May 28 13:58:13.807835 np0000001643 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 28 13:58:15.543553 np0000001643 nova-compute[98269]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98269) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 13:58:15.544000 np0000001643 nova-compute[98269]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98269) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 13:58:15.544102 np0000001643 nova-compute[98269]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 28 13:58:15.661961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 13:58:15.675517 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.014s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 13:58:15.826902 np0000001643 nova-compute[98269]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 28 13:58:16.584373 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [None req-3182639a-4800-43d8-a638-198de5058f29 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 28 13:58:16.584373 np0000001643 nova-compute[98269]: INFO nova.utils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] The long task thread pool MainProcess.long_task is initialized
May 28 13:58:16.584373 np0000001643 nova-compute[98269]: INFO nova.virt.driver [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 28 13:58:16.688655 np0000001643 nova-compute[98269]: INFO nova.compute.provider_config [None req-3182639a-4800-43d8-a638-198de5058f29 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 28 13:58:17.192474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Acquiring lock "singleton_lock" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 13:58:17.192474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Acquired lock "singleton_lock" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 13:58:17.192474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Releasing lock "singleton_lock" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 13:58:17.192474 np0000001643 nova-compute[98269]: WARNING oslo_service.backend._threading.service [None req-3182639a-4800-43d8-a638-198de5058f29 None None] no_fork=True: running service in main process
May 28 13:58:17.192474 np0000001643 nova-compute[98269]: INFO nova.service [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Starting compute node (version 33.1.0)
May 28 13:58:17.694711 np0000001643 nova-compute[98269]: INFO nova.utils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] The default thread pool MainProcess.default is initialized
May 28 13:58:17.695153 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 13:58:17.695294 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Starting event thread {{(pid=98269) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 28 13:58:17.695685 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Starting connection event dispatch thread {{(pid=98269) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 28 13:58:17.696321 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Connecting to libvirt: qemu:///system {{(pid=98269) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 28 13:58:18.283819 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x71a7845af8c0> {{(pid=98269) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 28 13:58:18.284734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x71a7845af8c0> {{(pid=98269) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 28 13:58:18.285183 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Connection event '1' reason 'None'
May 28 13:58:18.788303 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Cannot update service status on host "np0000001643" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001643 could not be found.
May 28 13:58:18.788303 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.mount [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Initialising _HostMountState generation 0 {{(pid=98269) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 28 13:58:29.032676 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host capabilities <capabilities>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:   <host>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:     <uuid>b7ee3189-dc86-4151-9082-28c325413c1b</uuid>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:     <cpu>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <arch>x86_64</arch>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <model>EPYC-Milan</model>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <microcode version='16777317'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <signature family='25' model='1' stepping='1'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <maxphysaddr mode='emulate' bits='40'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='x2apic'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='tsc-deadline'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='osxsave'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='hypervisor'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='tsc_adjust'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='ospke'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='vaes'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='vpclmulqdq'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='spec-ctrl'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='stibp'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='arch-capabilities'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='ssbd'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='cmp_legacy'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='topoext'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='stibp-always-on'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='virt-ssbd'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='amd-psfd'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='lbrv'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='tsc-scale'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='vmcb-clean'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='flushbyasid'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='pause-filter'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='pfthreshold'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='v-vmsave-vmload'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='vgif'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='no-nested-data-bp'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='lfence-always-serializing'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='null-sel-clr-base'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='rdctl-no'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='skip-l1dfl-vmentry'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='mds-no'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='pschange-mc-no'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <feature name='gds-no'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <pages unit='KiB' size='4'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <pages unit='KiB' size='2048'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <pages unit='KiB' size='1048576'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:     </cpu>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:     <power_management/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:     <iommu support='no'/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:     <migration_features>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <live/>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       <uri_transports>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:         <uri_transport>tcp</uri_transport>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:         <uri_transport>rdma</uri_transport>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:       </uri_transports>
May 28 13:58:29.032676 np0000001643 nova-compute[98269]:     </migration_features>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:     <topology>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <cells num='1'>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:         <cell id='0'>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           <memory unit='KiB'>24607184</memory>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           <pages unit='KiB' size='4'>6151796</pages>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           <pages unit='KiB' size='2048'>0</pages>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           <pages unit='KiB' size='1048576'>0</pages>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           <distances>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <sibling id='0' value='10'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           </distances>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           <cpus num='12'>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:           </cpus>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:         </cell>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       </cells>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:     </topology>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:     <cache>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 28 13:58:29.034643 np0000001643 nova-compute[98269]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     </cache>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     <secmodel>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <model>apparmor</model>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <doi>0</doi>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     </secmodel>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     <secmodel>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <model>dac</model>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <doi>0</doi>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     </secmodel>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:   </host>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     <arch name='alpha'>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>clipper</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:     <arch name='armv6l'>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>borzoi</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>spitz</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>nuri</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>musca-b1</machine>
May 28 13:58:29.035466 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>versatileab</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>kzm</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>musca-a</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>smdkc210</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sx1</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>z2</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>tosa</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>sabrelite</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>realview-eb</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>n810</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>n800</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 13:58:29.036865 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>versatilepb</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>terrier</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mainstone</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>integratorcp</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>midway</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>musicpal</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>microbit</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='3'>fby35</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>cubieboard</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>verdex</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>bpim2u</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>netduino2</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>raspi2b</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>cheetah</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 13:58:29.037762 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>highbank</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>akita</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>connex</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>collie</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>raspi0</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:     <arch name='armv7l'>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>borzoi</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>spitz</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>nuri</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>musca-b1</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>versatileab</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>kzm</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>musca-a</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 13:58:29.038670 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>smdkc210</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sx1</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>z2</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>tosa</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>sabrelite</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>realview-eb</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>n810</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>n800</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>versatilepb</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>terrier</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mainstone</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>integratorcp</machine>
May 28 13:58:29.039742 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>midway</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>musicpal</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>microbit</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='3'>fby35</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>cubieboard</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>verdex</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>bpim2u</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>netduino2</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>raspi2b</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>cheetah</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>highbank</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>akita</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>connex</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>collie</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>raspi0</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 13:58:29.040609 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:     <arch name='aarch64'>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>borzoi</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>spitz</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>nuri</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>musca-b1</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>versatileab</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>kzm</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>musca-a</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>smdkc210</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sx1</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 13:58:29.041541 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>z2</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>tosa</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>sabrelite</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>realview-eb</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>sbsa-ref</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>n810</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>n800</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>versatilepb</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>terrier</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mainstone</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>integratorcp</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 13:58:29.042595 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>midway</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>musicpal</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>microbit</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='3'>fby35</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>raspi3ap</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>cubieboard</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>verdex</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>bpim2u</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>netduino2</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>raspi3b</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>raspi2b</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>cheetah</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>highbank</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>akita</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>connex</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>collie</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>raspi0</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <acpi default='on' toggle='yes'/>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.043482 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     <arch name='cris'>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>axis-dev88</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:     <arch name='i686'>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 13:58:29.044437 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>x-remote</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 13:58:29.045511 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>isapc</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 13:58:29.046504 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>microvm</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 13:58:29.047407 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <domain type='kvm'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <pae/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <nonpae/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <acpi default='on' toggle='yes'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <apic default='on' toggle='no'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <arch name='m68k'>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mcf5208evb</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-7.0</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>an5206</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-6.0</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>q800</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-8.1</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-7.2</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-6.2</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-8.0</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>next-cube</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-7.1</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-6.1</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virt-8.2</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <arch name='microblaze'>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:     <arch name='microblazeel'>
May 28 13:58:29.048253 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <arch name='mips'>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='16'>malta</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mipssim</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <arch name='mipsel'>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='16'>malta</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mipssim</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <arch name='mips64'>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='16'>malta</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mipssim</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>pica61</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>magnum</machine>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:     <arch name='mips64el'>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 28 13:58:29.049623 np0000001643 nova-compute[98269]:       <machine maxCpus='16'>malta</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='16'>loongson3-virt</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mipssim</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>pica61</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>magnum</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='16'>boston</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>fuloong2e</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     <arch name='ppc'>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>g3beige</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>amigaone</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mac99</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>ppce500</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sam460ex</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>pegasos2</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>bamboo</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>40p</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ref405ep</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:     <arch name='ppc64'>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>amigaone</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='2048'>powernv9</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 13:58:29.051227 np0000001643 nova-compute[98269]:       <machine maxCpus='2048'>powernv10</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>ppce500</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>40p</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>pegasos2</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>bamboo</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>g3beige</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 13:58:29.052458 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mac99</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sam460ex</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ref405ep</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='2048'>powernv8</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:     <arch name='ppc64le'>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>amigaone</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='2048'>powernv9</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='2048'>powernv10</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>ppce500</machine>
May 28 13:58:29.053316 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>40p</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>pegasos2</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>bamboo</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>g3beige</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>mac99</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 13:58:29.054303 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sam460ex</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>ref405ep</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='2048'>powernv8</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <arch name='riscv32'>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='8'>spike</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>opentitan</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='5'>sifive_u</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sifive_e</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <arch name='riscv64'>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='512'>virt</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='8'>spike</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='5'>sifive_u</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>shakti_c</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sifive_e</machine>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:     <arch name='s390x'>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 28 13:58:29.055103 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 28 13:58:29.056496 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <arch name='sh4'>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>shix</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>r2d</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <arch name='sh4eb'>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>shix</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>r2d</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:     <arch name='sparc'>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>SS-5</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>SS-20</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>LX</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>SPARCClassic</machine>
May 28 13:58:29.057334 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>leon3_generic</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>SPARCbook</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>SS-4</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>SS-600MP</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>SS-10</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>Voyager</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     <arch name='sparc64'>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sun4u</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>niagara</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>sun4v</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:     <arch name='x86_64'>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <wordsize>64</wordsize>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 13:58:29.058646 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>x-remote</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 13:58:29.059763 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='1'>isapc</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 13:58:29.060546 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>microvm</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 13:58:29.061254 np0000001643 nova-compute[98269]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <domain type='kvm'/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <acpi default='on' toggle='yes'/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <apic default='on' toggle='no'/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     <arch name='xtensa'>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>sim</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>kc705</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>ml605</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>virt</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx200</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx60</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:   <guest>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     <os_type>hvm</os_type>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:     <arch name='xtensaeb'>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <wordsize>32</wordsize>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='4'>sim</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>kc705</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>ml605</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 13:58:29.061936 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>virt</machine>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx200</machine>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>lx60</machine>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <domain type='qemu'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     </arch>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <features>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <cpuselection/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <deviceboot/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <disksnapshot default='on' toggle='no'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <externalSnapshot/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     </features>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   </guest>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]: </capabilities>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]: 
May 28 13:58:29.062946 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.062946 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 28 13:58:29.062946 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-alpha</path>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <machine>clipper</machine>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <arch>alpha</arch>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <vcpu max='4'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.062946 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.064055 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.065301 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.065301 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 28 13:58:29.065301 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-arm</path>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <machine>virt-8.2</machine>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <arch>armv6l</arch>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <vcpu max='512'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.065301 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 13:58:29.066370 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.067109 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <gic supported='yes'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       <enum name='version'>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>2</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:         <value>3</value>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     </gic>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.068137 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.069735 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 28 13:58:29.069735 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-arm</path>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <machine>virt-8.2</machine>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <arch>armv6l</arch>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <vcpu max='512'/>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 13:58:29.069735 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.070503 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.071218 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <gic supported='yes'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <enum name='version'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>2</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>3</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     </gic>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.072380 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.072380 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 28 13:58:29.072380 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-arm</path>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <machine>virt-8.2</machine>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <arch>armv7l</arch>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <vcpu max='512'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <enum name='firmware'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <value>efi</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.072380 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 13:58:29.073457 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.074097 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     <gic supported='yes'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       <enum name='version'>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>2</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:         <value>3</value>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.075060 np0000001643 nova-compute[98269]:     </gic>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.076240 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.076240 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 28 13:58:29.076240 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-aarch64</path>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <machine>virt-8.2</machine>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <arch>aarch64</arch>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <vcpu max='512'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <enum name='firmware'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <value>efi</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 28 13:58:29.076240 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 28 13:58:29.077139 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.077640 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:     <gic supported='yes'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:       <enum name='version'>
May 28 13:58:29.078610 np0000001643 nova-compute[98269]:         <value>2</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>3</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     </gic>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.080062 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.080062 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 28 13:58:29.080062 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-cris</path>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <machine>axis-dev88</machine>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <arch>cris</arch>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.080062 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <redirdev supported='no'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.081028 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.082271 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.082271 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 28 13:58:29.082271 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-i386</path>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <machine>pc-i440fx-noble-v2</machine>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <arch>i686</arch>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <vcpu max='255'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.082271 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='lm'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 13:58:29.083120 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.083800 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.084442 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.085508 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.086793 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 28 13:58:29.086793 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-i386</path>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <machine>pc-q35-noble-v2</machine>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <arch>i686</arch>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <vcpu max='1024'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.086793 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='lm'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.088113 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.088875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.089541 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.090554 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.091819 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 28 13:58:29.091819 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-i386</path>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <machine>pc-q35-noble</machine>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <arch>i686</arch>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <vcpu max='1024'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.091819 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='lm'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.092875 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.093733 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.094193 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.095308 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.096688 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 28 13:58:29.096688 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-i386</path>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <machine>pc-i440fx-noble</machine>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <arch>i686</arch>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <vcpu max='255'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.096688 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='lm'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.097865 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.098633 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.099153 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.100607 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.102098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.102098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 28 13:58:29.102098 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <machine>mcf5208evb</machine>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <arch>m68k</arch>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.102098 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.103169 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <redirdev supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.104414 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 28 13:58:29.104414 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <machine>virt-8.2</machine>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <arch>m68k</arch>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.104414 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <redirdev supported='no'/>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.105553 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.106918 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.106918 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 28 13:58:29.106918 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-microblaze</path>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <machine>petalogix-s3adsp1800</machine>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <arch>microblaze</arch>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.106918 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <redirdev supported='no'/>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.108013 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.109406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.109406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 28 13:58:29.109406 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <machine>petalogix-s3adsp1800</machine>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <arch>microblazeel</arch>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.109406 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <redirdev supported='no'/>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.110428 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.111806 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.111806 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 28 13:58:29.111806 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-mips</path>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <machine>malta</machine>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <arch>mips</arch>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <vcpu max='16'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.111806 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.112845 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.114043 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.114043 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 28 13:58:29.114043 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-mipsel</path>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <machine>malta</machine>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <arch>mipsel</arch>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <vcpu max='16'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.114043 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.115031 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.116279 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.116279 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 28 13:58:29.116279 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-mips64</path>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <machine>malta</machine>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <arch>mips64</arch>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <vcpu max='16'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.116279 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.117333 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.118614 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.119658 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.119658 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 28 13:58:29.119658 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-mips64el</path>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <machine>malta</machine>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <arch>mips64el</arch>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <vcpu max='16'/>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.119658 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.120698 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.121996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.121996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 28 13:58:29.121996 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-ppc</path>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <machine>g3beige</machine>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <arch>ppc</arch>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.121996 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.123033 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.124659 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.124659 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 28 13:58:29.124659 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <machine>pseries-noble</machine>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <arch>ppc64</arch>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <vcpu max='4096'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.124659 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.125938 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>tpm-spapr</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>spapr-tpm-proxy</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.127888 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.129274 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 28 13:58:29.129274 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <machine>pseries-noble</machine>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <arch>ppc64</arch>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <vcpu max='4096'/>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.129274 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>tpm-spapr</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>spapr-tpm-proxy</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.130266 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.131630 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 28 13:58:29.131630 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <machine>powernv9</machine>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <arch>ppc64</arch>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <vcpu max='2048'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.131630 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.132780 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>tpm-spapr</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>spapr-tpm-proxy</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.134168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.134168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 28 13:58:29.134168 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 13:58:29.134168 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <machine>pseries-noble</machine>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <arch>ppc64le</arch>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <vcpu max='4096'/>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.135142 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>tpm-spapr</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>spapr-tpm-proxy</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.136274 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.137467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 28 13:58:29.137467 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <machine>powernv9</machine>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <arch>ppc64le</arch>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <vcpu max='2048'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.137467 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>tpm-spapr</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:         <value>spapr-tpm-proxy</value>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.138567 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.139778 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.139778 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 28 13:58:29.139778 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-riscv32</path>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <machine>virt</machine>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <arch>riscv32</arch>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <vcpu max='512'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.139778 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.140767 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.142073 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.143277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.143277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 28 13:58:29.143277 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-riscv64</path>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <machine>virt</machine>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <arch>riscv64</arch>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <vcpu max='512'/>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>any</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.143277 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.144138 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.145353 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.145353 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 28 13:58:29.145353 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-s390x</path>
May 28 13:58:29.145353 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:   <machine>s390-ccw-virtio-noble</machine>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:   <arch>s390x</arch>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:   <vcpu max='248'/>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z13</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.3</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z13-base</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.2</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z14</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.4</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z196</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z114-base</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen16b</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen16a</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.5</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z196.2</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>zEC12</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9BC</model>
May 28 13:58:29.146353 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z890</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z13.2</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z14.2</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z196-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z14-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z800</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10EC</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z900</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>max</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen15b</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen15a</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z114</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z13s</model>
May 28 13:58:29.147199 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z890.3</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z890.2</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z890-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z10BC</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9EC</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>zBC12</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z990-base</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.147942 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <s390-pv supported='no'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.148830 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.150134 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.150134 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 28 13:58:29.150134 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-sh4</path>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <machine>shix</machine>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <arch>sh4</arch>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.150134 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.151035 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.152406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.152406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 28 13:58:29.152406 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <machine>shix</machine>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <arch>sh4eb</arch>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.152406 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.153498 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.154692 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.154692 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 28 13:58:29.154692 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-sparc</path>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <machine>SS-5</machine>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <arch>sparc</arch>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.154692 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <redirdev supported='no'/>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.155669 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <enum name='model'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.156837 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.156837 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 28 13:58:29.156837 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-sparc64</path>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <machine>sun4u</machine>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <arch>sparc64</arch>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <vcpu max='1'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.156837 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.157831 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.159186 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.159186 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 28 13:58:29.159186 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <machine>pc-i440fx-noble-v2</machine>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <arch>x86_64</arch>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <vcpu max='255'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <enum name='firmware'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <value>efi</value>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.159186 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.160197 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.161084 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.161702 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.162586 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.163977 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 28 13:58:29.163977 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <machine>pc-q35-noble-v2</machine>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <arch>x86_64</arch>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <vcpu max='1024'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     <enum name='firmware'>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:       <value>efi</value>
May 28 13:58:29.163977 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.165176 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 13:58:29.166059 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.166748 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.167420 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.168752 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.168752 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 28 13:58:29.168752 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <machine>pc-q35-noble</machine>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <arch>x86_64</arch>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <vcpu max='1024'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     <enum name='firmware'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <value>efi</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.169892 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.170861 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.171413 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.172029 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.173292 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.174537 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 28 13:58:29.174537 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <machine>pc-i440fx-noble</machine>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <arch>x86_64</arch>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <vcpu max='255'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     <enum name='firmware'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <value>efi</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='yes'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <enum name='maximumMigratable'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:         <value>on</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:         <value>off</value>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='yes'>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <model fallback='forbid'>EPYC</model>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <vendor>AMD</vendor>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='acpi'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='ss'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='monitor'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='hypervisor'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='erms'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='mpx'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='pcommit'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='clwb'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='umip'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='pku'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='vaes'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='la57'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='rdpid'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='pks'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrm'/>
May 28 13:58:29.174537 np0000001643 nova-compute[98269]:       <feature policy='require' name='fzrm'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrs'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='fsrc'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnowext'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='3dnow'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='xsaveerptr'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='wbnoinvd'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='npt'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='vgif'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='require' name='svme-addr-chk'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='disable' name='vme'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='disable' name='xsavec'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='disable' name='fxsr_opt'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='disable' name='misalignsse'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='disable' name='osvw'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='disable' name='topoext'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <feature policy='disable' name='nrip-save'/>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:     <mode name='custom' supported='yes'>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 13:58:29.175352 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 13:58:29.175982 np0000001643 nova-compute[98269]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <model usable='yes' vendor='unknown'>486</model>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     </mode>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>ide</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>vmvga</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>qxl</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>ramfb</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.176492 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <tpm supported='yes'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>tpm-tis</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>tpm-crb</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>passthrough</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>emulator</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>external</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='backendVersion'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>1.2</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>2.0</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     </tpm>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='yes'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <genid supported='yes'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:     <hyperv supported='yes'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       <enum name='features'>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>relaxed</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>vapic</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>spinlocks</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>vpindex</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>runtime</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>synic</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>stimer</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>reset</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>vendor_id</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>frequencies</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>reenlightenment</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>tlbflush</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>ipi</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:         <value>avic</value>
May 28 13:58:29.177696 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     </hyperv>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.178983 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.178983 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 28 13:58:29.178983 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-xtensa</path>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <machine>sim</machine>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <arch>xtensa</arch>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <vcpu max='4'/>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.178983 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.179992 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.181185 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 13:58:29.181185 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 28 13:58:29.181185 np0000001643 nova-compute[98269]: <domainCapabilities>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <domain>qemu</domain>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <machine>sim</machine>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <arch>xtensaeb</arch>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <vcpu max='4'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <iothreads supported='yes'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <os supported='yes'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <enum name='firmware'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <loader supported='yes'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:         <value>rom</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:         <value>pflash</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <enum name='readonly'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:         <value>yes</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <enum name='secure'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:         <value>no</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     </loader>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   </os>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <cpu>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <mode name='host-passthrough' supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <mode name='maximum' supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <mode name='host-model' supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <mode name='custom' supported='no'/>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   </cpu>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   <memoryBacking supported='yes'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     <enum name='sourceType'>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <value>file</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <value>anonymous</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:       <value>memfd</value>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:     </enum>
May 28 13:58:29.181185 np0000001643 nova-compute[98269]:   </memoryBacking>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:   <devices>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     <disk supported='yes'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='diskDevice'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>disk</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>cdrom</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>floppy</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>lun</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>fdc</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>sata</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     </disk>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     <graphics supported='yes'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>sdl</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>vnc</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>spice</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>egl-headless</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>dbus</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     </graphics>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     <video supported='yes'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='modelType'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>vga</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>cirrus</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>none</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>bochs</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     </video>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     <hostdev supported='yes'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='mode'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>subsystem</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='startupPolicy'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>default</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>mandatory</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>requisite</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>optional</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='subsysType'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>pci</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>scsi</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='capsType'/>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='pciBackend'/>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     </hostdev>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     <rng supported='yes'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio-transitional</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtio-non-transitional</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>random</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>egd</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     </rng>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     <filesystem supported='yes'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       <enum name='driverType'>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>path</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>handle</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:         <value>virtiofs</value>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     </filesystem>
May 28 13:58:29.182145 np0000001643 nova-compute[98269]:     <tpm supported='no'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <redirdev supported='yes'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       <enum name='bus'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:         <value>usb</value>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     </redirdev>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <channel supported='yes'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:         <value>pty</value>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:         <value>unix</value>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:         <value>spicevmc</value>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     </channel>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <crypto supported='yes'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       <enum name='model'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:         <value>virtio</value>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       <enum name='type'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:         <value>qemu</value>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       <enum name='backendModel'>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:         <value>builtin</value>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:       </enum>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     </crypto>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:   </devices>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:   <features>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <gic supported='no'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <vmcoreinfo supported='no'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <genid supported='no'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <backingStoreInput supported='yes'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <backup supported='yes'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <async-teardown supported='yes'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <sev supported='no'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:     <sgx supported='no'/>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:   </features>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]: </domainCapabilities>
May 28 13:58:29.183335 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 13:58:29.183335 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Checking secure boot support for host arch (x86_64) {{(pid=98269) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 13:58:29.183335 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Checking secure boot support for host arch (x86_64) {{(pid=98269) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 13:58:29.183335 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Checking secure boot support for host arch (x86_64) {{(pid=98269) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 13:58:29.183335 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Secure Boot support detected
May 28 13:58:29.637325 np0000001643 nova-compute[98269]: INFO nova.virt.node [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Generated node identity f568fd9c-b967-45a3-9c51-ad00d748c4b7
May 28 13:58:29.637579 np0000001643 nova-compute[98269]: INFO nova.virt.node [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Wrote node identity f568fd9c-b967-45a3-9c51-ad00d748c4b7 to /opt/stack/data/nova/compute_id
May 28 13:58:30.139900 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Compute nodes ['f568fd9c-b967-45a3-9c51-ad00d748c4b7'] for host np0000001643 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 28 13:58:31.143577 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 28 13:58:32.148133 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [None req-3182639a-4800-43d8-a638-198de5058f29 None None] No compute node record found for host np0000001643. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001643 could not be found.
May 28 13:58:32.148701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 13:58:32.148701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 13:58:32.148701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 13:58:32.148701 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 13:58:32.208109 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-3182639a-4800-43d8-a638-198de5058f29 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 13:58:32.208895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 13:58:32.223733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 13:58:32.224110 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=16542MB free_disk=75.20537948608398GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 13:58:32.224279 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 13:58:32.224501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 13:58:32.727755 np0000001643 nova-compute[98269]: WARNING nova.compute.resource_tracker [None req-3182639a-4800-43d8-a638-198de5058f29 None None] No compute node record for np0000001643:f568fd9c-b967-45a3-9c51-ad00d748c4b7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f568fd9c-b967-45a3-9c51-ad00d748c4b7 could not be found.
May 28 13:58:33.231767 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Compute node record created for np0000001643:np0000001643 with uuid: f568fd9c-b967-45a3-9c51-ad00d748c4b7
May 28 13:58:34.738653 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 13:58:34.739019 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 13:58:32 up 25 min,  2 users,  load average: 1.98, 1.30, 0.70\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 13:58:35.180353 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-3182639a-4800-43d8-a638-198de5058f29 None None] [req-503de127-a281-46e8-ab55-883f36e5ff89] Created resource provider record via placement API for resource provider with UUID f568fd9c-b967-45a3-9c51-ad00d748c4b7 and name np0000001643.
May 28 13:58:35.232932 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 28 13:58:35.232932 np0000001643 nova-compute[98269]: ] {{(pid=98269) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 28 13:58:35.233087 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.host [None req-3182639a-4800-43d8-a638-198de5058f29 None None] kernel doesn't support AMD SEV
May 28 13:58:35.233293 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 13:58:35.233520 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 13:58:35.233832 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3182639a-4800-43d8-a638-198de5058f29 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 13:58:35.237461 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Libvirt baseline CPU <cpu>
May 28 13:58:35.237461 np0000001643 nova-compute[98269]:   <arch>x86_64</arch>
May 28 13:58:35.237461 np0000001643 nova-compute[98269]:   <model>Nehalem</model>
May 28 13:58:35.237461 np0000001643 nova-compute[98269]:   <vendor>AMD</vendor>
May 28 13:58:35.237461 np0000001643 nova-compute[98269]:   <topology sockets="12" cores="1" threads="1"/>
May 28 13:58:35.237461 np0000001643 nova-compute[98269]:   <maxphysaddr mode="emulate" bits="40"/>
May 28 13:58:35.237461 np0000001643 nova-compute[98269]: </cpu>
May 28 13:58:35.237461 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 28 13:58:35.806929 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Updated inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 28 13:58:35.807416 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Updating resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 generation from 0 to 1 during operation: update_inventory {{(pid=98269) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 13:58:35.807416 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 13:58:35.981428 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Updating resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 generation from 1 to 2 during operation: update_traits {{(pid=98269) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 13:58:36.490948 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 13:58:36.491105 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.267s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 13:58:36.491255 np0000001643 nova-compute[98269]: DEBUG nova.service [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98269) start /opt/stack/nova/nova/service.py:195}}
May 28 13:58:36.506541 np0000001643 nova-compute[98269]: DEBUG nova.service [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98269) start /opt/stack/nova/nova/service.py:211}}
May 28 13:58:36.519486 np0000001643 nova-compute[98269]: DEBUG nova.service [None req-3182639a-4800-43d8-a638-198de5058f29 None None] Join ServiceGroup membership for this service compute {{(pid=98269) start /opt/stack/nova/nova/service.py:221}}
May 28 13:58:36.519640 np0000001643 nova-compute[98269]: DEBUG nova.servicegroup.drivers.db [None req-3182639a-4800-43d8-a638-198de5058f29 None None] DB_Driver: join new ServiceGroup member np0000001643 to the compute group, service = <Service: host=np0000001643, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98269) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 28 13:58:42.022677 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 13:59:02.521016 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:03.024008 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:03.024892 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 12.80 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 13:59:15.827985 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:15.828818 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:15.829181 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:15.829496 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:15.829733 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:15.829999 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:15.830301 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:15.830585 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 13:59:15.830895 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 13:59:16.334953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 13:59:16.334953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 13:59:16.334953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 13:59:16.334953 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 13:59:16.346482 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 13:59:16.346482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 13:59:16.360029 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 13:59:16.361209 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=16290MB free_disk=75.11236953735352GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 13:59:16.361618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 13:59:16.362002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 13:59:17.412726 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 13:59:17.413230 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 13:59:16 up 25 min,  2 users,  load average: 1.44, 1.25, 0.72\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 13:59:17.457424 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 13:59:17.457679 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 13:59:17.960176 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 13:59:18.466409 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 13:59:18.466910 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.105s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 13:59:18.467030 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:00:18.461225 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.462274 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.462274 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.463044 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.463044 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.463298 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.463564 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.463927 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.463927 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:00:18.464256 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:00:18.968957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:00:18.968957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:00:18.968957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:00:18.968957 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:00:18.977202 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:00:18.978423 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:00:18.996381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:00:18.998876 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=16370MB free_disk=74.88081741333008GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:00:18.998876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:00:18.999319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:00:20.065164 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:00:20.065601 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:00:18 up 26 min,  2 users,  load average: 0.85, 1.12, 0.72\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:00:20.128994 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:00:20.129290 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:00:20.632138 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:00:21.139182 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:00:21.139735 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.142s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:00:21.139791 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:00:42.025587 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:01:03.683092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:03.683092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:04.184646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:04.779152 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:04.780506 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:04.783351 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:04.783774 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Claim successful on node np0000001643
May 28 14:01:05.899922 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:05.900376 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:06.403193 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:06.910665 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.131s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:06.911283 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:07.420147 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:07.420479 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:07.423281 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:07.424880 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:07.928859 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:08.432773 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:09.210529 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bc42ce4e1db4814a59fc552b56feb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c23cc7052a24f979780596790cb86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:09.444377 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:09.445509 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:09.445730 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Creating image(s)
May 28 14:01:09.446233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "/opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:09.446439 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "/opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:09.447120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "/opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:09.447742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:09.448122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:09.795098 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:09.799626 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:09.800047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:09.836245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:09.836495 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:09.866630 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.part --force-share --output=json" returned: 0 in 0.066s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:09.867381 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] ad923155-4eca-4cf1-b871-662172c18500 was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:01:09.867694 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:01:09.867952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.part /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:10.029746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.part /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.converted" returned: 0 in 0.161s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:10.035107 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:10.104108 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476.converted --force-share --output=json" returned: 0 in 0.069s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:10.107472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.657s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:10.107472 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:10.108735 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:10.109616 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp754es9v8/privsep.sock']
May 28 14:01:10.117076 np0000001643 sudo[109567]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp754es9v8/privsep.sock
May 28 14:01:10.117817 np0000001643 sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 14:01:10.339677 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:10.403926 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 14:01:10.403926 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 14:01:10.403926 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 14:01:10.404433 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:10.404433 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 14:01:10.404433 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 14:01:10.404433 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 14:01:10.404433 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:10.404433 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 14:01:10.770459 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 14:01:10.770459 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 14:01:10.770459 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 14:01:10.770459 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:10.770459 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 14:01:10.770647 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 14:01:10.770647 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 14:01:10.770687 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:10.771312 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 14:01:10.793083 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Successfully created port: c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:10.937545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:10.938150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:10.943135 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:10.943539 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Claim successful on node np0000001643
May 28 14:01:11.104622 np0000001643 sudo[109567]: pam_unix(sudo:session): session closed for user root
May 28 14:01:11.106694 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Spawned new privsep daemon via rootwrap
May 28 14:01:11.107933 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 14:01:11.107933 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 14:01:11.107933 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 28 14:01:11.107933 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109591
May 28 14:01:11.178865 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:11.246256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.067s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:11.246256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:11.246918 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:11.247515 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:11.251208 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:11.251667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:11.318949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.067s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:11.319411 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:11.347662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk 1073741824" returned: 0 in 0.028s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:11.348757 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.101s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:11.348757 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:11.423908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.074s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:11.428591 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:11.428591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:11.502544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:11.503202 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Cannot resize image /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:11.503813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:11.504034 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Ensure instance console log exists: /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:11.504412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:11.504687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:11.504889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:12.156219 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:12.156508 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:12.191845 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:12.191998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:12.660161 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:12.693657 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:12.822280 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Successfully updated port: c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:13.169610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.232s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:13.170117 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:13.248609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:13.248786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:13.251553 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:13.251692 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Claim successful on node np0000001643
May 28 14:01:13.324830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "refresh_cache-97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:13.324958 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquired lock "refresh_cache-97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:13.325089 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:13.677018 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:13.677536 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:13.677939 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:13.678214 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:14.011759 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d135543093d4ca0849ab043df8e19ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a792bdb63c954739ad33cb2fedeedee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:14.094061 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:14.181640 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:14.217944 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7afb34de-b077-486c-b1e8-824c84ae49aa req-1a8154d0-999d-4068-8e84-70aae5ddb1a1 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:14.218230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7afb34de-b077-486c-b1e8-824c84ae49aa req-1a8154d0-999d-4068-8e84-70aae5ddb1a1 service nova] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:14.218530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7afb34de-b077-486c-b1e8-824c84ae49aa req-1a8154d0-999d-4068-8e84-70aae5ddb1a1 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:14.218645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7afb34de-b077-486c-b1e8-824c84ae49aa req-1a8154d0-999d-4068-8e84-70aae5ddb1a1 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:14.218826 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7afb34de-b077-486c-b1e8-824c84ae49aa req-1a8154d0-999d-4068-8e84-70aae5ddb1a1 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] No waiting events found dispatching network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:14.219014 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-7afb34de-b077-486c-b1e8-824c84ae49aa req-1a8154d0-999d-4068-8e84-70aae5ddb1a1 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received unexpected event network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 for instance with vm_state building and task_state spawning.
May 28 14:01:14.436722 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-changed-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:14.436939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Refreshing instance network info cache due to event network-changed-c1341c24-2f36-4a83-9689-177abf10a391. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:14.437113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] Acquiring lock "refresh_cache-97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:14.520097 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:14.520298 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:14.685375 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:15.022735 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:15.207730 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:15.208129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:15.531568 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.283s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:15.531994 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:15.698795 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:15.700280 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:15.700743 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Creating image(s)
May 28 14:01:15.701618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "/opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:15.701833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:15.702545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:15.703906 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:15.708692 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:15.710606 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:15.717436 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Successfully created port: 0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:15.718715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:15.752657 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:15.793055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.075s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:15.793055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:15.793292 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:15.793759 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:15.796230 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:15.796887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:15.864038 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.067s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:15.864864 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:15.900756 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk 1073741824" returned: 0 in 0.036s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:15.901389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.108s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:15.901863 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:15.990649 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:15.990649 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:15.997801 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:16.043004 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:16.043004 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:16.043004 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:16.043004 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:16.085379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:16.086631 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Cannot resize image /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:16.086631 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:16.086938 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Ensure instance console log exists: /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:16.087247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:16.087418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:16.087635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:16.216644 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Updating instance_info_cache with network_info: [{"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:16.277072 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:16.277397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:16.282206 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:16.282827 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Claim successful on node np0000001643
May 28 14:01:16.291628 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04df1c95329f4b4e96ae705243c3fd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f245e8060643a4a760a0d26845e019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:16.545494 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 28 14:01:16.565993 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Successfully updated port: 0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:16.641998 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-changed-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:16.642177 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Refreshing instance network info cache due to event network-changed-0384c22d-d24f-466b-b3b2-61e8dc476888. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:16.642335 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] Acquiring lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:16.642443 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] Acquired lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:16.642561 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Refreshing network info cache for port 0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:16.718620 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Releasing lock "refresh_cache-97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:16.719033 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Instance network_info: |[{"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:16.721530 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Start _get_guest_xml network_info=[{"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:16.723305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] Acquired lock "refresh_cache-97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:16.723305 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Refreshing network info cache for port c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:16.731192 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:16.732836 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-789844248', uuid='97eb14df-abb4-41e7-bc37-5b4c6c74eaa8'), owner=OwnerMeta(userid='4bc42ce4e1db4814a59fc552b56feb73', username='tempest-DeleteServersTestJSON-1854035852-project-member', projectid='9c23cc7052a24f979780596790cb86ec', projectname='tempest-DeleteServersTestJSON-1854035852'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976876.7320745) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:16.734606 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:16.735027 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:16.735758 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:16.736324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:16.737525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:16.737930 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:16.738399 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:16.738399 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:16.738659 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:16.738659 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:16.738890 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:16.739433 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:16.739613 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:16.740185 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:16.740185 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:16.740384 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:16.755534 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:01:16.756775 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-789844248',display_name='tempest-DeleteServersTestJSON-server-789844248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-deleteserverstestjson-server-789844248',id=1,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c23cc7052a24f979780596790cb86ec',ramdisk_id='',reservation_id='r-l0ts3b7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1854035852',owner_user_name='tempest-DeleteServersTestJSON-1854035852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:08Z,user_data=None,user_id='4bc42ce4e1db4814a59fc552b56feb73',uuid=97eb14df-abb4-41e7-bc37-5b4c6c74eaa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:16.757362 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Converting VIF {"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:16.758645 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:09,bridge_name='br-int',has_traffic_filtering=True,id=c1341c24-2f36-4a83-9689-177abf10a391,network=Network(4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1341c24-2f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:16.760185 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lazy-loading 'pci_devices' on Instance uuid 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:17.048678 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:17.068767 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:17.070697 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Successfully created port: 5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:17.144503 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:17.226173 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:17.263500 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <uuid>97eb14df-abb4-41e7-bc37-5b4c6c74eaa8</uuid>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <name>instance-00000001</name>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:name>tempest-DeleteServersTestJSON-server-789844248</nova:name>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:16</nova:creationTime>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:user uuid="4bc42ce4e1db4814a59fc552b56feb73">tempest-DeleteServersTestJSON-1854035852-project-member</nova:user>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:project uuid="9c23cc7052a24f979780596790cb86ec">tempest-DeleteServersTestJSON-1854035852</nova:project>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         <nova:port uuid="c1341c24-2f36-4a83-9689-177abf10a391">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <entry name="serial">97eb14df-abb4-41e7-bc37-5b4c6c74eaa8</entry>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <entry name="uuid">97eb14df-abb4-41e7-bc37-5b4c6c74eaa8</entry>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk.config"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:b7:2e:09"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <target dev="tapc1341c24-2f"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/console.log" append="off"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:17.263500 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:17.263500 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Preparing to wait for external event network-vif-plugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:17.265689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:17.265689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:17.265689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:17.266273 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-789844248',display_name='tempest-DeleteServersTestJSON-server-789844248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-deleteserverstestjson-server-789844248',id=1,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c23cc7052a24f979780596790cb86ec',ramdisk_id='',reservation_id='r-l0ts3b7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1854035852',owner_user_name='tempest-DeleteServersTestJSON-1854035852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:08Z,user_data=None,user_id='4bc42ce4e1db4814a59fc552b56feb73',uuid=97eb14df-abb4-41e7-bc37-5b4c6c74eaa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:17.266471 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Converting VIF {"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:17.267180 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:09,bridge_name='br-int',has_traffic_filtering=True,id=c1341c24-2f36-4a83-9689-177abf10a391,network=Network(4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1341c24-2f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:17.267597 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:09,bridge_name='br-int',has_traffic_filtering=True,id=c1341c24-2f36-4a83-9689-177abf10a391,network=Network(4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1341c24-2f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:17.327439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Created schema index Interface.name {{(pid=98269) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 14:01:17.327633 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Created schema index Port.name {{(pid=98269) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 14:01:17.327690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Created schema index Bridge.name {{(pid=98269) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 14:01:17.328136 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:01:17.328341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [POLLOUT] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.328409 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:01:17.328941 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.330723 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.356947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.380861 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.381427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:17.381521 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:17.382396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.382712 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02f52f11-ca74-5a82-a5fd-2a997739f7b8', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:17.384137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.385262 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:17.385821 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:17.387532 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpaf9e_2qy/privsep.sock']
May 28 14:01:17.394484 np0000001643 sudo[109974]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpaf9e_2qy/privsep.sock
May 28 14:01:17.395173 np0000001643 sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 14:01:17.644182 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:17.644529 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:17.666204 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 14:01:17.666308 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 14:01:17.666364 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 14:01:17.666409 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:17.666517 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 14:01:17.666579 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 14:01:17.666661 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 14:01:17.666725 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:17.666782 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 14:01:17.737567 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:17.792342 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Successfully updated port: 5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:17.994016 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 14:01:17.994146 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 14:01:17.994180 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 14:01:17.994259 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:17.994570 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 14:01:17.994570 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 14:01:17.994570 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 14:01:17.994570 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:17.994666 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 14:01:18.065853 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:18.066959 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:18.067223 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Creating image(s)
May 28 14:01:18.070997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "/opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:18.071202 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "/opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:18.071763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "/opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:18.072042 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "73c7b08d745939f0c3bda4a68d7168c18dad9d4f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:18.072410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "73c7b08d745939f0c3bda4a68d7168c18dad9d4f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:18.148368 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:18.293319 np0000001643 sudo[109974]: pam_unix(sudo:session): session closed for user root
May 28 14:01:18.296772 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Spawned new privsep daemon via rootwrap
May 28 14:01:18.297172 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 14:01:18.297269 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 14:01:18.298014 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:18.298149 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 28 14:01:18.298378 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquired lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:18.298558 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109987
May 28 14:01:18.298724 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:18.419827 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:18.486200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:18.486556 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:18.561543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:18.561543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1341c24-2f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:18.562013 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1341c24-2f, col_values=(('qos', UUID('e974e0ed-6d27-4f88-a400-7546e91fd545')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:18.563708 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1341c24-2f, col_values=(('external_ids', {'iface-id': 'c1341c24-2f36-4a83-9689-177abf10a391', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:2e:09', 'vm-uuid': '97eb14df-abb4-41e7-bc37-5b4c6c74eaa8'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:18.567087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:18.573713 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:18.574984 np0000001643 nova-compute[98269]: INFO os_vif [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:09,bridge_name='br-int',has_traffic_filtering=True,id=c1341c24-2f36-4a83-9689-177abf10a391,network=Network(4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1341c24-2f')
May 28 14:01:18.656488 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.379s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:18.656840 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:18.704048 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:18.728466 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-changed-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:18.728774 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Refreshing instance network info cache due to event network-changed-5ffb73f5-b443-4237-982b-9b6e2ee5aa36. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:18.729039 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] Acquiring lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:18.740596 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:18.924557 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd236ee0-7c23-41ec-b09c-2ee6d8490d92 req-cb634662-8c42-4bae-ada6-81eb35005f54 service nova] Releasing lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:18.924728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquired lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:18.925116 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:18.981266 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:18.989601 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:19.082435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:19.101602 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:19.106870 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:19.107708 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.168834 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:19.169105 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:19.169534 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:19.171866 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:19.177778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.part --force-share --output=json" returned: 0 in 0.070s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.178996 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] 316e6a5d-83ed-4422-87b4-30badb1c9930 was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:01:19.178996 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:01:19.179256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.part /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.208436 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Updated VIF entry in instance network info cache for port c1341c24-2f36-4a83-9689-177abf10a391. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:19.209601 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Updating instance_info_cache with network_info: [{"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:19.295411 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7f2227d939749fba2d87d475eced3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c4eed05b4d6787812ac3fb0c7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:19.372112 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.part /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.converted" returned: 0 in 0.193s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.377714 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.418739 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:19.452408 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f.converted --force-share --output=json" returned: 0 in 0.075s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.453199 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "73c7b08d745939f0c3bda4a68d7168c18dad9d4f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.381s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:19.453722 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:19.457033 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:19.459144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.536072 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.537999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "73c7b08d745939f0c3bda4a68d7168c18dad9d4f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:19.537999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "73c7b08d745939f0c3bda4a68d7168c18dad9d4f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:19.537999 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:19.540154 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:19.540512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.578351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:19.578680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:19.583831 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:19.584132 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Claim successful on node np0000001643
May 28 14:01:19.627102 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.628264 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f,backing_fmt=raw /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.661406 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f,backing_fmt=raw /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk 1073741824" returned: 0 in 0.033s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.661406 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "73c7b08d745939f0c3bda4a68d7168c18dad9d4f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.124s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:19.661837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.673366 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:19.712884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-db916a0a-3f22-4770-8d55-b89856f0246e req-4001373d-1c04-4ba2-8230-d4c6ed737f6d service nova] Releasing lock "refresh_cache-97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:19.755907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.756432 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:19.756686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:19.834291 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:19.835014 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Cannot resize image /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:19.835548 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:19.835811 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Ensure instance console log exists: /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:19.836401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:19.836720 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:19.837343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:19.949529 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Successfully created port: 830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:20.051427 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:20.103630 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:20.103801 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:20.103861 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] No VIF found with MAC fa:16:3e:b7:2e:09, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:20.104475 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Using config drive
May 28 14:01:20.147032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:20.187508 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:20.609180 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:20.690770 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Updating instance_info_cache with network_info: [{"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:20.711606 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Successfully updated port: 830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:20.919579 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:20.920123 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:21.020106 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-changed-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:21.020294 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Refreshing instance network info cache due to event network-changed-830e8040-3da9-453c-b4fa-7fa9197d9a4f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:21.020484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] Acquiring lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:21.020821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] Acquired lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:21.020959 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Refreshing network info cache for port 830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:21.140472 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.140904 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.141269 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.141578 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.141864 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.142180 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.142458 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.142720 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:01:21.142961 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:01:21.197526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Releasing lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:21.197526 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Instance network_info: |[{"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:21.197759 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] Acquired lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:21.201347 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Start _get_guest_xml network_info=[{"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T14:01:00Z,direct_url=<?>,disk_format='qcow2',id=316e6a5d-83ed-4422-87b4-30badb1c9930,min_disk=0,min_ram=0,name='',owner='85dd57447ae34601ad51521092fc8881',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T14:01:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'device_name': '/dev/sda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_options': None, 'image_id': '316e6a5d-83ed-4422-87b4-30badb1c9930'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:21.201998 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Refreshing network info cache for port 5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:21.203938 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:21.206885 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:21.206885 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Creating image(s)
May 28 14:01:21.206885 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:21.206885 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:21.207721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:21.208529 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:21.215156 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:21.219646 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:21.219646 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='316e6a5d-83ed-4422-87b4-30badb1c9930', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-389486882', uuid='af52b758-781b-4980-9e1d-5cb5924eee22'), owner=OwnerMeta(userid='04df1c95329f4b4e96ae705243c3fd6a', username='tempest-AttachSCSIVolumeTestJSON-448475147-project-member', projectid='19f245e8060643a4a760a0d26845e019', projectname='tempest-AttachSCSIVolumeTestJSON-448475147'), image=ImageMeta(id='316e6a5d-83ed-4422-87b4-30badb1c9930', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976881.2188914) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:21.220356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:21.221402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:21.234205 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:21.235200 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:21.236821 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:21.236821 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:21.239054 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:21.239895 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T14:01:00Z,direct_url=<?>,disk_format='qcow2',id=316e6a5d-83ed-4422-87b4-30badb1c9930,min_disk=0,min_ram=0,name='',owner='85dd57447ae34601ad51521092fc8881',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T14:01:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:21.240297 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:21.240757 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:21.240878 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:21.242472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:21.242472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:21.242472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:21.242472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:21.242472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:21.242472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:21.242472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:21.260683 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-389486882',display_name='tempest-AttachSCSIVolumeTestJSON-server-389486882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachscsivolumetestjson-server-389486882',id=3,image_ref='316e6a5d-83ed-4422-87b4-30badb1c9930',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtkvWaiZIq6LTOp6Gsz1I77N3P5UWkcFTkEV0AHtyFEQnGT5hintB6L+vg6Cyi1fPO7nJ9fZEGmIXsFyhgy+oVXAS5togWbiW/MVapP5bdmQt436BI98zod/3DK9PoJBQ==',key_name='tempest-keypair-237655966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19f245e8060643a4a760a0d26845e019',ramdisk_id='',reservation_id='r-58emjmdw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='316e6a5d-83ed-4422-87b4-30badb1c9930',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-448475147',owner_user_name='tempest-AttachSCSIVolumeTestJSON-448475147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04df1c95329f4b4e96ae705243c3fd6a',uuid=af52b758-781b-4980-9e1d-5cb5924eee22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:21.261423 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Converting VIF {"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:21.265322 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:16:a4,bridge_name='br-int',has_traffic_filtering=True,id=5ffb73f5-b443-4237-982b-9b6e2ee5aa36,network=Network(fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffb73f5-b4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:21.265322 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lazy-loading 'pci_devices' on Instance uuid af52b758-781b-4980-9e1d-5cb5924eee22 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:21.312330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:21.312831 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:21.313563 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:21.314008 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:21.317423 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:21.319311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:21.379274 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:21.402462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.083s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:21.403303 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:21.425419 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:21.437834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk 1073741824" returned: 0 in 0.035s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:21.438325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.125s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:21.438830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:21.516674 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:21.517241 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:21.517603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:21.525540 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:21.597479 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:21.597999 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Cannot resize image /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:21.598545 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:21.598742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Ensure instance console log exists: /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:21.599181 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:21.599418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:21.599604 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:21.644558 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Creating config drive at /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk.config
May 28 14:01:21.647981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:21.650597 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp83yn5_sn {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:21.681946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp83yn5_sn" returned: 0 in 0.031s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:21.708632 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:21.747476 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:21.772593 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <uuid>af52b758-781b-4980-9e1d-5cb5924eee22</uuid>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <name>instance-00000003</name>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-389486882</nova:name>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:21</nova:creationTime>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:image uuid="316e6a5d-83ed-4422-87b4-30badb1c9930">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:user uuid="04df1c95329f4b4e96ae705243c3fd6a">tempest-AttachSCSIVolumeTestJSON-448475147-project-member</nova:user>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:project uuid="19f245e8060643a4a760a0d26845e019">tempest-AttachSCSIVolumeTestJSON-448475147</nova:project>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="316e6a5d-83ed-4422-87b4-30badb1c9930"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         <nova:port uuid="5ffb73f5-b443-4237-982b-9b6e2ee5aa36">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <entry name="serial">af52b758-781b-4980-9e1d-5cb5924eee22</entry>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <entry name="uuid">af52b758-781b-4980-9e1d-5cb5924eee22</entry>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <target dev="sda" bus="scsi"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <address type="drive" controller="0" unit="0"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.config"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <target dev="sdb" bus="scsi"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <address type="drive" controller="0" unit="1"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ae:16:a4"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <target dev="tap5ffb73f5-b4"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/console.log" append="off"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:21.772593 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:21.775301 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Preparing to wait for external event network-vif-plugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:21.775301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:21.775301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:21.775301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:21.775301 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-389486882',display_name='tempest-AttachSCSIVolumeTestJSON-server-389486882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachscsivolumetestjson-server-389486882',id=3,image_ref='316e6a5d-83ed-4422-87b4-30badb1c9930',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtkvWaiZIq6LTOp6Gsz1I77N3P5UWkcFTkEV0AHtyFEQnGT5hintB6L+vg6Cyi1fPO7nJ9fZEGmIXsFyhgy+oVXAS5togWbiW/MVapP5bdmQt436BI98zod/3DK9PoJBQ==',key_name='tempest-keypair-237655966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19f245e8060643a4a760a0d26845e019',ramdisk_id='',reservation_id='r-58emjmdw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='316e6a5d-83ed-4422-87b4-30badb1c9930',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-448475147',owner_user_name='tempest-AttachSCSIVolumeTestJSON-448475147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04df1c95329f4b4e96ae705243c3fd6a',uuid=af52b758-781b-4980-9e1d-5cb5924eee22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:21.778961 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Converting VIF {"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:21.778961 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:16:a4,bridge_name='br-int',has_traffic_filtering=True,id=5ffb73f5-b443-4237-982b-9b6e2ee5aa36,network=Network(fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffb73f5-b4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:21.778961 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:16:a4,bridge_name='br-int',has_traffic_filtering=True,id=5ffb73f5-b443-4237-982b-9b6e2ee5aa36,network=Network(fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffb73f5-b4') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:21.780817 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:21.781285 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:21.781716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:21.782919 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:21.783233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5885ceb-0733-5ff2-a922-449f4f4f07ce', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:21.784929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:21.785923 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:21.791471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:21.795344 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Updating instance_info_cache with network_info: [{"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:21.799307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:21.799596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ffb73f5-b4, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:21.800080 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ffb73f5-b4, col_values=(('qos', UUID('4360d373-2de6-444c-98fb-91ea1f40ff5f')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:21.800550 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ffb73f5-b4, col_values=(('external_ids', {'iface-id': '5ffb73f5-b443-4237-982b-9b6e2ee5aa36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:16:a4', 'vm-uuid': 'af52b758-781b-4980-9e1d-5cb5924eee22'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:21.801541 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:21.802777 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:21.814092 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:21.816148 np0000001643 nova-compute[98269]: INFO os_vif [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:16:a4,bridge_name='br-int',has_traffic_filtering=True,id=5ffb73f5-b443-4237-982b-9b6e2ee5aa36,network=Network(fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffb73f5-b4')
May 28 14:01:21.951152 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.372s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:21.952195 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.303s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:21.952606 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:21.955083 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:21.956097 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:01:22.053179 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:22.176256 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.202257 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.204098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.290190 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:22.300680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Releasing lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:22.300680 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Instance network_info: |[{"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:22.302966 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Start _get_guest_xml network_info=[{"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:22.311189 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:22.312764 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1298993869', uuid='aaeff833-80ef-4909-96de-5958543e37ba'), owner=OwnerMeta(userid='2d135543093d4ca0849ab043df8e19ca', username='tempest-AttachVolumeNegativeTest-703881462-project-member', projectid='a792bdb63c954739ad33cb2fedeedee4', projectname='tempest-AttachVolumeNegativeTest-703881462'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976882.3122725) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:22.315324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:22.315695 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:22.317555 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:22.318342 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:22.319697 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:22.320061 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:22.320692 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:22.320692 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:22.321413 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:22.323157 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:22.323157 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:22.323157 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:22.323157 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:22.323354 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:22.323407 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:22.323688 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:22.357326 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1298993869',display_name='tempest-AttachVolumeNegativeTest-server-1298993869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-1298993869',id=2,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBj9VBjg4iTeEdQ5MADnTXtOYjY/NJnh65qfQpfCYOFibSVcbk2JD8z3EQBeybM9X8EEIN8I/Jye5zk4OhPhgIyUhabDOcVaPQcnmQf4Ryph97yOcVc0RU2oZjly31LsA==',key_name='tempest-keypair-13948228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-p926h9k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=aaeff833-80ef-4909-96de-5958543e37ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:22.357326 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:22.357634 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=0384c22d-d24f-466b-b3b2-61e8dc476888,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0384c22d-d2') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:22.359319 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'pci_devices' on Instance uuid aaeff833-80ef-4909-96de-5958543e37ba {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:22.367735 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.384098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.462241 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:22.462391 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:22.463629 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:22.464051 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fca9d553-5b50-4d9a-a7c7-5a6f26df30f0 req-e6be7cd4-9287-46c9-ae84-b04993f9a966 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-plugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fca9d553-5b50-4d9a-a7c7-5a6f26df30f0 req-e6be7cd4-9287-46c9-ae84-b04993f9a966 service nova] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fca9d553-5b50-4d9a-a7c7-5a6f26df30f0 req-e6be7cd4-9287-46c9-ae84-b04993f9a966 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fca9d553-5b50-4d9a-a7c7-5a6f26df30f0 req-e6be7cd4-9287-46c9-ae84-b04993f9a966 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fca9d553-5b50-4d9a-a7c7-5a6f26df30f0 req-e6be7cd4-9287-46c9-ae84-b04993f9a966 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Processing event network-vif-plugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e634eb49-2d64-43f6-a2ab-7a99f1abe75b req-a8fa7770-e47f-4c51-a165-3b5ee8e1e64e service nova] Releasing lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquired lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Updated VIF entry in instance network info cache for port 5ffb73f5-b443-4237-982b-9b6e2ee5aa36. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Updating instance_info_cache with network_info: [{"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f09ed5266ee9487f837a6d029481f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba104c9114f447d390a20808c754f519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:22.984595 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:22.984595 np0000001643 nova-compute[98269]:   <uuid>aaeff833-80ef-4909-96de-5958543e37ba</uuid>
May 28 14:01:22.984595 np0000001643 nova-compute[98269]:   <name>instance-00000002</name>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1298993869</nova:name>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:22</nova:creationTime>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:user uuid="2d135543093d4ca0849ab043df8e19ca">tempest-AttachVolumeNegativeTest-703881462-project-member</nova:user>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:project uuid="a792bdb63c954739ad33cb2fedeedee4">tempest-AttachVolumeNegativeTest-703881462</nova:project>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         <nova:port uuid="0384c22d-d24f-466b-b3b2-61e8dc476888">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <entry name="serial">aaeff833-80ef-4909-96de-5958543e37ba</entry>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <entry name="uuid">aaeff833-80ef-4909-96de-5958543e37ba</entry>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk.config"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:60:f8:70"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <target dev="tap0384c22d-d2"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/console.log" append="off"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:22.986071 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:22.986071 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Preparing to wait for external event network-vif-plugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:22.986071 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:22.986071 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:22.986071 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:22.988527 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1298993869',display_name='tempest-AttachVolumeNegativeTest-server-1298993869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-1298993869',id=2,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBj9VBjg4iTeEdQ5MADnTXtOYjY/NJnh65qfQpfCYOFibSVcbk2JD8z3EQBeybM9X8EEIN8I/Jye5zk4OhPhgIyUhabDOcVaPQcnmQf4Ryph97yOcVc0RU2oZjly31LsA==',key_name='tempest-keypair-13948228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-p926h9k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=aaeff833-80ef-4909-96de-5958543e37ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:22.988527 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:22.988527 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=0384c22d-d24f-466b-b3b2-61e8dc476888,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0384c22d-d2') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=0384c22d-d24f-466b-b3b2-61e8dc476888,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0384c22d-d2') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd74b1e0e-224d-5a25-a785-60de5cfb6633', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0384c22d-d2, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0384c22d-d2, col_values=(('qos', UUID('667a0108-0a30-4ccc-a0a2-28b181d1cee6')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0384c22d-d2, col_values=(('external_ids', {'iface-id': '0384c22d-d24f-466b-b3b2-61e8dc476888', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:f8:70', 'vm-uuid': 'aaeff833-80ef-4909-96de-5958543e37ba'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: INFO os_vif [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=0384c22d-d24f-466b-b3b2-61e8dc476888,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0384c22d-d2')
May 28 14:01:22.989179 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:23.115216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-73dd1036-bc43-4f97-8fc8-8969d6ebb53d req-4d3f41df-f5c7-4d3d-84f0-9ab9f3ccb146 service nova] Releasing lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:23.273475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:23.273613 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779976883.273262, 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:23.273988 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] VM Started (Lifecycle Event)
May 28 14:01:23.275482 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:23.278943 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Instance spawned successfully.
May 28 14:01:23.279353 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:23.354472 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] No BDM found with device name sda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:23.354598 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:23.354703 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] No VIF found with MAC fa:16:3e:ae:16:a4, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:23.355172 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Using config drive
May 28 14:01:23.431712 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Successfully created port: 42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:23.448959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:23.478048 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:23.492839 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:23.526286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:23.526960 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:23.611257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:23.611257 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000003, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.config'
May 28 14:01:23.614707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:23.698265 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:23.699940 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:23.779382 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:23.785642 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:23.788629 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:23.793153 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:23.793433 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:23.793959 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:23.794884 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:23.795641 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:23.796086 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:23.801152 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:23.803149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:23.831336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.028s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:23.834090 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14977MB free_disk=74.77677917480469GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:01:23.834090 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:23.834332 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:23.864994 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:24.083556 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:24.087804 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Creating config drive at /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.config
May 28 14:01:24.092969 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoh669zkv {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:24.110474 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:24.138202 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoh669zkv" returned: 0 in 0.045s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:24.233885 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Successfully updated port: 42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:24.291924 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:24.293659 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976884.2931938, 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:24.295016 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] VM Paused (Lifecycle Event)
May 28 14:01:24.318206 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Took 14.87 seconds to spawn the instance on the hypervisor.
May 28 14:01:24.321690 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:24.354057 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:24.420393 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:24.420542 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:24.420644 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No VIF found with MAC fa:16:3e:60:f8:70, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:24.421102 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Using config drive
May 28 14:01:24.494357 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:24.496505 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:24.496505 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Creating image(s)
May 28 14:01:24.497153 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:24.497352 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "/opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:24.498525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "/opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:24.499538 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:24.503698 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:24.506484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:24.594159 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:24.594899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:24.595612 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:24.598466 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:24.600230 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:24.600776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:24.616824 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e766629c-f879-4c79-8668-fdeb3125fe40 req-4c1fbfcd-4177-4b3d-a1ca-875399592cf0 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-plugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:24.617226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e766629c-f879-4c79-8668-fdeb3125fe40 req-4c1fbfcd-4177-4b3d-a1ca-875399592cf0 service nova] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:24.617504 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e766629c-f879-4c79-8668-fdeb3125fe40 req-4c1fbfcd-4177-4b3d-a1ca-875399592cf0 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:24.617694 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e766629c-f879-4c79-8668-fdeb3125fe40 req-4c1fbfcd-4177-4b3d-a1ca-875399592cf0 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:24.617880 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e766629c-f879-4c79-8668-fdeb3125fe40 req-4c1fbfcd-4177-4b3d-a1ca-875399592cf0 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] No waiting events found dispatching network-vif-plugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:24.618077 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e766629c-f879-4c79-8668-fdeb3125fe40 req-4c1fbfcd-4177-4b3d-a1ca-875399592cf0 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received unexpected event network-vif-plugged-c1341c24-2f36-4a83-9689-177abf10a391 for instance with vm_state active and task_state None.
May 28 14:01:24.677210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:24.685707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:24.686840 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:24.710083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:24.722575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk 1073741824" returned: 0 in 0.036s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:24.723117 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.128s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:24.723605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:24.740409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:24.740589 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquired lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:24.740825 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:24.800299 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:24.800299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:24.800805 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:24.802822 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:24.817868 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:24.826893 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-changed-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:24.827123 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Refreshing instance network info cache due to event network-changed-42b51fb3-cbd7-4828-8620-124136ac1391. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:24.827719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] Acquiring lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:24.835630 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976884.834421, 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:24.835630 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] VM Resumed (Lifecycle Event)
May 28 14:01:24.838088 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Took 20.15 seconds to build instance.
May 28 14:01:24.855306 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Releasing lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:24.855666 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Instance network_info: |[{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:24.858041 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Start _get_guest_xml network_info=[{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:24.861657 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:24.863100 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1214174567', uuid='0c96a33a-84dd-4c95-82b3-94a6251e5404'), owner=OwnerMeta(userid='d7f2227d939749fba2d87d475eced3ad', username='tempest-TaggedAttachmentsTest-1796593045-project-member', projectid='8f26c4eed05b4d6787812ac3fb0c7803', projectname='tempest-TaggedAttachmentsTest-1796593045'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976884.862661) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:24.865170 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:24.867311 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:24.871721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:24.871721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:24.872565 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:24.873362 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:24.873783 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:24.873966 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:24.874184 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:24.874346 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:24.874645 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:24.874794 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:24.874935 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:24.875112 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:24.875348 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:24.875891 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:24.906269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:24.907771 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Cannot resize image /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:24.908094 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:24.908253 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Ensure instance console log exists: /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:24.918269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:24.918269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:24.918269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:24.921836 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:24.921836 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converting VIF {"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:24.923689 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=830e8040-3da9-453c-b4fa-7fa9197d9a4f,network=Network(19f2a949-8d33-47a7-a5d6-9d974b4c3cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8040-3d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:24.923689 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:24.934636 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:24.946795 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:01:24.946795 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance aaeff833-80ef-4909-96de-5958543e37ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:01:24.946795 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance af52b758-781b-4980-9e1d-5cb5924eee22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:01:24.946795 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:01:24.947270 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:01:24.947665 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:01:24.950408 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:01:23 up 28 min,  2 users,  load average: 4.97, 2.27, 1.14\n', 'num_instances': '5', 'num_vm_building': '5', 'num_task_spawning': '4', 'num_os_type_None': '5', 'num_proj_9c23cc7052a24f979780596790cb86ec': '1', 'io_workload': '5', 'num_proj_a792bdb63c954739ad33cb2fedeedee4': '1', 'num_proj_19f245e8060643a4a760a0d26845e019': '1', 'num_proj_8f26c4eed05b4d6787812ac3fb0c7803': '1', 'num_task_block_device_mapping': '1', 'num_proj_ba104c9114f447d390a20808c754f519': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:01:25.232646 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Creating config drive at /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk.config
May 28 14:01:25.239469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_alv88hx {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:25.281229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_alv88hx" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:25.312926 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.328309 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.332076 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.338881 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:25.341489 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be6bedb3-b15b-4c03-8655-ed14c2b2e873 tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.659s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:25.347226 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:25.351058 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.356644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.396286 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:25.396793 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:25.402346 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:25.434540 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <uuid>0c96a33a-84dd-4c95-82b3-94a6251e5404</uuid>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <name>instance-00000004</name>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:24</nova:creationTime>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <entry name="serial">0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <entry name="uuid">0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:46:1d:78"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <target dev="tap830e8040-3d"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log" append="off"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:25.434540 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:25.436348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Preparing to wait for external event network-vif-plugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:25.436348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:25.436348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:25.436348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:25.439237 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:25.439480 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converting VIF {"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:25.440207 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=830e8040-3da9-453c-b4fa-7fa9197d9a4f,network=Network(19f2a949-8d33-47a7-a5d6-9d974b4c3cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8040-3d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:25.440510 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=830e8040-3da9-453c-b4fa-7fa9197d9a4f,network=Network(19f2a949-8d33-47a7-a5d6-9d974b4c3cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8040-3d') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:25.441625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.441625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:25.441625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:25.443632 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.443884 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e548eee2-e18d-5fd9-8021-ea2bd05762f6', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:25.445816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.445816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:25.452708 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.460235 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.460235 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap830e8040-3d, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:25.460235 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap830e8040-3d, col_values=(('qos', UUID('3a805486-d014-4962-9934-5c64838f99b2')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:25.460235 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap830e8040-3d, col_values=(('external_ids', {'iface-id': '830e8040-3da9-453c-b4fa-7fa9197d9a4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:1d:78', 'vm-uuid': '0c96a33a-84dd-4c95-82b3-94a6251e5404'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:25.460854 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.462925 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:25.475498 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.475938 np0000001643 nova-compute[98269]: INFO os_vif [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=830e8040-3da9-453c-b4fa-7fa9197d9a4f,network=Network(19f2a949-8d33-47a7-a5d6-9d974b4c3cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8040-3d')
May 28 14:01:25.751092 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:25.893143 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976885.8914099, af52b758-781b-4980-9e1d-5cb5924eee22 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:25.893143 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] VM Started (Lifecycle Event)
May 28 14:01:25.898078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:25.900843 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:25.934791 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.057213 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f436b36d-4c02-4c37-8c44-e7d6c40b2748 req-bf474084-16eb-4f3a-95ec-30f5a6eaf402 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:26.057473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f436b36d-4c02-4c37-8c44-e7d6c40b2748 req-bf474084-16eb-4f3a-95ec-30f5a6eaf402 service nova] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:26.057810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f436b36d-4c02-4c37-8c44-e7d6c40b2748 req-bf474084-16eb-4f3a-95ec-30f5a6eaf402 service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:26.059695 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f436b36d-4c02-4c37-8c44-e7d6c40b2748 req-bf474084-16eb-4f3a-95ec-30f5a6eaf402 service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:26.060711 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f436b36d-4c02-4c37-8c44-e7d6c40b2748 req-bf474084-16eb-4f3a-95ec-30f5a6eaf402 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] No event matching network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 in dict_keys([('network-vif-plugged', '0384c22d-d24f-466b-b3b2-61e8dc476888')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:01:26.061196 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f436b36d-4c02-4c37-8c44-e7d6c40b2748 req-bf474084-16eb-4f3a-95ec-30f5a6eaf402 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received unexpected event network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 for instance with vm_state building and task_state spawning.
May 28 14:01:26.077119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.116221 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Updating instance_info_cache with network_info: [{"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:26.340291 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.351687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.366658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.386437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.388579 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.399621 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:26.401556 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976886.4012468, af52b758-781b-4980-9e1d-5cb5924eee22 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:26.401780 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] VM Paused (Lifecycle Event)
May 28 14:01:26.414544 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:01:26.414544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.581s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:26.415006 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.68 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:01:26.622117 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Releasing lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:26.622117 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Instance network_info: |[{"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:26.624670 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Start _get_guest_xml network_info=[{"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:26.626174 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] Acquired lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:26.626174 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Refreshing network info cache for port 42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:26.639334 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:26.640791 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1205548759', uuid='5a5e8316-ba70-4c95-b9d8-30fdac3f8bca'), owner=OwnerMeta(userid='f09ed5266ee9487f837a6d029481f8a2', username='tempest-VolumesAssistedSnapshotsTest-1574201677-project-member', projectid='ba104c9114f447d390a20808c754f519', projectname='tempest-VolumesAssistedSnapshotsTest-1574201677'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976886.6402867) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:26.644440 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:26.645006 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:26.648468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:26.648468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:26.648468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:26.648705 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:26.648854 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:26.649016 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:26.649212 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:26.649375 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:26.649558 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:26.649939 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:26.650103 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:26.650262 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:26.650428 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:26.650805 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:26.673401 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1205548759',display_name='tempest-VolumesAssistedSnapshotsTest-server-1205548759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesassistedsnapshotstest-server-1205548759',id=5,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuktH9yNPc5v5+7EamfRlN6xcOEgp5iSIefF4v4QiQJLw62Kq3qWOuL4zBgwj5gPnzA7UaCn88e2VwrAM+/vvjo/9xMaSaHXHbfbyb/Wh6ZtQHx9SsI0tgJtR1+QSe6Ng==',key_name='tempest-keypair-643212401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba104c9114f447d390a20808c754f519',ramdisk_id='',reservation_id='r-kznumsyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1574201677',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1574201677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f09ed5266ee9487f837a6d029481f8a2',uuid=5a5e8316-ba70-4c95-b9d8-30fdac3f8bca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:26.673743 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Converting VIF {"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:26.674435 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=42b51fb3-cbd7-4828-8620-124136ac1391,network=Network(febe37ed-4d4c-4129-b4e8-3d943cea631a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b51fb3-cb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:26.675109 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:26.864771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:26.865235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:26.905933 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:26.910405 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:26.939267 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.950958 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.973135 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:26.982260 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.003347 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:27.003517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:27.003517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No VIF found with MAC fa:16:3e:46:1d:78, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:27.007577 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Using config drive
May 28 14:01:27.135636 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:27.178277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <uuid>5a5e8316-ba70-4c95-b9d8-30fdac3f8bca</uuid>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <name>instance-00000005</name>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1205548759</nova:name>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:26</nova:creationTime>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:user uuid="f09ed5266ee9487f837a6d029481f8a2">tempest-VolumesAssistedSnapshotsTest-1574201677-project-member</nova:user>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:project uuid="ba104c9114f447d390a20808c754f519">tempest-VolumesAssistedSnapshotsTest-1574201677</nova:project>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         <nova:port uuid="42b51fb3-cbd7-4828-8620-124136ac1391">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <entry name="serial">5a5e8316-ba70-4c95-b9d8-30fdac3f8bca</entry>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <entry name="uuid">5a5e8316-ba70-4c95-b9d8-30fdac3f8bca</entry>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk.config"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:c7:c2:75"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <target dev="tap42b51fb3-cb"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/console.log" append="off"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:27.178277 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:27.180721 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Preparing to wait for external event network-vif-plugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:27.180721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:27.180721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:27.180721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:27.180721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1205548759',display_name='tempest-VolumesAssistedSnapshotsTest-server-1205548759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesassistedsnapshotstest-server-1205548759',id=5,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuktH9yNPc5v5+7EamfRlN6xcOEgp5iSIefF4v4QiQJLw62Kq3qWOuL4zBgwj5gPnzA7UaCn88e2VwrAM+/vvjo/9xMaSaHXHbfbyb/Wh6ZtQHx9SsI0tgJtR1+QSe6Ng==',key_name='tempest-keypair-643212401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba104c9114f447d390a20808c754f519',ramdisk_id='',reservation_id='r-kznumsyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1574201677',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1574201677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f09ed5266ee9487f837a6d029481f8a2',uuid=5a5e8316-ba70-4c95-b9d8-30fdac3f8bca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:27.181115 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Converting VIF {"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:27.181115 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=42b51fb3-cbd7-4828-8620-124136ac1391,network=Network(febe37ed-4d4c-4129-b4e8-3d943cea631a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b51fb3-cb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:27.181239 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=42b51fb3-cbd7-4828-8620-124136ac1391,network=Network(febe37ed-4d4c-4129-b4e8-3d943cea631a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b51fb3-cb') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:27.182486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.182486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:27.182866 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:27.183550 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.183716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '565b3cc3-a2a7-5a33-a2ac-e200044c5846', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:27.185122 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.185459 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:27.191299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.194174 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.194400 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42b51fb3-cb, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:27.194778 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42b51fb3-cb, col_values=(('qos', UUID('5c7a0775-0593-4e57-bf41-362fddd18e58')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:27.194930 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42b51fb3-cb, col_values=(('external_ids', {'iface-id': '42b51fb3-cbd7-4828-8620-124136ac1391', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:c2:75', 'vm-uuid': '5a5e8316-ba70-4c95-b9d8-30fdac3f8bca'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:27.196774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.198894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:27.211312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:27.214373 np0000001643 nova-compute[98269]: INFO os_vif [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=42b51fb3-cbd7-4828-8620-124136ac1391,network=Network(febe37ed-4d4c-4129-b4e8-3d943cea631a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b51fb3-cb')
May 28 14:01:27.368995 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lazy-loading 'flavor' on Instance uuid 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:27.413553 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:27.413900 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976887.4136593, aaeff833-80ef-4909-96de-5958543e37ba => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:27.414104 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] VM Started (Lifecycle Event)
May 28 14:01:27.513096 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:27.573269 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:27.693261 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Creating config drive at /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config
May 28 14:01:27.702208 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1yt2l160 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:27.734237 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1yt2l160" returned: 0 in 0.032s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:27.830712 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Updated VIF entry in instance network info cache for port 42b51fb3-cbd7-4828-8620-124136ac1391. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:27.830882 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Updating instance_info_cache with network_info: [{"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:27.920484 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:27.923845 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976887.9234965, aaeff833-80ef-4909-96de-5958543e37ba => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:27.924077 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] VM Paused (Lifecycle Event)
May 28 14:01:28.217236 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.244620 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.336344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f654c80-a420-44f8-9742-ca14354fe09c req-bb77919d-f8e5-4e28-be97-386e7bb0a7fc service nova] Releasing lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:28.348259 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:28.348840 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:28.349796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:28.350048 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:28.350278 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No event matching network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f in dict_keys([('network-vif-plugged', '830e8040-3da9-453c-b4fa-7fa9197d9a4f')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:01:28.350581 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received unexpected event network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f for instance with vm_state building and task_state spawning.
May 28 14:01:28.350640 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-plugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:28.350750 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:28.351007 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Processing event network-vif-plugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-plugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] No waiting events found dispatching network-vif-plugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-58828d38-3108-4694-95db-b17fe6be7e35 req-70a6db46-82da-406d-9737-1da81219a9ea service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received unexpected event network-vif-plugged-0384c22d-d24f-466b-b3b2-61e8dc476888 for instance with vm_state building and task_state spawning.
May 28 14:01:28.353477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:28.357985 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.359411 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:28.368930 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Instance spawned successfully.
May 28 14:01:28.369438 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:28.376374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:28.429635 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:28.433427 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976888.4330807, aaeff833-80ef-4909-96de-5958543e37ba => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:28.435252 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] VM Resumed (Lifecycle Event)
May 28 14:01:28.630976 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.640398 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.644723 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.666647 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.674711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:28.746473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:28.746473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:28.746473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] No VIF found with MAC fa:16:3e:c7:c2:75, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:28.746473 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Using config drive
May 28 14:01:28.877203 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:28.877368 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:28.877794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:28.878066 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:28.878412 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:28.878882 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:28.938189 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:28.941749 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:29.087300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:29.253129 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:29.386480 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Took 13.69 seconds to spawn the instance on the hypervisor.
May 28 14:01:29.386480 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:29.447484 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:29.447745 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976889.4475784, 0c96a33a-84dd-4c95-82b3-94a6251e5404 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:29.447849 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] VM Started (Lifecycle Event)
May 28 14:01:29.468188 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Creating config drive at /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk.config
May 28 14:01:29.475543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt4xo2pdf {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:29.513943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt4xo2pdf" returned: 0 in 0.038s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:29.896319 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Took 19.05 seconds to build instance.
May 28 14:01:29.950665 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:29.952998 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976889.9526482, 0c96a33a-84dd-4c95-82b3-94a6251e5404 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:29.953195 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] VM Paused (Lifecycle Event)
May 28 14:01:29.990250 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.020259 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.060249 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:30.060249 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:30.061248 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Attaching volume 28824eea-7670-48f1-b2f0-1119f8e87511 to /dev/vdb
May 28 14:01:30.099531 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.121639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.147913 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:01:30.147913 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpq1o3f3pc/privsep.sock']
May 28 14:01:30.156366 np0000001643 sudo[110713]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpq1o3f3pc/privsep.sock
May 28 14:01:30.157085 np0000001643 sudo[110713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 14:01:30.398540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65e06360-643d-47a3-b18f-2c5f6270a830 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.562s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:30.401505 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.403369 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.408733 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.427064 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.427834 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:30.452250 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 14:01:30.452369 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 14:01:30.452414 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 14:01:30.452607 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:30.452607 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 14:01:30.452738 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 14:01:30.453061 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 14:01:30.453061 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:30.453061 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 14:01:30.458360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:30.464682 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:30.554395 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-255c82ba-1812-49a0-885f-63ddc6933cfe req-e7b98f2c-c28b-4ec7-820e-1adda1db7951 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-vif-plugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:30.555081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-255c82ba-1812-49a0-885f-63ddc6933cfe req-e7b98f2c-c28b-4ec7-820e-1adda1db7951 service nova] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:30.555688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-255c82ba-1812-49a0-885f-63ddc6933cfe req-e7b98f2c-c28b-4ec7-820e-1adda1db7951 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:30.555829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-255c82ba-1812-49a0-885f-63ddc6933cfe req-e7b98f2c-c28b-4ec7-820e-1adda1db7951 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:30.555985 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-255c82ba-1812-49a0-885f-63ddc6933cfe req-e7b98f2c-c28b-4ec7-820e-1adda1db7951 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Processing event network-vif-plugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:30.582484 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-plugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:30.584824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:30.584824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:30.584824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:30.584824 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Processing event network-vif-plugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:30.584967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-plugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:30.587360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:30.587360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:30.587360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:30.587360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No waiting events found dispatching network-vif-plugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:30.587360 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-80462133-2320-4ca4-bb73-fefeeecf765c req-aea82123-665b-485e-859e-5e5f19aa39ca service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received unexpected event network-vif-plugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f for instance with vm_state building and task_state spawning.
May 28 14:01:30.587360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:30.593711 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:30.595901 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Instance spawned successfully.
May 28 14:01:30.596350 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 14:01:30.898156 np0000001643 nova-compute[98269]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 14:01:30.966571 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:30.970012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:30.972860 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:30.973131 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976890.9729464, 0c96a33a-84dd-4c95-82b3-94a6251e5404 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:30.973217 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] VM Resumed (Lifecycle Event)
May 28 14:01:30.976533 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Instance spawned successfully.
May 28 14:01:30.978467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:31.110297 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.110522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.110794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.111034 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.111294 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.111554 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.248097 np0000001643 sudo[110713]: pam_unix(sudo:session): session closed for user root
May 28 14:01:31.249833 np0000001643 nova-compute[98269]: INFO oslo.privsep.daemon [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Spawned new privsep daemon via rootwrap
May 28 14:01:31.351000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:01:31.351326 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.nvmeof [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 28 14:01:31.376106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:31.401498 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:01:31.401999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:01:31.413422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:01:31.415547 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feb7:2e09', 'fe80::fc16:3eff:feae:16a4', 'fe80::6491:7fff:fecb:8634', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c'] 
May 28 14:01:31.415547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:01:31.415547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:01:31.415801 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] <== get_connector_properties: return (1269ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:01:31.416074 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Updating existing volume attachment record: c1b89095-1fd4-41e0-afb4-e1d0fbc4f9f9 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:01:31.478316 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:31.480674 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:31.489396 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.489565 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.490110 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.490463 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.491008 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.491342 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:31.615796 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:31.620415 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Took 10.42 seconds to spawn the instance on the hypervisor.
May 28 14:01:31.620415 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:31.985019 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:31.985529 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976891.984999, 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:31.985529 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] VM Started (Lifecycle Event)
May 28 14:01:31.998974 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Took 7.50 seconds to spawn the instance on the hypervisor.
May 28 14:01:31.998974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:32.058805 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:32.059191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:32.060911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connector [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Factory for ISCSI on None {{(pid=98269) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 28 14:01:32.061343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:32.061343 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:01:32.061924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28824eea-7670-48f1-b2f0-1119f8e87511', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:01:32.062127 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:01:32.062913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:01:32.062913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28824eea-7670-48f1-b2f0-1119f8e87511', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:01:32.081722 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:01:32.082164 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:01:32.082701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:01:32.082955 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:01:32.083273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:01:32.083601 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:01:32.096152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:01:32.096152 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:32.105849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:01:32.105849 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:32.113112 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511] added
May 28 14:01:32.113112 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:01:32.113112 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:32.113112 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:32.113112 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:32.113112 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:32.113112 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:32.113112 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:01:32.113112 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:01:32.113505 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511] added
May 28 14:01:32.120469 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:32.120469 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:01:32.120469 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:01:32.134364 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Took 15.91 seconds to build instance.
May 28 14:01:32.198834 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:32.489118 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:32.494690 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:32.511576 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Took 13.01 seconds to build instance.
May 28 14:01:32.550803 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:32.638909 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cdb3554e-a4b5-4abb-b086-d8a52981b438 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.430s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:32.872351 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f41bbaf-d9a3-41ac-8d43-88908c1bfec0 req-47694ab6-ecc7-4f8f-9866-8f0aefeeb846 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-vif-plugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:32.872351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f41bbaf-d9a3-41ac-8d43-88908c1bfec0 req-47694ab6-ecc7-4f8f-9866-8f0aefeeb846 service nova] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:32.873238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f41bbaf-d9a3-41ac-8d43-88908c1bfec0 req-47694ab6-ecc7-4f8f-9866-8f0aefeeb846 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:32.873742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f41bbaf-d9a3-41ac-8d43-88908c1bfec0 req-47694ab6-ecc7-4f8f-9866-8f0aefeeb846 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:32.874157 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f41bbaf-d9a3-41ac-8d43-88908c1bfec0 req-47694ab6-ecc7-4f8f-9866-8f0aefeeb846 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] No waiting events found dispatching network-vif-plugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:32.874157 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-7f41bbaf-d9a3-41ac-8d43-88908c1bfec0 req-47694ab6-ecc7-4f8f-9866-8f0aefeeb846 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received unexpected event network-vif-plugged-42b51fb3-cbd7-4828-8620-124136ac1391 for instance with vm_state active and task_state None.
May 28 14:01:32.996796 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976892.9964342, 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:32.996958 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] VM Paused (Lifecycle Event)
May 28 14:01:33.015113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.529s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:33.113965 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:01:33.121489 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:01:33.130334 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:01:33.130334 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:01:33.137001 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:01:33.137001 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:33.148786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:33.155290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:33.160276 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:33.160276 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:33.160559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:33.160559 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:33.160559 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:01:33.160559 np0000001643 nova-compute[98269]: 
May 28 14:01:33.165241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:33.165241 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:33.165784 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:33.165784 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:33.165784 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:01:33.165784 np0000001643 nova-compute[98269]: 
May 28 14:01:33.500618 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:33.507004 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976893.5066154, 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:33.507163 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] VM Resumed (Lifecycle Event)
May 28 14:01:33.552658 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-changed-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:33.552865 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Refreshing instance network info cache due to event network-changed-0384c22d-d24f-466b-b3b2-61e8dc476888. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:33.553121 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] Acquiring lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:33.553283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] Acquired lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:33.553464 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Refreshing network info cache for port 0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:34.009427 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:34.013856 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:34.058441 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:34.091021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:34.201161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.40.100,3260]
May 28 14:01:34.201161 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.40.100,3260] successful.
May 28 14:01:34.201161 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:34.202027 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.50.100,3260]
May 28 14:01:34.202027 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.50.100,3260] successful.
May 28 14:01:34.202027 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:34.224412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:34.229035 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5cfa7aa4-162f-445d-ab25-ef1d90d82f11 req-11e80aa6-24c5-4bad-9960-00c199340172 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:34.232888 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5cfa7aa4-162f-445d-ab25-ef1d90d82f11 req-11e80aa6-24c5-4bad-9960-00c199340172 service nova] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:34.235788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5cfa7aa4-162f-445d-ab25-ef1d90d82f11 req-11e80aa6-24c5-4bad-9960-00c199340172 service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:34.236087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5cfa7aa4-162f-445d-ab25-ef1d90d82f11 req-11e80aa6-24c5-4bad-9960-00c199340172 service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:34.236437 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5cfa7aa4-162f-445d-ab25-ef1d90d82f11 req-11e80aa6-24c5-4bad-9960-00c199340172 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] No event matching network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 in dict_keys([('network-vif-plugged', '5ffb73f5-b443-4237-982b-9b6e2ee5aa36')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:01:34.236986 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-5cfa7aa4-162f-445d-ab25-ef1d90d82f11 req-11e80aa6-24c5-4bad-9960-00c199340172 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received unexpected event network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 for instance with vm_state building and task_state spawning.
May 28 14:01:34.237725 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:34.243532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.243532 np0000001643 nova-compute[98269]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.243532 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:34.243700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.243700 np0000001643 nova-compute[98269]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.243700 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:34.243968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.161s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:01:34.244111 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:01:34.250232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.250232 np0000001643 nova-compute[98269]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.250232 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:34.250420 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.250420 np0000001643 nova-compute[98269]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:34.250420 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:34.250758 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.168s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:01:34.250855 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:01:34.251416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:01:34.251590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:01:34.256306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:01:34.256306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:01:34.292074 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:01:34.292255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28824eea-7670-48f1-b2f0-1119f8e87511', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:01:34.300980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:01:34.301676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '28824eea-7670-48f1-b2f0-1119f8e87511', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:01:34.306319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:34.307047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:34.376500 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:34.809845 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:34.901163 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:35.084875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:01:35.130697 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Updated VIF entry in instance network info cache for port 0384c22d-d24f-466b-b3b2-61e8dc476888. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:35.131137 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Updating instance_info_cache with network_info: [{"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:35.422461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:35.422731 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:35.426059 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:35.426259 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Claim successful on node np0000001643
May 28 14:01:35.634626 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e43753b3-d02b-4b86-8e47-c1e22f42d662 req-0729242d-b734-452e-8996-1de28643e57b service nova] Releasing lock "refresh_cache-aaeff833-80ef-4909-96de-5958543e37ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:35.675458 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-changed-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:35.675563 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Refreshing instance network info cache due to event network-changed-42b51fb3-cbd7-4828-8620-124136ac1391. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:35.675737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] Acquiring lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:35.675898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] Acquired lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:35.676141 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Refreshing network info cache for port 42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:35.689172 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-changed-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:35.691247 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Refreshing instance network info cache due to event network-changed-830e8040-3da9-453c-b4fa-7fa9197d9a4f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:35.691247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] Acquiring lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:35.691247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] Acquired lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:35.691247 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Refreshing network info cache for port 830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:36.110769 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Found WWN 3300000003326fd3a for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:01:36.110769 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.048s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:01:36.110769 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] <== connect_volume: return (4048ms) {'type': 'block', 'scsi_wwn': '3300000003326fd3a', 'path': '/dev/dm-0', 'multipath_id': '3300000003326fd3a'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:01:36.110769 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003326fd3a', 'path': '/dev/dm-0', 'multipath_id': '3300000003326fd3a'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:01:36.116540 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lazy-loading 'flavor' on Instance uuid 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:36.178982 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:36.198612 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:36.344677 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-plugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:36.344677 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:36.344758 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:36.344921 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:36.345461 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Processing event network-vif-plugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:36.345659 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-plugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:36.345865 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:36.346086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:36.346432 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:36.346515 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] No waiting events found dispatching network-vif-plugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:36.347256 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Instance event wait completed in 10 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:36.347478 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-fbd2de99-9e4c-4b02-843c-25fc8ae2fd1f req-e9f89a46-3d68-412b-85d3-2729006d2b0b service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received unexpected event network-vif-plugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 for instance with vm_state building and task_state spawning.
May 28 14:01:36.352623 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976896.3521929, af52b758-781b-4980-9e1d-5cb5924eee22 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:36.352818 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] VM Resumed (Lifecycle Event)
May 28 14:01:36.357179 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:36.360254 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Instance spawned successfully.
May 28 14:01:36.360878 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:36.369087 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:36.369522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:36.369871 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:36.370208 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:36.618555 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Attempting to attach volume 28824eea-7670-48f1-b2f0-1119f8e87511 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:01:36.621250 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:01:36.621250 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:01:36.621250 np0000001643 nova-compute[98269]:   <alias name="ua-28824eea-7670-48f1-b2f0-1119f8e87511"/>
May 28 14:01:36.621250 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:01:36.621250 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:01:36.621250 np0000001643 nova-compute[98269]:   <serial>28824eea-7670-48f1-b2f0-1119f8e87511</serial>
May 28 14:01:36.621250 np0000001643 nova-compute[98269]: </disk>
May 28 14:01:36.621250 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:01:36.694509 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:36.694703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:36.858218 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:36.860032 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:36.880875 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Took 18.81 seconds to spawn the instance on the hypervisor.
May 28 14:01:36.881143 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:36.884985 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:36.891104 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:37.147041 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Updated VIF entry in instance network info cache for port 42b51fb3-cbd7-4828-8620-124136ac1391. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:37.147041 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Updating instance_info_cache with network_info: [{"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:37.164796 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:37.164963 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:37.199995 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:37.202417 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:37.228608 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updated VIF entry in instance network info cache for port 830e8040-3da9-453c-b4fa-7fa9197d9a4f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:37.228839 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:37.367413 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:37.404991 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Took 24.21 seconds to build instance.
May 28 14:01:37.649371 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8cf518e0-a500-4f98-8115-9a47107c4ea2 req-cb6b87e6-8280-4e03-ac33-00a7847277e4 service nova] Releasing lock "refresh_cache-5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:37.667672 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:37.730928 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7a76ce76-cab2-4325-9843-6a1c00b5fd6f req-90850be5-8505-42db-94ec-7ef420d748c3 service nova] Releasing lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:37.749904 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:37.907133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-172613a3-d14b-4bd9-a576-e5b51fc8ebc2 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.715s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:38.183038 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.758s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:38.183038 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:38.185177 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.435s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:38.188645 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:38.189068 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Claim successful on node np0000001643
May 28 14:01:38.284034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:38.284262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:38.365465 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:38.365655 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:38.365810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:38.365990 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] No VIF found with MAC fa:16:3e:b7:2e:09, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:38.689912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:38.690187 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:38.690436 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:38.690700 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:38.786832 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:38.970198 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '365296e0ff384bad9ae6b97762431f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee69e237aa64213a01d0bf475569055', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:39.092345 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:39.194609 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:39.237067 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-changed-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:39.237491 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Refreshing instance network info cache due to event network-changed-5ffb73f5-b443-4237-982b-9b6e2ee5aa36. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:39.237793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] Acquiring lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:39.238049 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] Acquired lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:39.238290 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Refreshing network info cache for port 5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:39.369150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:39.618846 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully created port: a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:39.706496 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:39.708166 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:39.731287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:39.731287 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:39.743722 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:39.941048 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8db97a42-c10d-4dc1-8f0a-eb4c25bf21bb tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.882s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:40.072177 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully created port: 00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:40.211808 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:01:40.217194 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:40.234897 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:40.439221 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Updated VIF entry in instance network info cache for port 5ffb73f5-b443-4237-982b-9b6e2ee5aa36. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:40.439761 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Updating instance_info_cache with network_info: [{"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:40.628994 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully created port: 0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:40.713140 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:40.745833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.561s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:40.746286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:40.749386 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.381s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:40.753668 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:40.753668 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Claim successful on node np0000001643
May 28 14:01:40.801960 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:40.942088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c11cd5b-ec7c-4604-b211-d3f5d5b559cb req-ef07b2bf-7198-48dc-b191-82764950b39f service nova] Releasing lock "refresh_cache-af52b758-781b-4980-9e1d-5cb5924eee22" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:41.086655 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully created port: 09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:41.145670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:41.145846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:41.146000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:41.146113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:41.146232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:41.148280 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Terminating instance
May 28 14:01:41.217849 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Booting with volume e328b1f5-924b-4abc-b089-5b9f05b0fecb at /dev/vda
May 28 14:01:41.253520 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:41.253720 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:41.253983 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:41.254244 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:41.283325 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:01:41.297376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:01:41.331054 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:41.360319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:01:41.360851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:01:41.376599 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86dc22a5d6a7478dab81969f17d3daab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74df57519ea42009fcebcff7cfdf94e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:41.380183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:01:41.383092 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feb7:2e09', 'fe80::fc16:3eff:feae:16a4', 'fe80::6491:7fff:fecb:8634', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c'] 
May 28 14:01:41.383263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:01:41.383427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:01:41.384322 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:01:41.384996 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating existing volume attachment record: b6c1b9e2-d8e6-4bd1-b942-0b021e92c0f9 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:01:41.598243 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully created port: f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:41.652904 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:01:41.675814 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:41.697029 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:41.703073 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:41.725094 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:41.764244 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:41.891749 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8246215c-fa0a-43ac-9c05-6160d07f00ef req-3fa4ebed-0e7b-4b7a-816b-400cfd858a5b service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:41.895717 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8246215c-fa0a-43ac-9c05-6160d07f00ef req-3fa4ebed-0e7b-4b7a-816b-400cfd858a5b service nova] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:41.896088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8246215c-fa0a-43ac-9c05-6160d07f00ef req-3fa4ebed-0e7b-4b7a-816b-400cfd858a5b service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:41.896479 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8246215c-fa0a-43ac-9c05-6160d07f00ef req-3fa4ebed-0e7b-4b7a-816b-400cfd858a5b service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:41.896611 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8246215c-fa0a-43ac-9c05-6160d07f00ef req-3fa4ebed-0e7b-4b7a-816b-400cfd858a5b service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] No waiting events found dispatching network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:41.897421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8246215c-fa0a-43ac-9c05-6160d07f00ef req-3fa4ebed-0e7b-4b7a-816b-400cfd858a5b service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:01:41.972542 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Successfully created port: 25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:42.003702 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.013585 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.044029 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99914207300003 future=<Future at 0x71a7781a1790 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:01:42.045075 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998052317000202 future=<Future at 0x71a7781a1790 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:01:42.045195 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997901057000036 future=<Future at 0x71a7781a1790 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:01:42.053161 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Instance destroyed successfully.
May 28 14:01:42.054220 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lazy-loading 'resources' on Instance uuid 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:42.204762 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.269428 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:42.345168 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully updated port: a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:42.415650 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:42.415650 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:42.415650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:42.415650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:42.415650 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:42.424120 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:42.424473 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:42.558269 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-789844248',display_name='tempest-DeleteServersTestJSON-server-789844248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-deleteserverstestjson-server-789844248',id=1,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:24Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c23cc7052a24f979780596790cb86ec',ramdisk_id='',reservation_id='r-l0ts3b7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1854035852',owner_user_name='tempest-DeleteServersTestJSON-1854035852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:24Z,user_data=None,user_id='4bc42ce4e1db4814a59fc552b56feb73',uuid=97eb14df-abb4-41e7-bc37-5b4c6c74eaa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:01:42.558269 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Converting VIF {"id": "c1341c24-2f36-4a83-9689-177abf10a391", "address": "fa:16:3e:b7:2e:09", "network": {"id": "4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1145461821-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9c23cc7052a24f979780596790cb86ec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1341c24-2f", "ovs_interfaceid": "c1341c24-2f36-4a83-9689-177abf10a391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:42.558632 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:09,bridge_name='br-int',has_traffic_filtering=True,id=c1341c24-2f36-4a83-9689-177abf10a391,network=Network(4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1341c24-2f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:42.558945 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:09,bridge_name='br-int',has_traffic_filtering=True,id=c1341c24-2f36-4a83-9689-177abf10a391,network=Network(4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1341c24-2f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:01:42.565158 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.565377 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1341c24-2f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:42.580247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.581101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:42.583642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.584569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.585387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e974e0ed-6d27-4f88-a400-7546e91fd545) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:42.586291 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:42.587022 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:42.589385 np0000001643 nova-compute[98269]: INFO os_vif [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2e:09,bridge_name='br-int',has_traffic_filtering=True,id=c1341c24-2f36-4a83-9689-177abf10a391,network=Network(4cd4c00f-0404-48c1-8e2e-4bb4c90a32bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1341c24-2f')
May 28 14:01:42.590517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:01:42.592720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28824eea-7670-48f1-b2f0-1119f8e87511', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:01:42.592720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:01:42.592720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:01:42.592720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28824eea-7670-48f1-b2f0-1119f8e87511', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:01:42.592720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:01:42.620351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:42.620351 np0000001643 nova-compute[98269]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:42.620351 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:42.620649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:42.620649 np0000001643 nova-compute[98269]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511 (non-flash)
May 28 14:01:42.620649 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:42.620934 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', '4')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:01:42.621117 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', '4')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:01:42.622414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511', '3')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:01:42.623124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7803677e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:01:42.623473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:01:42.623823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Flush multipath device 3300000003326fd3a {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:01:42.665591 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:01:42.718315 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:01:42.769041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:01:42.769209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:01:42.770901 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:01:42.782581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:01:42.788055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:01:42.801278 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:42.832865 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.40.100,3260]
May 28 14:01:42.832865 np0000001643 nova-compute[98269]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.40.100,3260] successful.
May 28 14:01:42.832865 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:42.845115 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:42.857285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:42.886877 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.50.100,3260]
May 28 14:01:42.886877 np0000001643 nova-compute[98269]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-28824eea-7670-48f1-b2f0-1119f8e87511, portal: 192.168.50.100,3260] successful.
May 28 14:01:42.886877 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:42.896549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:42.896883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:01:42.897064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] <== disconnect_volume: return (306ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:01:42.897303 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:01:42.898232 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Deleting instance files /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8_del
May 28 14:01:42.899331 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Deletion of /opt/stack/data/nova/instances/97eb14df-abb4-41e7-bc37-5b4c6c74eaa8_del complete
May 28 14:01:42.917308 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:42.929412 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:42.946016 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Successfully updated port: 25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:43.015977 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-changed-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:43.016877 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Refreshing instance network info cache due to event network-changed-25f7408f-0d21-494a-8cf0-b5a78aea3fd7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:43.017100 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] Acquiring lock "refresh_cache-150a83f0-0070-4df3-ab14-6aa1c028be82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:43.017246 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] Acquired lock "refresh_cache-150a83f0-0070-4df3-ab14-6aa1c028be82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:43.017418 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Refreshing network info cache for port 25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:43.041988 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:43.045984 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Booting with volume 0498706f-7c10-44e6-ac4c-96485dd9e12f at /dev/vdb
May 28 14:01:43.099552 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:01:43.113716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:01:43.137277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:43.163919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:01:43.164310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:01:43.175442 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:01:43.177030 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feae:16a4', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c'] 
May 28 14:01:43.177224 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:01:43.177386 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:01:43.177713 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:01:43.178009 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating existing volume attachment record: d89ad9d9-5e3a-49c5-948c-0e081257ffa5 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:01:43.263779 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:43.291806 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:43.293658 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:43.293843 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Creating image(s)
May 28 14:01:43.294533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "/opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:43.295544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:43.295544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:43.297059 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:43.304414 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:43.306293 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:43.399334 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:43.401333 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:43.402104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:43.403204 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:43.406052 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:43.408434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:43.422664 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Took 1.77 seconds to destroy the instance on the hypervisor.
May 28 14:01:43.423952 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:01:43.424421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:01:43.424637 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:01:43.426429 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:43.439824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.690s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:43.441265 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.639s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:43.441436 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:43.450959 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:01:43.450959 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Claim successful on node np0000001643
May 28 14:01:43.453914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-150a83f0-0070-4df3-ab14-6aa1c028be82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:43.495079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:43.495584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:43.526365 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:43.540193 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk 1073741824" returned: 0 in 0.044s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:43.541117 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:43.541512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:43.579252 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully updated port: 34d0e8d8-44e7-460e-8bad-b2a3110164da {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:43.598366 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:43.618254 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:43.621616 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.080s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:43.622026 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:43.622497 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:43.701655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:43.702188 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Cannot resize image /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:43.702725 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:43.703435 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Ensure instance console log exists: /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:43.703603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:43.703880 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:43.704086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:43.767358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-59343999-856c-4b14-adb7-58137d5ff733 req-a50b9e61-5f3e-4b23-898f-edffda922307 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:43.827467 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:43.953791 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:43.955258 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:43.955258 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:43.955258 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:43.968571 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:43.968571 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] Acquiring lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:43.969979 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:43.969979 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:43.969979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] No waiting events found dispatching network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:43.969979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-unplugged-c1341c24-2f36-4a83-9689-177abf10a391 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:01:43.969979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-34d0e8d8-44e7-460e-8bad-b2a3110164da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:43.970982 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-34d0e8d8-44e7-460e-8bad-b2a3110164da. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:43.971271 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:43.971393 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:43.971567 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port 34d0e8d8-44e7-460e-8bad-b2a3110164da {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:44.050301 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3deb2050ffd5441bb38c08eb82707d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bfe2941b78c4f2e9f16f60e05ec5dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:44.095412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:44.329431 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d06ed4d-2580-4a44-9a7c-198bea724be7 req-7ab63905-2f96-46cb-b393-7b89df13b1e3 service nova] Releasing lock "refresh_cache-150a83f0-0070-4df3-ab14-6aa1c028be82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:44.330771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-150a83f0-0070-4df3-ab14-6aa1c028be82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:44.331156 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:44.414868 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:44.460579 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:44.474016 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:44.600178 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:44.637612 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Successfully created port: e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:44.777669 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully updated port: 0313acab-d072-4ead-9186-1a6bc350a825 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:44.845641 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Booting with volume e8e72339-2641-4e2f-b2b8-94b12a1226f1 at /dev/vdc
May 28 14:01:44.851840 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:44.910953 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:01:44.917585 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Took 1.49 seconds to deallocate network for instance.
May 28 14:01:44.925471 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:01:44.958160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:44.981011 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:44.990213 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:44.995952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:01:44.996215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:01:45.008118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:01:45.009916 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feae:16a4', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c'] 
May 28 14:01:45.010309 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:01:45.010309 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:01:45.010750 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:01:45.011115 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating existing volume attachment record: 9b3c2334-d78b-4215-a3e0-f864012294cb {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:01:45.120585 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4031bdda-303a-484b-94ec-a3ecc5d7294e req-89deb42b-9411-43d4-bca8-1d209f776d00 service nova] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Received event network-vif-deleted-c1341c24-2f36-4a83-9689-177abf10a391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:45.253473 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:45.346467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:45.347969 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:45.356215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d541feed-927a-4a8d-9ec1-b9c9e2384a37 req-2bdf566e-ade8-4236-af9f-a61720dfb9d6 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:45.377340 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Successfully updated port: e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:45.439471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Updating instance_info_cache with network_info: [{"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:45.504909 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Took 0.59 seconds to detach 1 volumes for instance.
May 28 14:01:45.853650 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:45.881047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:45.881047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:45.881047 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:45.887632 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully updated port: 00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:45.944204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-150a83f0-0070-4df3-ab14-6aa1c028be82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:45.944497 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Instance network_info: |[{"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:45.946293 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Start _get_guest_xml network_info=[{"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:45.949054 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:45.950184 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1503665945', uuid='150a83f0-0070-4df3-ab14-6aa1c028be82'), owner=OwnerMeta(userid='86dc22a5d6a7478dab81969f17d3daab', username='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member', projectid='b74df57519ea42009fcebcff7cfdf94e', projectname='tempest-ServerBootFromVolumeStableRescueTest-241739491'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976905.949856) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:45.950889 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:45.951236 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:45.951827 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:45.952011 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:45.952892 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:45.953214 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:45.953400 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:45.953559 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:45.953722 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:45.953858 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:45.953989 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:45.954137 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:45.954297 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:45.954414 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:45.955028 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:45.955171 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:45.966330 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1503665945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1503665945',id=7,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-626j2y02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:42Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=150a83f0-0070-4df3-ab14-6aa1c028be82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:45.966638 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:45.968279 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:d3,bridge_name='br-int',has_traffic_filtering=True,id=25f7408f-0d21-494a-8cf0-b5a78aea3fd7,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f7408f-0d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:45.968279 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'pci_devices' on Instance uuid 150a83f0-0070-4df3-ab14-6aa1c028be82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:46.003846 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:46.005052 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:46.005342 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Creating image(s)
May 28 14:01:46.007320 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:46.007536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:46.008964 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:46.009634 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:46.016506 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:46.021121 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:46.024470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:46.047827 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-0313acab-d072-4ead-9186-1a6bc350a825 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:46.049269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-0313acab-d072-4ead-9186-1a6bc350a825. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:46.049537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:46.049674 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:46.049843 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port 0313acab-d072-4ead-9186-1a6bc350a825 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:46.108390 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:46.112473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:46.112473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:46.112473 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:46.115096 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:46.116113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:46.191888 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.075s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:46.192820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:46.234600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk 1073741824" returned: 0 in 0.042s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:46.235311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.125s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:46.235866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:46.325955 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:46.329521 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:46.329521 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:46.364123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.924s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:46.365253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.343s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:46.365552 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:01:46.414640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:46.416104 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Cannot resize image /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:46.416104 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:46.416104 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Ensure instance console log exists: /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:46.416104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:46.416104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:46.416104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:46.471572 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <uuid>150a83f0-0070-4df3-ab14-6aa1c028be82</uuid>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <name>instance-00000007</name>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1503665945</nova:name>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:45</nova:creationTime>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:user uuid="86dc22a5d6a7478dab81969f17d3daab">tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member</nova:user>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:project uuid="b74df57519ea42009fcebcff7cfdf94e">tempest-ServerBootFromVolumeStableRescueTest-241739491</nova:project>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         <nova:port uuid="25f7408f-0d21-494a-8cf0-b5a78aea3fd7">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <entry name="serial">150a83f0-0070-4df3-ab14-6aa1c028be82</entry>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <entry name="uuid">150a83f0-0070-4df3-ab14-6aa1c028be82</entry>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk.config"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:fc:c7:d3"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <target dev="tap25f7408f-0d"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/console.log" append="off"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:46.471572 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:46.476752 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Preparing to wait for external event network-vif-plugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:46.476752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:46.476752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:46.476752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:46.476752 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1503665945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1503665945',id=7,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-626j2y02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:42Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=150a83f0-0070-4df3-ab14-6aa1c028be82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:d3,bridge_name='br-int',has_traffic_filtering=True,id=25f7408f-0d21-494a-8cf0-b5a78aea3fd7,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f7408f-0d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:d3,bridge_name='br-int',has_traffic_filtering=True,id=25f7408f-0d21-494a-8cf0-b5a78aea3fd7,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f7408f-0d') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:46.477056 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80be7ecb-9163-58c2-b168-40f4dc1b1793', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:46.478096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:46.479408 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:46.479408 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:46.482798 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:46.483128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25f7408f-0d, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:46.483574 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25f7408f-0d, col_values=(('qos', UUID('6d291e66-5d0b-48aa-ade6-145d708b8175')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:46.483857 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25f7408f-0d, col_values=(('external_ids', {'iface-id': '25f7408f-0d21-494a-8cf0-b5a78aea3fd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:c7:d3', 'vm-uuid': '150a83f0-0070-4df3-ab14-6aa1c028be82'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:46.486967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:46.490738 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:46.494639 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:46.496739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:46.498388 np0000001643 nova-compute[98269]: INFO os_vif [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:d3,bridge_name='br-int',has_traffic_filtering=True,id=25f7408f-0d21-494a-8cf0-b5a78aea3fd7,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f7408f-0d')
May 28 14:01:46.554569 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:46.706026 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:46.830108 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:46.878370 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:01:46.879120 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:01:46.879120 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:46.879120 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:46.990369 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:47.006112 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3deb2050ffd5441bb38c08eb82707d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bfe2941b78c4f2e9f16f60e05ec5dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:01:47.055743 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Updating instance_info_cache with network_info: [{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:47.096470 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:01:47.097509 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:01:47.136508 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully updated port: 0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:47.149208 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:47.150277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:47.150791 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Creating image(s)
May 28 14:01:47.151085 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:01:47.151221 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Ensure instance console log exists: /opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:47.151441 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:47.151782 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:47.151916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:47.193176 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-changed-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:47.194019 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Refreshing instance network info cache due to event network-changed-e57ade8b-a180-4fd2-9951-a99aec03b52c. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:47.194210 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] Acquiring lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:47.381105 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:01:47.491758 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:47.491958 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:47.492068 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:47.492313 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:47.492400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:47.492527 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port 00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:47.509980 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Successfully created port: 0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:01:47.560682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:47.561109 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance network_info: |[{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:47.563171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] Acquired lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:47.563421 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Start _get_guest_xml network_info=[{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:47.563897 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Refreshing network info cache for port e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:47.569556 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:47.569556 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2020791412', uuid='fb9d4d3f-f068-49a2-ba11-114989ee8d9e'), owner=OwnerMeta(userid='3deb2050ffd5441bb38c08eb82707d7d', username='tempest-ServerRescueNegativeTestJSON-1154493123-project-member', projectid='9bfe2941b78c4f2e9f16f60e05ec5dcc', projectname='tempest-ServerRescueNegativeTestJSON-1154493123'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976907.5691314) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:47.570265 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:47.570672 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:47.571477 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:47.571699 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:47.572562 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:47.572964 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:47.573235 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:47.573403 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:47.573619 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:47.573817 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:47.574002 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:47.574200 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:47.574369 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:47.574554 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:47.574751 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:47.574942 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:47.588085 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020791412',display_name='tempest-ServerRescueNegativeTestJSON-server-2020791412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020791412',id=8,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-7ieaqe8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:45Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=fb9d4d3f-f068-49a2-ba11-114989ee8d9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:47.588537 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:47.589245 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:47.589920 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'pci_devices' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:47.605080 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:01:47.884291 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:01:47.995741 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:48.025414 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:48.025764 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:48.025975 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No VIF found with MAC fa:16:3e:fc:c7:d3, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:48.026631 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Using config drive
May 28 14:01:48.041518 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Successfully updated port: 0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:48.068415 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:48.093496 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <uuid>fb9d4d3f-f068-49a2-ba11-114989ee8d9e</uuid>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <name>instance-00000008</name>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020791412</nova:name>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:47</nova:creationTime>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:user uuid="3deb2050ffd5441bb38c08eb82707d7d">tempest-ServerRescueNegativeTestJSON-1154493123-project-member</nova:user>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:project uuid="9bfe2941b78c4f2e9f16f60e05ec5dcc">tempest-ServerRescueNegativeTestJSON-1154493123</nova:project>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         <nova:port uuid="e57ade8b-a180-4fd2-9951-a99aec03b52c">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <entry name="serial">fb9d4d3f-f068-49a2-ba11-114989ee8d9e</entry>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <entry name="uuid">fb9d4d3f-f068-49a2-ba11-114989ee8d9e</entry>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:eb:f8:2e"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <target dev="tape57ade8b-a1"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/console.log" append="off"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:48.093496 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:48.093496 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Preparing to wait for external event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:48.093496 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:48.093496 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:48.095786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:48.095786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020791412',display_name='tempest-ServerRescueNegativeTestJSON-server-2020791412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020791412',id=8,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-7ieaqe8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:45Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=fb9d4d3f-f068-49a2-ba11-114989ee8d9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:48.095786 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:48.100190 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:48.100190 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:48.100190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:48.100190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:48.100190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:48.101779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:48.101779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd64f14de-3359-5594-9d8b-8dc4479ecd5e', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:48.104553 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:48.104553 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:48.114362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:48.116001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.751s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:48.123646 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:48.128495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:48.128748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape57ade8b-a1, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:48.129091 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape57ade8b-a1, col_values=(('qos', UUID('6398fbf7-71b6-4012-8df6-8944a5f64f65')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:48.129236 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape57ade8b-a1, col_values=(('external_ids', {'iface-id': 'e57ade8b-a180-4fd2-9951-a99aec03b52c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:f8:2e', 'vm-uuid': 'fb9d4d3f-f068-49a2-ba11-114989ee8d9e'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:48.134828 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:48.136240 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:48.140478 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:48.140478 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-0bfe536e-457d-4275-a0ff-78f03834d29e. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:48.140478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:48.148679 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:48.149987 np0000001643 nova-compute[98269]: INFO os_vif [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1')
May 28 14:01:48.158467 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully updated port: 09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:48.205771 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Deleted allocations for instance 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8
May 28 14:01:48.214825 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:48.215202 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-09bc3f96-3fb8-4529-9d98-e63533eb5d45. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:48.215634 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:48.345124 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:48.463604 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:48.533316 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:48.546144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:48.546144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:48.546144 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:48.638950 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Updated VIF entry in instance network info cache for port e57ade8b-a180-4fd2-9951-a99aec03b52c. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:48.639371 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Updating instance_info_cache with network_info: [{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:48.700462 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Creating config drive at /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk.config
May 28 14:01:48.705278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbv8ss7i0 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:48.743045 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbv8ss7i0" returned: 0 in 0.037s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:48.851179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8b8c967-f07a-409a-a70f-1f5f746ed1ab req-32c8ef0e-6007-4061-8953-545d7b17cba7 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:48.851754 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:48.851915 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port 0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:48.893053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:01:48.897868 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:01:48.898318 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Creating image(s)
May 28 14:01:48.899216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:48.899511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:48.900169 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:48.901053 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:48.906785 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:48.908018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:48.984729 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:48.985310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:48.986343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:48.988056 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:48.992027 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:01:48.992494 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:49.064792 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.072s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:49.065176 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:49.097836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:49.111236 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk 1073741824" returned: 0 in 0.046s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:49.111906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.126s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:49.112302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:49.142781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0c0b5faa-fa03-4437-99b1-8e9986142225 req-0503d74c-737b-4b8f-b496-c0651b9cbd22 service nova] Releasing lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:49.152562 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:49.198109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:49.198520 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:01:49.198793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:49.241432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:49.266212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e11e971-eb81-4813-b0e1-0218d57d289c tempest-DeleteServersTestJSON-1854035852 tempest-DeleteServersTestJSON-1854035852-project-member] Lock "97eb14df-abb4-41e7-bc37-5b4c6c74eaa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.119s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:49.272136 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:49.313430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:49.313430 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Cannot resize image /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:01:49.313430 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:01:49.313430 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:01:49.313430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:49.313430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:49.313430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:49.354173 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:49.373557 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:49.438200 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:49.510337 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:49.527867 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Successfully updated port: f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:01:49.680377 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:49.680536 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:49.681426 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No VIF found with MAC fa:16:3e:eb:f8:2e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:49.681426 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Using config drive
May 28 14:01:49.705831 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Updating instance_info_cache with network_info: [{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:49.731418 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:49.745026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:49.763469 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:49.773005 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:49.782462 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.033475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:50.187103 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:50.194718 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:50.194860 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-f97897ad-8223-4e94-a0d2-30e968ae948f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:50.195046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:50.210910 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:50.211750 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance network_info: |[{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:50.213938 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Start _get_guest_xml network_info=[{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:50.219006 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:50.220272 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2020760314', uuid='65c247b5-acbc-474a-bb88-a2edf9ac2d0b'), owner=OwnerMeta(userid='3deb2050ffd5441bb38c08eb82707d7d', username='tempest-ServerRescueNegativeTestJSON-1154493123-project-member', projectid='9bfe2941b78c4f2e9f16f60e05ec5dcc', projectname='tempest-ServerRescueNegativeTestJSON-1154493123'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976910.219882) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:50.221763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:50.222095 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:50.222980 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:50.223151 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:50.224153 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:50.224747 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:50.224918 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:50.225052 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:50.225357 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:50.225499 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:50.225653 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:50.225834 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:50.225962 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:50.226099 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:50.226229 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:50.226398 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:50.237940 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020760314',display_name='tempest-ServerRescueNegativeTestJSON-server-2020760314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020760314',id=9,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-jz911k8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:48Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=65c247b5-acbc-474a-bb88-a2edf9ac2d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:01:50.238187 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:50.238836 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:50.239412 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'pci_devices' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:01:50.269284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:50.269529 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-changed-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:50.269716 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Refreshing instance network info cache due to event network-changed-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:01:50.270067 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] Acquiring lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:50.270202 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] Acquired lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:50.270363 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Refreshing network info cache for port 0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:50.271391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:50.271962 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port 09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:50.291146 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976910.2908232, 150a83f0-0070-4df3-ab14-6aa1c028be82 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:50.291531 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] VM Started (Lifecycle Event)
May 28 14:01:50.322930 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Creating config drive at /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config
May 28 14:01:50.327191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmx7ug4fg {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:50.359467 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmx7ug4fg" returned: 0 in 0.032s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:50.742812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] End _get_guest_xml xml=<domain type="qemu">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <uuid>65c247b5-acbc-474a-bb88-a2edf9ac2d0b</uuid>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <name>instance-00000009</name>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020760314</nova:name>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:50</nova:creationTime>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:user uuid="3deb2050ffd5441bb38c08eb82707d7d">tempest-ServerRescueNegativeTestJSON-1154493123-project-member</nova:user>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:project uuid="9bfe2941b78c4f2e9f16f60e05ec5dcc">tempest-ServerRescueNegativeTestJSON-1154493123</nova:project>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         <nova:port uuid="0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <system>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <entry name="serial">65c247b5-acbc-474a-bb88-a2edf9ac2d0b</entry>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <entry name="uuid">65c247b5-acbc-474a-bb88-a2edf9ac2d0b</entry>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </system>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <os>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   </os>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <features>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   </features>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   <devices>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </disk>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:f1:0a:f1"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <target dev="tap0af0d2c3-2e"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </interface>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/console.log" append="off"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </serial>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <video>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </video>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </rng>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:   </devices>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]: </domain>
May 28 14:01:50.742812 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:01:50.745219 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Preparing to wait for external event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:01:50.745219 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:50.745219 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:50.745219 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:50.749601 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020760314',display_name='tempest-ServerRescueNegativeTestJSON-server-2020760314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020760314',id=9,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-jz911k8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:48Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=65c247b5-acbc-474a-bb88-a2edf9ac2d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:01:50.749601 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:01:50.749601 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:01:50.750596 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:01:50.750596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.750596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:50.750596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:01:50.751345 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.751633 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '435d40ad-8335-5499-8684-4c3e5a1cc602', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:50.752556 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.753260 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:50.759186 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.761464 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.761729 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0af0d2c3-2e, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:50.762127 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0af0d2c3-2e, col_values=(('qos', UUID('7f7fa2df-1d9a-4c04-bcf2-64e39c5d6419')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:50.762395 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0af0d2c3-2e, col_values=(('external_ids', {'iface-id': '0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:0a:f1', 'vm-uuid': '65c247b5-acbc-474a-bb88-a2edf9ac2d0b'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:01:50.763439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.764754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:01:50.775542 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:50.780429 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:50.784967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.790465 np0000001643 nova-compute[98269]: INFO os_vif [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e')
May 28 14:01:50.794239 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:50.799796 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.816889 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976910.816507, 150a83f0-0070-4df3-ab14-6aa1c028be82 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:50.817302 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] VM Paused (Lifecycle Event)
May 28 14:01:50.842945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.945236 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:50.960789 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:51.200108 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6a753bf8-8a0b-445c-b018-0b98c91899f3 req-fe5666ab-bd0b-4c95-a7c0-b008bbd2b6c9 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:51.200687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6a753bf8-8a0b-445c-b018-0b98c91899f3 req-fe5666ab-bd0b-4c95-a7c0-b008bbd2b6c9 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:51.200926 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6a753bf8-8a0b-445c-b018-0b98c91899f3 req-fe5666ab-bd0b-4c95-a7c0-b008bbd2b6c9 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:51.201078 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6a753bf8-8a0b-445c-b018-0b98c91899f3 req-fe5666ab-bd0b-4c95-a7c0-b008bbd2b6c9 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:51.201276 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6a753bf8-8a0b-445c-b018-0b98c91899f3 req-fe5666ab-bd0b-4c95-a7c0-b008bbd2b6c9 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Processing event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:51.208464 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:51.212109 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:51.216332 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:51.221815 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:51.229812 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:51.242982 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:51.251902 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:51.322581 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:51.329837 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:51.414689 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Updated VIF entry in instance network info cache for port 0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:51.415305 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Updating instance_info_cache with network_info: [{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:51.714775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f84ac89a-dde1-4456-a76e-dfc05f03a1eb req-af575045-9d0d-4567-9300-248e90b50972 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:51.715328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:51.715328 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:51.778756 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:51.784176 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:51.785828 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance spawned successfully.
May 28 14:01:51.786136 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:51.837407 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:51.837798 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976911.8375185, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:51.837985 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Started (Lifecycle Event)
May 28 14:01:51.917329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-89309bff-cbd8-4630-b15e-d02021a8e119 req-01d28686-8839-4282-87c1-863a87903a73 service nova] Releasing lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:52.293505 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:52.293595 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:52.293846 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:52.294062 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:52.294313 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:52.294610 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:52.321379 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:01:52.333397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:52.333573 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:01:52.333721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No VIF found with MAC fa:16:3e:f1:0a:f1, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:01:52.334202 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Using config drive
May 28 14:01:52.341055 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:52.344179 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:52.541624 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:52.799542 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Took 6.80 seconds to spawn the instance on the hypervisor.
May 28 14:01:52.800106 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:52.846501 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:52.850980 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:52.851224 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976912.8510308, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:52.851295 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Paused (Lifecycle Event)
May 28 14:01:52.938858 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:53.032207 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Creating config drive at /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config
May 28 14:01:53.035087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps4cdlwch {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:01:53.068545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps4cdlwch" returned: 0 in 0.033s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:01:53.311957 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Took 14.02 seconds to build instance.
May 28 14:01:53.338959 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f48cc956-2704-44bf-9383-c431e298cdac req-6551510c-d359-462b-81d5-7fd7a950c562 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:53.344873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f48cc956-2704-44bf-9383-c431e298cdac req-6551510c-d359-462b-81d5-7fd7a950c562 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:53.344873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f48cc956-2704-44bf-9383-c431e298cdac req-6551510c-d359-462b-81d5-7fd7a950c562 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:53.344873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f48cc956-2704-44bf-9383-c431e298cdac req-6551510c-d359-462b-81d5-7fd7a950c562 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:53.344873 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f48cc956-2704-44bf-9383-c431e298cdac req-6551510c-d359-462b-81d5-7fd7a950c562 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:53.344873 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f48cc956-2704-44bf-9383-c431e298cdac req-6551510c-d359-462b-81d5-7fd7a950c562 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state active and task_state None.
May 28 14:01:53.355254 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:53.358526 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:53.362735 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976913.3622928, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:53.362890 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Resumed (Lifecycle Event)
May 28 14:01:53.413993 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:53.546858 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:53.578929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:53.681424 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:53.744358 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:53.752042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:53.753601 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:53.820642 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.536s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:53.867179 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-87f52219-1952-4f29-a5fb-bc8319c48f80 req-686dae7c-ca9d-406e-b12d-ccff7f3e10fd service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:53.867179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-87f52219-1952-4f29-a5fb-bc8319c48f80 req-686dae7c-ca9d-406e-b12d-ccff7f3e10fd service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:53.867179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-87f52219-1952-4f29-a5fb-bc8319c48f80 req-686dae7c-ca9d-406e-b12d-ccff7f3e10fd service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:53.867381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-87f52219-1952-4f29-a5fb-bc8319c48f80 req-686dae7c-ca9d-406e-b12d-ccff7f3e10fd service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:53.867669 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-87f52219-1952-4f29-a5fb-bc8319c48f80 req-686dae7c-ca9d-406e-b12d-ccff7f3e10fd service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Processing event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:53.877100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:53.881902 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:54.102238 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:54.113152 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:54.437545 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:54.505579 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976914.5052137, 65c247b5-acbc-474a-bb88-a2edf9ac2d0b => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:54.506465 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:54.506728 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] VM Started (Lifecycle Event)
May 28 14:01:54.511249 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:54.513322 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance spawned successfully.
May 28 14:01:54.513791 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:54.789070 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:54.990033 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [{"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:55.011496 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:55.012238 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:55.019257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:55.019391 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:55.019709 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:55.020494 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:55.020494 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:55.020494 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:55.492106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:55.492769 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance network_info: |[{"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:01:55.493196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:55.495367 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:01:55.495533 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Start _get_guest_xml network_info=[{"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'b6c1b9e2-d8e6-4bd1-b942-0b021e92c0f9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '986e86a9-d6cb-40b3-9c7b-263684816a96', 'attached_at': '', 'detached_at': '', 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'serial': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb'}, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'd89ad9d9-5e3a-49c5-948c-0e081257ffa5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '986e86a9-d6cb-40b3-9c7b-263684816a96', 'attached_at': '', 'detached_at': '', 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'serial': '0498706f-7c10-44e6-ac4c-96485dd9e12f'}, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '9b3c2334-d78b-4215-a3e0-f864012294cb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '986e86a9-d6cb-40b3-9c7b-263684816a96', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'serial': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:01:55.501130 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:01:55.502556 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1935911609', uuid='986e86a9-d6cb-40b3-9c7b-263684816a96'), owner=OwnerMeta(userid='365296e0ff384bad9ae6b97762431f99', username='tempest-TaggedBootDevicesTest_v242-769083887-project-member', projectid='bee69e237aa64213a01d0bf475569055', projectname='tempest-TaggedBootDevicesTest_v242-769083887'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976915.5019817) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:01:55.503607 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:01:55.504068 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:01:55.504925 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:01:55.505142 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:01:55.506325 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:01:55.506823 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:01:55.507038 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:01:55.507193 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:01:55.507388 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:01:55.507546 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:01:55.507720 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:01:55.507922 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:01:55.508086 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:01:55.508261 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:01:55.508423 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:01:55.508811 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:01:55.514715 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:55.516764 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976915.516527, 65c247b5-acbc-474a-bb88-a2edf9ac2d0b => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:55.516913 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] VM Paused (Lifecycle Event)
May 28 14:01:55.523772 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:01:55.524186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:01:55.524379 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:01:55.524847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:01:55.525774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:01:55.527673 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Took 6.63 seconds to spawn the instance on the hypervisor.
May 28 14:01:55.527849 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:55.540682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:01:55.541206 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:01:55.541934 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:01:55.542209 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:01:55.542697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:01:55.542910 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:01:55.553220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:01:55.553220 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:55.559229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:01:55.559229 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:55.570593 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb] added
May 28 14:01:55.570593 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:01:55.570593 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:55.570593 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:55.570593 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:55.570593 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:55.570593 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:55.570593 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:01:55.571281 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:01:55.571281 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:01:55.574151 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb] added
May 28 14:01:55.574151 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:01:55.574151 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:55.574151 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:55.574151 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:01:55.574151 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:01:55.574151 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:55.574625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:01:55.574625 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:01:55.574756 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:01:55.765080 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:55.956688 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b72b9a81-66c2-4615-8994-f612e1081203 req-6a9beb9f-3435-4cf6-8cea-3d139865fd74 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:55.956688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b72b9a81-66c2-4615-8994-f612e1081203 req-6a9beb9f-3435-4cf6-8cea-3d139865fd74 service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:55.956688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b72b9a81-66c2-4615-8994-f612e1081203 req-6a9beb9f-3435-4cf6-8cea-3d139865fd74 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:55.956688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b72b9a81-66c2-4615-8994-f612e1081203 req-6a9beb9f-3435-4cf6-8cea-3d139865fd74 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:55.957281 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b72b9a81-66c2-4615-8994-f612e1081203 req-6a9beb9f-3435-4cf6-8cea-3d139865fd74 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] No waiting events found dispatching network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:55.957566 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b72b9a81-66c2-4615-8994-f612e1081203 req-6a9beb9f-3435-4cf6-8cea-3d139865fd74 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received unexpected event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 for instance with vm_state active and task_state None.
May 28 14:01:55.997193 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:56.020548 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:56.023519 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976916.0224066, 65c247b5-acbc-474a-bb88-a2edf9ac2d0b => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:56.023519 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] VM Resumed (Lifecycle Event)
May 28 14:01:56.038145 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Took 15.31 seconds to build instance.
May 28 14:01:56.443703 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:56.528216 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:56.530634 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:56.541076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.832s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:56.571485 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:01:56.577466 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:01:56.588061 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:01:56.588061 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:01:56.599184 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:01:56.599184 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:56.606787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:56.618844 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:56.618844 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:56.620200 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:56.620200 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:56.620200 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:01:56.620200 np0000001643 nova-compute[98269]: 
May 28 14:01:56.620200 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:56.633805 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updated VIF entry in instance network info cache for port f97897ad-8223-4e94-a0d2-30e968ae948f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:01:56.634877 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [{"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:56.635739 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:56.635739 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:56.635739 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:01:56.635739 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:56.635739 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:01:56.635739 np0000001643 nova-compute[98269]: 
May 28 14:01:56.908543 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Rescuing
May 28 14:01:56.908775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:01:56.908909 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:01:56.909045 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:01:57.033093 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] During sync_power_state the instance has a pending task (rescuing). Skip.
May 28 14:01:57.043656 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00047742099991410214 future=<Future at 0x71a7781a1790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:01:57.043838 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:01:57.044292 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Emitting event <LifecycleEvent: 1779976902.0430207, 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:57.044482 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] VM Stopped (Lifecycle Event)
May 28 14:01:57.137898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:57.138124 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-vif-plugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:57.138809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:57.138809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:57.138809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:57.138809 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Processing event network-vif-plugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:01:57.139095 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-vif-plugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:01:57.139268 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:01:57.139416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:01:57.139566 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:57.139715 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] No waiting events found dispatching network-vif-plugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:01:57.139858 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e0263dd1-1436-4fa3-a1e0-23ce509a10b3 req-008b0806-c8bc-42cf-99cb-2c618d9edfb2 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received unexpected event network-vif-plugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 for instance with vm_state building and task_state spawning.
May 28 14:01:57.140534 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:01:57.143288 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976917.1430082, 150a83f0-0070-4df3-ab14-6aa1c028be82 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:01:57.143454 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] VM Resumed (Lifecycle Event)
May 28 14:01:57.144670 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:01:57.146936 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Instance spawned successfully.
May 28 14:01:57.146936 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:01:57.411230 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:57.548232 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 97eb14df-abb4-41e7-bc37-5b4c6c74eaa8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:57.646709 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:57.648537 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:01:57.659365 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:57.659551 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:57.659934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:57.660501 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:57.660897 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:57.661235 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:01:57.672273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.50.100,3260]
May 28 14:01:57.672273 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.50.100,3260] successful.
May 28 14:01:57.672273 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:57.674024 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.40.100,3260]
May 28 14:01:57.674024 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.40.100,3260] successful.
May 28 14:01:57.674024 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:57.691208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:57.707354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:01:57.717008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.717008 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.717008 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:57.717213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.717213 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.717213 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:57.717633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.175s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:01:57.717789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:01:57.718402 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:01:57.718563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:01:57.728756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.728756 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.728756 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:01:57.728970 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.728970 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:01:57.728970 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:01:57.729223 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.188s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:01:57.729337 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:01:57.729894 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:01:57.730022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:01:57.792153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:01:57.792153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:01:57.792153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:01:57.792153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:01:57.848854 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:01:58.098129 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Updating instance_info_cache with network_info: [{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:01:58.152115 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:01:58.178160 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Took 14.89 seconds to spawn the instance on the hypervisor.
May 28 14:01:58.178160 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:01:58.543662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:01:58.599930 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-65c247b5-acbc-474a-bb88-a2edf9ac2d0b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:01:58.694467 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Took 20.99 seconds to build instance.
May 28 14:01:59.105169 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:59.196379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eacaaaac-57ce-47ed-b354-b94c98b8b9e3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.501s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:01:59.453900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:01:59.565036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Found WWN 33000000086bf4ed4 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:01:59.565372 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.041s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:01:59.565515 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '33000000086bf4ed4', 'path': '/dev/dm-0', 'multipath_id': '33000000086bf4ed4'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:01:59.566040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086bf4ed4', 'path': '/dev/dm-0', 'multipath_id': '33000000086bf4ed4'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:00.072864 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:00.073135 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:00.073260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:00.073570 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:00.073867 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:00.089912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:00.091153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:00.092473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:00.092473 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:00.093325 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:00.093662 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:00.105792 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:00.105792 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:00.111340 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:00.111340 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:00.120228 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f] added
May 28 14:02:00.120228 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:00.120228 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:00.120228 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:00.120228 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:00.120228 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:00.120228 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:00.120623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:00.120623 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:00.120861 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:00.124716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f] added
May 28 14:02:00.124716 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:00.124716 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:00.124716 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:00.124716 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:00.124716 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:00.124716 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:00.125008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:00.125053 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:00.125207 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:00.257959 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:00.258692 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:00.277208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:00.490409 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4f0339da-71e4-4a9c-8d19-e491f827d5ea req-bece5f91-a3fe-4698-9997-17cdacbebd4a service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:00.495051 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4f0339da-71e4-4a9c-8d19-e491f827d5ea req-bece5f91-a3fe-4698-9997-17cdacbebd4a service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:00.495051 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4f0339da-71e4-4a9c-8d19-e491f827d5ea req-bece5f91-a3fe-4698-9997-17cdacbebd4a service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:00.495051 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4f0339da-71e4-4a9c-8d19-e491f827d5ea req-bece5f91-a3fe-4698-9997-17cdacbebd4a service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:00.495051 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4f0339da-71e4-4a9c-8d19-e491f827d5ea req-bece5f91-a3fe-4698-9997-17cdacbebd4a service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] No waiting events found dispatching network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:00.495051 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-4f0339da-71e4-4a9c-8d19-e491f827d5ea req-bece5f91-a3fe-4698-9997-17cdacbebd4a service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received unexpected event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 for instance with vm_state active and task_state rescuing.
May 28 14:02:00.504237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:00.513643 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:00.583672 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999645513999894 future=<Future at 0x71a75c709520 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:00.585223 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997739348999858 future=<Future at 0x71a75c709520 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:00.585369 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99755509800002 future=<Future at 0x71a75c709520 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:00.587718 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance destroyed successfully.
May 28 14:02:00.588617 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'numa_topology' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:00.770715 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:01.045814 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:01.093593 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Attempting rescue
May 28 14:02:01.094009 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 14:02:01.101171 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:02:01.101800 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Creating image(s)
May 28 14:02:01.101961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:01.102288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:01.103315 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:01.103594 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'trusted_certs' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:01.121581 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:01.125889 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:01.142283 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:01.142283 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:01.148225 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:01.148225 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.159716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.162858 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.176781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.176781 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.176781 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:01.176962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.176962 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.176962 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:01.182106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.182106 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.182106 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:01.182362 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.182362 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.182362 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:01.207669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.40.100,3260]
May 28 14:02:01.207669 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.40.100,3260] successful.
May 28 14:02:01.207669 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.220262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.232535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.50.100,3260]
May 28 14:02:01.232535 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.50.100,3260] successful.
May 28 14:02:01.232535 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.233271 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.233271 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.233271 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.233271 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.233271 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:01.233435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.233435 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.233435 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.233435 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.233435 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:01.234182 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:01.234182 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:01.234852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:01.234955 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:01.251133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:01.264989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:01.265157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:01.270408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.270408 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.270408 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.270408 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.270408 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:01.270698 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.270698 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:01.270698 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.270698 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:01.270698 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:01.270887 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:01.271023 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:01.272216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:01.272216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:01.297222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:01.297385 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:01.553199 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] instance snapshotting
May 28 14:02:01.605757 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<65c247b5-acbc-474a-bb88-a2edf9ac2d0b> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:01.606555 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:01.611248 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:01.613294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:01.614083 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:01.614706 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:01.622355 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:01.623281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:01.701849 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Beginning live snapshot process
May 28 14:02:01.721559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:01.725472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:01.778214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:01.779204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:01.781974 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'migration_context' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:02.093806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:02:02.286282 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<65c247b5-acbc-474a-bb88-a2edf9ac2d0b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:02.286282 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:02:02.287052 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Start _get_guest_xml network_info=[{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:f1:0a:f1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ad923155-4eca-4cf1-b871-662172c18500', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:02:02.287262 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'resources' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:02.575171 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2935b22e-ee1c-4a46-8129-c9e2d6ef6d82 req-59f7ab72-cc2c-4a63-bdde-d37dbb82c7a9 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:02.575885 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2935b22e-ee1c-4a46-8129-c9e2d6ef6d82 req-59f7ab72-cc2c-4a63-bdde-d37dbb82c7a9 service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:02.576127 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2935b22e-ee1c-4a46-8129-c9e2d6ef6d82 req-59f7ab72-cc2c-4a63-bdde-d37dbb82c7a9 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:02.576203 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2935b22e-ee1c-4a46-8129-c9e2d6ef6d82 req-59f7ab72-cc2c-4a63-bdde-d37dbb82c7a9 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:02.576382 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2935b22e-ee1c-4a46-8129-c9e2d6ef6d82 req-59f7ab72-cc2c-4a63-bdde-d37dbb82c7a9 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] No waiting events found dispatching network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:02.576706 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2935b22e-ee1c-4a46-8129-c9e2d6ef6d82 req-59f7ab72-cc2c-4a63-bdde-d37dbb82c7a9 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received unexpected event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 for instance with vm_state active and task_state rescuing.
May 28 14:02:02.703581 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:02.789804 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<65c247b5-acbc-474a-bb88-a2edf9ac2d0b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:02.792099 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:02.793212 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2020760314', uuid='65c247b5-acbc-474a-bb88-a2edf9ac2d0b'), owner=OwnerMeta(userid='3deb2050ffd5441bb38c08eb82707d7d', username='tempest-ServerRescueNegativeTestJSON-1154493123-project-member', projectid='9bfe2941b78c4f2e9f16f60e05ec5dcc', projectname='tempest-ServerRescueNegativeTestJSON-1154493123'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:f1:0a:f1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976922.7927823) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:02.794620 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:02:02.795152 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:02:02.796054 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:02:02.796379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:02:02.799464 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:03.114413 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Found WWN 3300000009d6bdc37 for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:03.117280 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:03.117280 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000009d6bdc37', 'path': '/dev/dm-3', 'multipath_id': '3300000009d6bdc37'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:03.117280 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009d6bdc37', 'path': '/dev/dm-3', 'multipath_id': '3300000009d6bdc37'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:03.215882 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:03.303483 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<65c247b5-acbc-474a-bb88-a2edf9ac2d0b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:03.317870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json -f qcow2" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:03.321261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:03.341110 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020760314',display_name='tempest-ServerRescueNegativeTestJSON-server-2020760314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020760314',id=9,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:55Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-jz911k8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:56Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=65c247b5-acbc-474a-bb88-a2edf9ac2d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:f1:0a:f1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:03.341411 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:f1:0a:f1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:03.342795 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:03.344337 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'pci_devices' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:03.421198 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json -f qcow2" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:03.422181 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:03.424931 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:03.425397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:03.503147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:03.503689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprrgl6jdt/0b298735c7914ec0aee36f718a15af75.delta 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:03.547310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprrgl6jdt/0b298735c7914ec0aee36f718a15af75.delta 1073741824" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:03.548224 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 14:02:03.638849 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:03.638849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:03.638849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:03.638849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:03.639406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:03.653868 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:03.654627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:03.655138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:03.655392 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:03.655903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:03.656132 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:03.667589 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:03.667589 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:03.668180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:03.668180 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:03.679435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1] added
May 28 14:02:03.679435 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:03.679435 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:03.679435 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:03.679435 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:03.679435 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:03.679435 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:03.679733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:03.679843 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:03.679978 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:03.682140 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1] added
May 28 14:02:03.682140 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:03.682140 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:03.682140 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:03.682140 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:03.682140 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:03.682140 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:03.682374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:03.682516 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:03.682704 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:03.820667 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 14:02:03.821999 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 14:02:03.848607 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<65c247b5-acbc-474a-bb88-a2edf9ac2d0b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:03.849956 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <uuid>65c247b5-acbc-474a-bb88-a2edf9ac2d0b</uuid>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <name>instance-00000009</name>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020760314</nova:name>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:02:02</nova:creationTime>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:user uuid="3deb2050ffd5441bb38c08eb82707d7d">tempest-ServerRescueNegativeTestJSON-1154493123-project-member</nova:user>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:project uuid="9bfe2941b78c4f2e9f16f60e05ec5dcc">tempest-ServerRescueNegativeTestJSON-1154493123</nova:project>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         <nova:port uuid="0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <entry name="serial">65c247b5-acbc-474a-bb88-a2edf9ac2d0b</entry>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <entry name="uuid">65c247b5-acbc-474a-bb88-a2edf9ac2d0b</entry>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config.rescue"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:f1:0a:f1"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <target dev="tap0af0d2c3-2e"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/console.log" append="off"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:03.849956 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:03.857344 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance destroyed successfully.
May 28 14:02:03.867569 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:02:03.867569 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprrgl6jdt/0b298735c7914ec0aee36f718a15af75.delta /opt/stack/data/nova/instances/snapshots/tmprrgl6jdt/0b298735c7914ec0aee36f718a15af75 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:03.973187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprrgl6jdt/0b298735c7914ec0aee36f718a15af75.delta /opt/stack/data/nova/instances/snapshots/tmprrgl6jdt/0b298735c7914ec0aee36f718a15af75" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:03.973828 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Snapshot extracted, beginning image upload
May 28 14:02:04.105065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:04.680763 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:04.683939 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:04.695456 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:04.695456 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:04.700785 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:04.700785 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.712719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.718917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.728960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.728960 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.728960 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.728960 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.728960 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:04.729142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.729142 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.729142 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.729142 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.729142 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:04.736661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.736661 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.736661 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.736661 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.736661 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:04.736934 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.736934 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.736934 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.736934 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.736934 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:04.777584 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.50.100,3260]
May 28 14:02:04.777584 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.50.100,3260] successful.
May 28 14:02:04.777584 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.790768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.40.100,3260]
May 28 14:02:04.790768 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.40.100,3260] successful.
May 28 14:02:04.790768 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.799225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.807263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.819588 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:04.819975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:04.820037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:04.821143 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:04.821390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:04.829828 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.829828 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.829828 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.829828 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.829828 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.829828 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.829828 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:04.830141 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.830141 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.830141 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:04.830141 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.830141 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:04.830141 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:04.830141 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:04.830357 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:04.830438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:04.831258 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:04.831390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:04.844171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:04.844171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:04.868222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:04.868222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:05.399081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:05.399228 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:05.399307 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:05.399519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No VIF found with MAC fa:16:3e:f1:0a:f1, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:05.399961 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Using config drive
May 28 14:02:05.656143 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:02:05.771806 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:05.907131 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'ec2_ids' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:06.411266 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<65c247b5-acbc-474a-bb88-a2edf9ac2d0b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:06.411387 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'keypairs' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:06.675604 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Found WWN 330000000b08d2609 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:06.676019 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:06.676295 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000b08d2609', 'path': '/dev/dm-4', 'multipath_id': '330000000b08d2609'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:06.676524 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b08d2609', 'path': '/dev/dm-4', 'multipath_id': '330000000b08d2609'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:06.914333 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<65c247b5-acbc-474a-bb88-a2edf9ac2d0b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:06.917739 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:07.073395 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Creating config drive at /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config.rescue
May 28 14:02:07.074523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc9bhtd4d {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:07.097065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.097529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.112563 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc9bhtd4d" returned: 0 in 0.038s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:07.163564 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Snapshot image upload complete
May 28 14:02:07.163889 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-966c4a1f-466d-4d72-abce-bc9cbe9563af tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Took 5.61 seconds to snapshot the instance on the hypervisor.
May 28 14:02:07.182388 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:07.182634 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.183316 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec,network=Network(2e7b5e36-5909-4a0d-b5ab-a29026b3af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3498e0c-df') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.184175 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:07.184329 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.185623 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e9:82,bridge_name='br-int',has_traffic_filtering=True,id=34d0e8d8-44e7-460e-8bad-b2a3110164da,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34d0e8d8-44') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.187420 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:07.187420 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.187420 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:cf:e0,bridge_name='br-int',has_traffic_filtering=True,id=0313acab-d072-4ead-9186-1a6bc350a825,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0313acab-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.187873 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:07.187873 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.188145 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:a7,bridge_name='br-int',has_traffic_filtering=True,id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fa2b3e-b5') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.189130 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:07.189639 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.190060 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:69,bridge_name='br-int',has_traffic_filtering=True,id=0bfe536e-457d-4275-a0ff-78f03834d29e,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfe536e-45') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.194547 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:07.194547 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.194547 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:16,bridge_name='br-int',has_traffic_filtering=True,id=09bc3f96-3fb8-4529-9d98-e63533eb5d45,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bc3f96-3f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.194547 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:07.194547 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.194547 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:0d:4e,bridge_name='br-int',has_traffic_filtering=True,id=f97897ad-8223-4e94-a0d2-30e968ae948f,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf97897ad-82') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.194547 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lazy-loading 'pci_devices' on Instance uuid 986e86a9-d6cb-40b3-9c7b-263684816a96 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:07.596718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.602202 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:02:07.621651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.626521 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.696983 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <uuid>986e86a9-d6cb-40b3-9c7b-263684816a96</uuid>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <name>instance-00000006</name>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:name>tempest-device-tagging-server-1935911609</nova:name>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:01:55</nova:creationTime>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:user uuid="365296e0ff384bad9ae6b97762431f99">tempest-TaggedBootDevicesTest_v242-769083887-project-member</nova:user>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:project uuid="bee69e237aa64213a01d0bf475569055">tempest-TaggedBootDevicesTest_v242-769083887</nova:project>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:port uuid="a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:port uuid="34d0e8d8-44e7-460e-8bad-b2a3110164da">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:port uuid="0313acab-d072-4ead-9186-1a6bc350a825">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.26" ipVersion="4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:port uuid="00fa2b3e-b595-4f5e-b9a7-ed2df9302c80">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:port uuid="0bfe536e-457d-4275-a0ff-78f03834d29e">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:port uuid="09bc3f96-3fb8-4529-9d98-e63533eb5d45">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         <nova:port uuid="f97897ad-8223-4e94-a0d2-30e968ae948f">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <entry name="serial">986e86a9-d6cb-40b3-9c7b-263684816a96</entry>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <entry name="uuid">986e86a9-d6cb-40b3-9c7b-263684816a96</entry>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96/disk.config"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <alias name="ua-e328b1f5-924b-4abc-b089-5b9f05b0fecb"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <serial>e328b1f5-924b-4abc-b089-5b9f05b0fecb</serial>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <alias name="ua-0498706f-7c10-44e6-ac4c-96485dd9e12f"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-3"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <serial>0498706f-7c10-44e6-ac4c-96485dd9e12f</serial>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <alias name="ua-e8e72339-2641-4e2f-b2b8-94b12a1226f1"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-4"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="vdc" bus="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <serial>e8e72339-2641-4e2f-b2b8-94b12a1226f1</serial>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:66:e9:da"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="tapa3498e0c-df"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ee:e9:82"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="tap34d0e8d8-44"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:26:cf:e0"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="tap0313acab-d0"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:9d:d1:a7"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="tap00fa2b3e-b5"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:09:04:69"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="tap0bfe536e-45"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:69:81:16"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="tap09bc3f96-3f"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:e0:0d:4e"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <target dev="tapf97897ad-82"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96/console.log" append="off"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:07.696983 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:07.702027 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Preparing to wait for external event network-vif-plugged-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:07.702027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.702027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.702027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.702027 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Preparing to wait for external event network-vif-plugged-34d0e8d8-44e7-460e-8bad-b2a3110164da {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:07.702027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.702257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.702257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.702325 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Preparing to wait for external event network-vif-plugged-0313acab-d072-4ead-9186-1a6bc350a825 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:07.703173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.703173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.703173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.703173 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Preparing to wait for external event network-vif-plugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:07.703173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.703173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.703173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.703367 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Preparing to wait for external event network-vif-plugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:07.703367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.703426 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.703544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.703661 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Preparing to wait for external event network-vif-plugged-09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:07.703738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.703865 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.704123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.704280 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Preparing to wait for external event network-vif-plugged-f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:07.704378 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.704575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.704647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.705214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:07.705405 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.706371 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec,network=Network(2e7b5e36-5909-4a0d-b5ab-a29026b3af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3498e0c-df') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.706371 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec,network=Network(2e7b5e36-5909-4a0d-b5ab-a29026b3af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3498e0c-df') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:07.707644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.708307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.708307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:07.709021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.709194 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61471fe9-2929-5101-b79b-f3ba4ecdbe81', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.710034 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.710693 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.710985 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.714595 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.720639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.720639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3498e0c-df, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.720639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3498e0c-df, col_values=(('qos', UUID('bf72f010-2751-4314-ab83-37a5a895bfc6')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.720639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3498e0c-df, col_values=(('external_ids', {'iface-id': 'a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:e9:da', 'vm-uuid': '986e86a9-d6cb-40b3-9c7b-263684816a96'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.721667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.725361 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.726616 np0000001643 nova-compute[98269]: INFO os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec,network=Network(2e7b5e36-5909-4a0d-b5ab-a29026b3af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3498e0c-df')
May 28 14:02:07.727292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:07.727535 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.728122 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e9:82,bridge_name='br-int',has_traffic_filtering=True,id=34d0e8d8-44e7-460e-8bad-b2a3110164da,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34d0e8d8-44') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.728328 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e9:82,bridge_name='br-int',has_traffic_filtering=True,id=34d0e8d8-44e7-460e-8bad-b2a3110164da,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34d0e8d8-44') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:07.728684 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.729500 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.729779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:07.733329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.733329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00348467-7add-578f-9163-152a5784e3b5', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.733995 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.735906 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.749217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.752566 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.752566 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34d0e8d8-44, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.752566 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34d0e8d8-44, col_values=(('qos', UUID('dd642c16-c152-4d32-bf29-8edb4d78e743')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.752566 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34d0e8d8-44, col_values=(('external_ids', {'iface-id': '34d0e8d8-44e7-460e-8bad-b2a3110164da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:e9:82', 'vm-uuid': '986e86a9-d6cb-40b3-9c7b-263684816a96'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.755306 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.757662 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.767819 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.768200 np0000001643 nova-compute[98269]: INFO os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e9:82,bridge_name='br-int',has_traffic_filtering=True,id=34d0e8d8-44e7-460e-8bad-b2a3110164da,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34d0e8d8-44')
May 28 14:02:07.769078 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:07.769277 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.769882 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:cf:e0,bridge_name='br-int',has_traffic_filtering=True,id=0313acab-d072-4ead-9186-1a6bc350a825,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0313acab-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.770123 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:cf:e0,bridge_name='br-int',has_traffic_filtering=True,id=0313acab-d072-4ead-9186-1a6bc350a825,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0313acab-d0') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:07.770353 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.770705 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.771024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:07.772028 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.773133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '961b14f1-0111-5aad-9068-e4a5d08bcb7a', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.775652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.775652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.789983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.795412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.795412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0313acab-d0, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.795412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0313acab-d0, col_values=(('qos', UUID('f06fb4e5-1d69-4462-899d-5d7eab87eaea')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.795412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0313acab-d0, col_values=(('external_ids', {'iface-id': '0313acab-d072-4ead-9186-1a6bc350a825', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:cf:e0', 'vm-uuid': '986e86a9-d6cb-40b3-9c7b-263684816a96'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.797355 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.799110 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.803214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.814220 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.816436 np0000001643 nova-compute[98269]: INFO os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:cf:e0,bridge_name='br-int',has_traffic_filtering=True,id=0313acab-d072-4ead-9186-1a6bc350a825,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0313acab-d0')
May 28 14:02:07.817180 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:07.817388 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.821144 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:a7,bridge_name='br-int',has_traffic_filtering=True,id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fa2b3e-b5') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.821144 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:a7,bridge_name='br-int',has_traffic_filtering=True,id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fa2b3e-b5') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:07.823937 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.823937 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.823937 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:07.825530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.825530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5589be9-8cab-5928-a1ee-ae997ca337b3', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.827065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.827065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.829545 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.845957 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.849842 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.849842 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00fa2b3e-b5, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.849842 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00fa2b3e-b5, col_values=(('qos', UUID('1c6a3036-ab9d-4afe-b570-bf2f3846ce53')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.849842 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00fa2b3e-b5, col_values=(('external_ids', {'iface-id': '00fa2b3e-b595-4f5e-b9a7-ed2df9302c80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:d1:a7', 'vm-uuid': '986e86a9-d6cb-40b3-9c7b-263684816a96'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.850245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.851658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.873148 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.877985 np0000001643 nova-compute[98269]: INFO os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:a7,bridge_name='br-int',has_traffic_filtering=True,id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fa2b3e-b5')
May 28 14:02:07.880466 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:07.880466 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.880466 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:69,bridge_name='br-int',has_traffic_filtering=True,id=0bfe536e-457d-4275-a0ff-78f03834d29e,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfe536e-45') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.880466 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:69,bridge_name='br-int',has_traffic_filtering=True,id=0bfe536e-457d-4275-a0ff-78f03834d29e,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfe536e-45') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:07.880466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.880466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.880466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:07.883583 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.884747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d57c3f5-c00a-5d66-b2ea-b2be329a386b', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.884847 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.885952 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.928862 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.934388 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.935478 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bfe536e-45, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.935478 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bfe536e-45, col_values=(('qos', UUID('e0b3d16e-0e7b-43e1-af1d-f25130cfe4c7')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.935478 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bfe536e-45, col_values=(('external_ids', {'iface-id': '0bfe536e-457d-4275-a0ff-78f03834d29e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:04:69', 'vm-uuid': '986e86a9-d6cb-40b3-9c7b-263684816a96'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.940945 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ae76c7ae-539c-4cab-9bd0-ab1bf74843a2 req-79bfa10a-7443-4b25-89d8-596259744ec4 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:07.940945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ae76c7ae-539c-4cab-9bd0-ab1bf74843a2 req-79bfa10a-7443-4b25-89d8-596259744ec4 service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:07.940945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ae76c7ae-539c-4cab-9bd0-ab1bf74843a2 req-79bfa10a-7443-4b25-89d8-596259744ec4 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:07.940945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ae76c7ae-539c-4cab-9bd0-ab1bf74843a2 req-79bfa10a-7443-4b25-89d8-596259744ec4 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:07.940945 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ae76c7ae-539c-4cab-9bd0-ab1bf74843a2 req-79bfa10a-7443-4b25-89d8-596259744ec4 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] No waiting events found dispatching network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:07.940945 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ae76c7ae-539c-4cab-9bd0-ab1bf74843a2 req-79bfa10a-7443-4b25-89d8-596259744ec4 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received unexpected event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 for instance with vm_state active and task_state rescuing.
May 28 14:02:07.941143 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.944742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:07.966693 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.968411 np0000001643 nova-compute[98269]: INFO os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:69,bridge_name='br-int',has_traffic_filtering=True,id=0bfe536e-457d-4275-a0ff-78f03834d29e,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfe536e-45')
May 28 14:02:07.968411 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:07.968411 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:07.968902 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:16,bridge_name='br-int',has_traffic_filtering=True,id=09bc3f96-3fb8-4529-9d98-e63533eb5d45,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bc3f96-3f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:07.969111 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:16,bridge_name='br-int',has_traffic_filtering=True,id=09bc3f96-3fb8-4529-9d98-e63533eb5d45,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bc3f96-3f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:07.969289 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.969496 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.969660 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:07.970329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.970521 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98e88114-c876-5d8e-bc04-95d229ea77ff', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:07.971332 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:07.972081 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:08.002889 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.007182 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.007182 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09bc3f96-3f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.007182 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09bc3f96-3f, col_values=(('qos', UUID('061b65f7-4073-4752-9868-42172c1dbe36')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.007182 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09bc3f96-3f, col_values=(('external_ids', {'iface-id': '09bc3f96-3fb8-4529-9d98-e63533eb5d45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:81:16', 'vm-uuid': '986e86a9-d6cb-40b3-9c7b-263684816a96'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.007862 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.009740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:08.044420 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.047512 np0000001643 nova-compute[98269]: INFO os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:16,bridge_name='br-int',has_traffic_filtering=True,id=09bc3f96-3fb8-4529-9d98-e63533eb5d45,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bc3f96-3f')
May 28 14:02:08.047512 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:08.047512 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:08.047893 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:0d:4e,bridge_name='br-int',has_traffic_filtering=True,id=f97897ad-8223-4e94-a0d2-30e968ae948f,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf97897ad-82') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:08.048087 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:0d:4e,bridge_name='br-int',has_traffic_filtering=True,id=f97897ad-8223-4e94-a0d2-30e968ae948f,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf97897ad-82') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:08.048754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.048938 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.049141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:08.051901 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.051901 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2613070e-6fc4-547b-bcc7-eb6b834c7988', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.052927 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.053699 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:08.098768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.101855 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.102133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf97897ad-82, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.102560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf97897ad-82, col_values=(('qos', UUID('dbd93758-4214-4cce-aa9e-043fd19f195f')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.102772 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf97897ad-82, col_values=(('external_ids', {'iface-id': 'f97897ad-8223-4e94-a0d2-30e968ae948f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:0d:4e', 'vm-uuid': '986e86a9-d6cb-40b3-9c7b-263684816a96'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:08.106712 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:08.152697 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:08.154264 np0000001643 nova-compute[98269]: INFO os_vif [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:0d:4e,bridge_name='br-int',has_traffic_filtering=True,id=f97897ad-8223-4e94-a0d2-30e968ae948f,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf97897ad-82')
May 28 14:02:08.192852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:08.193649 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:08.198891 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:02:08.198891 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Claim successful on node np0000001643
May 28 14:02:08.667515 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 65c247b5-acbc-474a-bb88-a2edf9ac2d0b due to new event <LifecycleEvent: 1779976928.667035, 65c247b5-acbc-474a-bb88-a2edf9ac2d0b => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:02:08.667754 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976928.667035, 65c247b5-acbc-474a-bb88-a2edf9ac2d0b => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:08.667943 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] VM Resumed (Lifecycle Event)
May 28 14:02:08.673371 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d79933dd-57f3-4f03-9f47-a629e7a29df1 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:09.105295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:09.105817 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:09.108700 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:09.172581 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:09.173803 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:09.608554 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:02:09.676587 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976929.676135, 65c247b5-acbc-474a-bb88-a2edf9ac2d0b => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:09.676822 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] VM Started (Lifecycle Event)
May 28 14:02:09.694750 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:09.696256 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:09.697398 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] No VIF found with MAC fa:16:3e:66:e9:da, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:09.698203 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] No VIF found with MAC fa:16:3e:09:04:69, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:09.699525 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Using config drive
May 28 14:02:09.864857 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:09.866083 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:10.029641 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-05d25898-9c93-4ca1-87bd-010e3fb4a57e req-362502bb-b39c-4d72-86c5-53fd07da0a77 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:10.029641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-05d25898-9c93-4ca1-87bd-010e3fb4a57e req-362502bb-b39c-4d72-86c5-53fd07da0a77 service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:10.029641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-05d25898-9c93-4ca1-87bd-010e3fb4a57e req-362502bb-b39c-4d72-86c5-53fd07da0a77 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:10.029641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-05d25898-9c93-4ca1-87bd-010e3fb4a57e req-362502bb-b39c-4d72-86c5-53fd07da0a77 service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:10.029641 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-05d25898-9c93-4ca1-87bd-010e3fb4a57e req-362502bb-b39c-4d72-86c5-53fd07da0a77 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] No waiting events found dispatching network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:10.029641 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-05d25898-9c93-4ca1-87bd-010e3fb4a57e req-362502bb-b39c-4d72-86c5-53fd07da0a77 service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received unexpected event network-vif-plugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 for instance with vm_state rescued and task_state None.
May 28 14:02:10.180282 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:10.187087 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:10.213205 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:10.301920 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:10.369779 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:10.422108 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Creating config drive at /opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96/disk.config
May 28 14:02:10.428554 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuhmm6h2r {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:10.471358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuhmm6h2r" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:10.878389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.685s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:10.880223 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.577s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:10.880223 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:02:10.886021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:02:10.886146 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Claim successful on node np0000001643
May 28 14:02:10.967070 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.036028 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.100036 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.231648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.239327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.263749 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.284766 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.294106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:11.294106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:11.310191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:11.310191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:11.387638 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:02:11.387868 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:02:11.388343 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:11.388914 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:11.440425 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.499490 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.509474 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.545491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.567113 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.598398 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90f6ff80402b47b399ba052cccf0f141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161254855aa54c71a7ac0a8a7076750c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:02:11.629089 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.671314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.675952 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.771614 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.803062 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid aaeff833-80ef-4909-96de-5958543e37ba {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:11.813485 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lazy-loading 'flavor' on Instance uuid 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:11.850717 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.860375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.897705 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:02:11.931936 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e38362c7-946c-4fbc-b4a2-b9ab89dd277d req-9459cb96-4800-4521-9a21-7e36f10c48dc service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-34d0e8d8-44e7-460e-8bad-b2a3110164da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:11.932110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e38362c7-946c-4fbc-b4a2-b9ab89dd277d req-9459cb96-4800-4521-9a21-7e36f10c48dc service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:11.932319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e38362c7-946c-4fbc-b4a2-b9ab89dd277d req-9459cb96-4800-4521-9a21-7e36f10c48dc service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:11.932499 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e38362c7-946c-4fbc-b4a2-b9ab89dd277d req-9459cb96-4800-4521-9a21-7e36f10c48dc service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:11.932769 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e38362c7-946c-4fbc-b4a2-b9ab89dd277d req-9459cb96-4800-4521-9a21-7e36f10c48dc service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Processing event network-vif-plugged-34d0e8d8-44e7-460e-8bad-b2a3110164da {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:11.957569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:11.989757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.000097 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Rescuing
May 28 14:02:12.000097 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:12.000097 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:12.000321 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:12.111558 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.179624 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.186584 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.210651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.403604 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:02:12.503188 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:12.569355 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.674681 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-186ce6b7-c4a6-4b6d-b487-a34c2127d48d req-ce4eed02-62fd-4302-a531-df463b441af4 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:12.674924 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-186ce6b7-c4a6-4b6d-b487-a34c2127d48d req-ce4eed02-62fd-4302-a531-df463b441af4 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:12.675131 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-186ce6b7-c4a6-4b6d-b487-a34c2127d48d req-ce4eed02-62fd-4302-a531-df463b441af4 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:12.675335 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-186ce6b7-c4a6-4b6d-b487-a34c2127d48d req-ce4eed02-62fd-4302-a531-df463b441af4 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:12.676127 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-186ce6b7-c4a6-4b6d-b487-a34c2127d48d req-ce4eed02-62fd-4302-a531-df463b441af4 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Processing event network-vif-plugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:12.749757 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:12.749757 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:12.798334 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.802559 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:12.816043 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.523s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:12.822158 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:12.875850 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:12.876300 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:12.876510 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:12.876680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:12.876844 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Processing event network-vif-plugged-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:12.877004 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:12.877212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:12.877346 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:12.877504 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:12.877970 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No event matching network-vif-plugged-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec in dict_keys([('network-vif-plugged', '0313acab-d072-4ead-9186-1a6bc350a825'), ('network-vif-plugged', '0bfe536e-457d-4275-a0ff-78f03834d29e'), ('network-vif-plugged', '09bc3f96-3fb8-4529-9d98-e63533eb5d45'), ('network-vif-plugged', 'f97897ad-8223-4e94-a0d2-30e968ae948f')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:02:12.878139 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-beb3d4d0-83b6-45f7-aed9-4aee40c724a4 req-2d45fdad-c0e1-4495-a780-17c9a9d58164 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received unexpected event network-vif-plugged-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec for instance with vm_state building and task_state spawning.
May 28 14:02:13.009051 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:13.016189 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:13.017998 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:13.057273 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Successfully created port: c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:02:13.104256 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:13.230621 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Updating instance_info_cache with network_info: [{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:13.253369 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:13.266537 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976933.26598, 986e86a9-d6cb-40b3-9c7b-263684816a96 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:13.266537 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] VM Started (Lifecycle Event)
May 28 14:02:13.415878 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:02:13.416757 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:02:13.416897 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Creating image(s)
May 28 14:02:13.417324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:13.420219 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:13.422491 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:13.425972 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:13.433578 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:13.437062 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:13.458002 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:13.474579 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:13.481876 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:13.551188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:13.551827 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:13.552830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:13.554024 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:13.557738 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:13.558461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:13.666696 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:13.667055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:13.716424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk 1073741824" returned: 0 in 0.049s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:13.716931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:13.717299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:13.736703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:13.765472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "interface-0c96a33a-84dd-4c95-82b3-94a6251e5404-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:13.765472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "interface-0c96a33a-84dd-4c95-82b3-94a6251e5404-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:13.765472 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'flavor' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:13.768188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.889s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:13.768636 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:02:13.775987 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:13.778569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:13.783652 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976933.7819068, 986e86a9-d6cb-40b3-9c7b-263684816a96 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:13.783652 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] VM Paused (Lifecycle Event)
May 28 14:02:13.803945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:13.804226 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:02:13.804569 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:13.831761 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Successfully updated port: c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:02:13.885530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:13.885950 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Cannot resize image /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:02:13.886346 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:02:13.886608 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Ensure instance console log exists: /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:02:13.887129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:13.887600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:13.887600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.114519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:14.283760 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:14.286264 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:02:14.288197 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:14.289058 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:02:14.289327 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:14.289651 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:14.298079 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:14.335659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:14.335659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquired lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:14.335659 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:14.423137 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86dc22a5d6a7478dab81969f17d3daab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74df57519ea42009fcebcff7cfdf94e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:02:14.471328 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'pci_requests' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:14.493470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.493470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.493470 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Attaching volume 8c2914e1-0030-4fd9-93ee-d6763a467c6f to /dev/vdb
May 28 14:02:14.539403 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-34d0e8d8-44e7-460e-8bad-b2a3110164da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.540090 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.540257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.540379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.540580 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No event matching network-vif-plugged-34d0e8d8-44e7-460e-8bad-b2a3110164da in dict_keys([('network-vif-plugged', '0313acab-d072-4ead-9186-1a6bc350a825'), ('network-vif-plugged', '0bfe536e-457d-4275-a0ff-78f03834d29e'), ('network-vif-plugged', '09bc3f96-3fb8-4529-9d98-e63533eb5d45'), ('network-vif-plugged', 'f97897ad-8223-4e94-a0d2-30e968ae948f')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:02:14.540784 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received unexpected event network-vif-plugged-34d0e8d8-44e7-460e-8bad-b2a3110164da for instance with vm_state building and task_state spawning.
May 28 14:02:14.540885 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-0313acab-d072-4ead-9186-1a6bc350a825 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.541216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.541216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Processing event network-vif-plugged-0313acab-d072-4ead-9186-1a6bc350a825 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-0313acab-d072-4ead-9186-1a6bc350a825 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No event matching network-vif-plugged-0313acab-d072-4ead-9186-1a6bc350a825 in dict_keys([('network-vif-plugged', '0bfe536e-457d-4275-a0ff-78f03834d29e'), ('network-vif-plugged', '09bc3f96-3fb8-4529-9d98-e63533eb5d45'), ('network-vif-plugged', 'f97897ad-8223-4e94-a0d2-30e968ae948f')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received unexpected event network-vif-plugged-0313acab-d072-4ead-9186-1a6bc350a825 for instance with vm_state building and task_state spawning.
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.543523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.544331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.544331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.544331 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Processing event network-vif-plugged-f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:14.544331 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.544331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.544331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.544721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.544721 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No event matching network-vif-plugged-f97897ad-8223-4e94-a0d2-30e968ae948f in dict_keys([('network-vif-plugged', '0bfe536e-457d-4275-a0ff-78f03834d29e'), ('network-vif-plugged', '09bc3f96-3fb8-4529-9d98-e63533eb5d45')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:02:14.544848 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-38784ce1-22d2-4a06-8280-1d32ee3d93fe req-dfccd4d9-ecef-40bb-b90f-07de1c56943c service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received unexpected event network-vif-plugged-f97897ad-8223-4e94-a0d2-30e968ae948f for instance with vm_state building and task_state spawning.
May 28 14:02:14.552534 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:14.569860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:02:14.595120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:14.625225 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:02:14.625958 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:02:14.629398 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.629688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.630022 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Attaching volume ef535692-e07a-439d-b3cf-b7b4f211673e to /dev/vdb
May 28 14:02:14.636294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:02:14.641298 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feae:16a4', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::fc16:3eff:feeb:f82e', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:fe66:e9da', 'fe80::fc16:3eff:feee:e982', 'fe80::54c2:95ff:fe36:5e1', 'fe80::fc16:3eff:fe26:cfe0', 'fe80::fc16:3eff:fe9d:d1a7', 'fe80::fc16:3eff:fe09:469', 'fe80::fc16:3eff:fe69:8116', 'fe80::84c8:d5ff:fe78:370', 'fe80::fc16:3eff:fee0:d4e', 'fe80::809f:94ff:fe0f:c60'] 
May 28 14:02:14.641786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:02:14.642616 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:02:14.642935 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:14.643427 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Updating existing volume attachment record: 464f6e54-dacc-4939-8942-c01eceaf18c1 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:02:14.703884 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:14.716701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:02:14.740643 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:14.773760 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.773760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.773760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.773760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.773760 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No event matching network-vif-plugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 in dict_keys([('network-vif-plugged', '0bfe536e-457d-4275-a0ff-78f03834d29e'), ('network-vif-plugged', '09bc3f96-3fb8-4529-9d98-e63533eb5d45')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:02:14.773760 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received unexpected event network-vif-plugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 for instance with vm_state building and task_state spawning.
May 28 14:02:14.773760 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.774025 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.774228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.774727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.774905 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Processing event network-vif-plugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:14.775156 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.775709 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.775994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:02:14.776171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.776397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.776564 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No event matching network-vif-plugged-0bfe536e-457d-4275-a0ff-78f03834d29e in dict_keys([('network-vif-plugged', '09bc3f96-3fb8-4529-9d98-e63533eb5d45')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:02:14.778637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:02:14.779323 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-96afec19-dd62-4894-b921-7fc2d97c8cba req-942c8298-5fd6-4a8f-a77a-0e7cb68d0550 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received unexpected event network-vif-plugged-0bfe536e-457d-4275-a0ff-78f03834d29e for instance with vm_state building and task_state spawning.
May 28 14:02:14.788530 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:02:14.793068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:02:14.794561 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feae:16a4', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::fc16:3eff:feeb:f82e', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:fe66:e9da', 'fe80::fc16:3eff:feee:e982', 'fe80::54c2:95ff:fe36:5e1', 'fe80::fc16:3eff:fe26:cfe0', 'fe80::fc16:3eff:fe9d:d1a7', 'fe80::fc16:3eff:fe09:469', 'fe80::fc16:3eff:fe69:8116', 'fe80::84c8:d5ff:fe78:370', 'fe80::fc16:3eff:fee0:d4e', 'fe80::809f:94ff:fe0f:c60'] 
May 28 14:02:14.794780 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:02:14.794780 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:02:14.794967 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:14.795118 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Updating existing volume attachment record: 876d08ec-77da-4356-8d70-45d186584481 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:02:14.800351 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:02:14.959906 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:02:14.972141 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Successfully created port: a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:02:14.974462 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Object Instance<0c96a33a-84dd-4c95-82b3-94a6251e5404> lazy-loaded attributes: flavor,pci_requests {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:14.976384 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:02:14.976384 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:14.976384 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:14.990000 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.990433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.990697 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.990896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.991086 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Processing event network-vif-plugged-09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:14.991380 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-plugged-09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.991842 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:02:14.993173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:14.993883 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:14.993883 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:14.995779 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No waiting events found dispatching network-vif-plugged-09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:14.995779 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received unexpected event network-vif-plugged-09bc3f96-3fb8-4529-9d98-e63533eb5d45 for instance with vm_state building and task_state spawning.
May 28 14:02:14.995779 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-changed-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:14.995779 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Refreshing instance network info cache due to event network-changed-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:14.995779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Acquiring lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:14.998488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:02:14.999462 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976934.998879, 986e86a9-d6cb-40b3-9c7b-263684816a96 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:14.999563 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] VM Resumed (Lifecycle Event)
May 28 14:02:15.009473 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance spawned successfully.
May 28 14:02:15.009473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:02:15.088996 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7f2227d939749fba2d87d475eced3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c4eed05b4d6787812ac3fb0c7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:02:15.159782 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:15.298925 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:02:15.315141 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:15.362724 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:15.363087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef535692-e07a-439d-b3cf-b7b4f211673e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:15.363486 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:15.364036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:15.364373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef535692-e07a-439d-b3cf-b7b4f211673e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:15.376530 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:15.376775 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:15.376880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:15.377920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:15.379139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:15.379252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:15.379429 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:15.379734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:15.379991 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:15.392587 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:15.392587 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:15.397941 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:15.397941 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e] added
May 28 14:02:15.407736 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:15.407736 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:15.407736 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:15.416071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e] added
May 28 14:02:15.416071 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:15.416071 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:15.416071 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:15.416071 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:15.416071 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:15.416071 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:15.416409 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:15.416677 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:15.416874 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:15.426339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:15.432438 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:15.453820 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:15.503978 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:15.525987 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:15.550012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:15.550012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:15.550012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:15.550012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:15.550776 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:15.551888 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:15.583525 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005213399999774992 future=<Future at 0x71a75c709520 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:15.583783 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:15.677020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:15.683765 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:15.693062 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Successfully updated port: a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:02:15.706438 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:15.718398 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:15.725954 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Successfully created port: 0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:02:15.733270 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance destroyed successfully.
May 28 14:02:15.735810 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'numa_topology' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:15.804072 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Booting with blank volume at /dev/vda
May 28 14:02:15.818678 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Releasing lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:15.818678 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance network_info: |[{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:02:15.818678 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Acquired lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:15.818678 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Refreshing network info cache for port c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:15.820291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Start _get_guest_xml network_info=[{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:02:15.822515 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:15.823806 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-981658321', uuid='16cfe8d8-1812-46a2-b92a-bd34d2cb7289'), owner=OwnerMeta(userid='90f6ff80402b47b399ba052cccf0f141', username='tempest-ServerActionsTestOtherB-89556640-project-member', projectid='161254855aa54c71a7ac0a8a7076750c', projectname='tempest-ServerActionsTestOtherB-89556640'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976935.823292) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:15.824585 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:02:15.824946 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:02:15.826218 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:02:15.826218 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:02:15.827104 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:02:15.827436 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:02:15.827733 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:02:15.827733 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:02:15.827818 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:02:15.827862 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:02:15.827972 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:02:15.828119 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:02:15.831470 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:02:15.831470 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:02:15.831470 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:02:15.831470 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:02:15.843878 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:15.844135 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:15.844700 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:15.845724 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lazy-loading 'pci_devices' on Instance uuid 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:16.031885 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:02:16.032060 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999788409000075 future=<Future at 0x71a7802d2780 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:16.032468 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999406904000125 future=<Future at 0x71a7802d2780 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:16.032645 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999197907000053 future=<Future at 0x71a7802d2780 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:16.070789 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Took 28.92 seconds to spawn the instance on the hypervisor.
May 28 14:02:16.070985 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:16.201584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:16.201584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:16.201584 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:16.244050 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Attempting rescue
May 28 14:02:16.245005 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 14:02:16.252182 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:02:16.252495 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Creating image(s)
May 28 14:02:16.253024 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:16.253399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:16.253826 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:16.254021 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:16.321735 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:16.352515 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <uuid>16cfe8d8-1812-46a2-b92a-bd34d2cb7289</uuid>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <name>instance-0000000a</name>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsTestOtherB-server-981658321</nova:name>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:02:15</nova:creationTime>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:user uuid="90f6ff80402b47b399ba052cccf0f141">tempest-ServerActionsTestOtherB-89556640-project-member</nova:user>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:project uuid="161254855aa54c71a7ac0a8a7076750c">tempest-ServerActionsTestOtherB-89556640</nova:project>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         <nova:port uuid="c438645f-c3e6-4778-91e5-ca2e1d7bbdd0">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <entry name="serial">16cfe8d8-1812-46a2-b92a-bd34d2cb7289</entry>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <entry name="uuid">16cfe8d8-1812-46a2-b92a-bd34d2cb7289</entry>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ab:39:d2"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <target dev="tapc438645f-c3"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/console.log" append="off"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:16.352515 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:16.352515 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Preparing to wait for external event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:16.352515 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:16.352515 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:16.352515 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:16.354534 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:16.354534 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:16.354534 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:16.354534 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:16.357367 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:16.357367 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:16.357367 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:16.358299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:16.358643 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bb2f8b6-1dbd-521e-96cd-d1ab1fd08eb7', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:16.359813 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:16.360649 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:16.373744 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:16.378078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:16.378404 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc438645f-c3, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:16.378807 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc438645f-c3, col_values=(('qos', UUID('cec5e9ec-4651-4572-8f4f-a8b67fdb461a')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:16.378998 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc438645f-c3, col_values=(('external_ids', {'iface-id': 'c438645f-c3e6-4778-91e5-ca2e1d7bbdd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:39:d2', 'vm-uuid': '16cfe8d8-1812-46a2-b92a-bd34d2cb7289'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:16.380337 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:16.382088 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:16.396653 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:16.399324 np0000001643 nova-compute[98269]: INFO os_vif [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3')
May 28 14:02:16.406046 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:16.418611 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:16.432524 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:16.432524 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:16.440785 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:16.440785 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.456984 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.463294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.478671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.478671 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.478671 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.478671 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.478671 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.478671 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.478671 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:16.479303 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.479303 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.479303 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.479303 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.479303 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.479303 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.479303 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:16.486237 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Successfully updated port: 0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:02:16.495277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.495277 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.495277 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.495277 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.495277 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.495277 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.495277 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:16.495607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.495607 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.495607 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.495607 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.495607 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.495607 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.495607 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:16.521299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.50.100,3260]
May 28 14:02:16.521299 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.50.100,3260] successful.
May 28 14:02:16.521299 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.535188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.549000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.40.100,3260]
May 28 14:02:16.549000 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.40.100,3260] successful.
May 28 14:02:16.549000 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.554983 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.555390 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:16.555584 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:16.555640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:16.559310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] HCTL ('13', '-', '-', 0) found on session 11 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:16.559525 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:16.572487 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:16.594398 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Took 41.27 seconds to build instance.
May 28 14:02:16.595829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching for a device in session 11 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:16.596180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ef535692-e07a-439d-b3cf-b7b4f211673e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.605481 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:16.605863 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:16.606004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:16.606263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:16.607209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:16.608907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:16.633251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:16.633507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef535692-e07a-439d-b3cf-b7b4f211673e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:16.636596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:16.636596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:16.665100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-changed-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:16.666355 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Refreshing instance network info cache due to event network-changed-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:16.666355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] Acquiring lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:16.759610 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:16.761657 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:16.765757 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:16.766989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:16.768167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:16.768614 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:16.773685 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:16.773685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:16.804876 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:02:16.839758 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:16.860588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:16.863510 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.rescue {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:16.896530 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:16.897385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:16.897929 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:16.898628 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:16.898834 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:16.899033 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state active and task_state rescuing.
May 28 14:02:16.899189 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:16.899616 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:16.899803 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:16.899954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:16.900112 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:16.900276 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e7f6f8b2-d161-47b1-97d8-42d14dbdd960 req-68e76f86-85f7-450d-b2fb-4e70d31d978a service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state active and task_state rescuing.
May 28 14:02:16.913402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.rescue" returned: 0 in 0.048s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:16.913402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:16.913402 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'migration_context' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:16.992079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:16.992257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquired lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:16.992471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:17.019986 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:17.031547 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updated VIF entry in instance network info cache for port c438645f-c3e6-4778-91e5-ca2e1d7bbdd0. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:02:17.032016 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:17.101162 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-45e7f350-9bcf-45e9-a05c-a63d8c12a85e tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.794s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:17.140563 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lazy-loading 'flavor' on Instance uuid af52b758-781b-4980-9e1d-5cb5924eee22 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:17.157659 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Updating instance_info_cache with network_info: [{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:17.218338 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-changed-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:17.218551 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Refreshing instance network info cache due to event network-changed-0391cf13-9163-4dad-951b-e7158fd8630a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:17.218701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] Acquiring lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:17.380843 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:02:17.415071 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:17.415461 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:02:17.416042 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Start _get_guest_xml network_info=[{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:eb:f8:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ad923155-4eca-4cf1-b871-662172c18500', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:02:17.416212 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'resources' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:17.534392 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a6547813-dde3-45cc-aa2c-119ae0cdb6bf req-aa9fda13-31fb-4dd8-a7d7-7a9087dd5755 service nova] Releasing lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:17.663283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:17.664018 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance network_info: |[{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:02:17.664512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] Acquired lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:17.664687 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Refreshing network info cache for port a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:17.789313 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:17.920069 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:17.925416 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:17.925633 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:17.925854 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No VIF found with MAC fa:16:3e:ab:39:d2, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:17.926523 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Using config drive
May 28 14:02:17.934636 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:17.934636 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2020791412', uuid='fb9d4d3f-f068-49a2-ba11-114989ee8d9e'), owner=OwnerMeta(userid='3deb2050ffd5441bb38c08eb82707d7d', username='tempest-ServerRescueNegativeTestJSON-1154493123-project-member', projectid='9bfe2941b78c4f2e9f16f60e05ec5dcc', projectname='tempest-ServerRescueNegativeTestJSON-1154493123'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:eb:f8:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976937.9338992) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:17.936142 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:02:17.936142 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:02:17.938459 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:02:17.938694 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:02:17.939738 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:02:17.940101 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:02:17.940337 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:02:17.943467 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:18.125172 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:18.151954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:18.168364 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:18.300587 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:18.402661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found WWN 33000000049a23265 for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:18.403003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:18.403223 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000049a23265', 'path': '/dev/dm-5', 'multipath_id': '33000000049a23265'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:18.403414 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000049a23265', 'path': '/dev/dm-5', 'multipath_id': '33000000049a23265'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:18.404167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.027s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:18.404474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:18.413081 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid aaeff833-80ef-4909-96de-5958543e37ba {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:18.419278 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:18.419939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:18.420530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:18.420706 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:18.421929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:18.421929 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:18.435714 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:18.438386 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:18.438386 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:18.447028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:18.447028 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:18.450482 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:18.461235 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f] added
May 28 14:02:18.461235 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:18.461235 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:18.461235 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:18.461235 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:18.461235 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:18.461235 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:18.461761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:18.461761 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:18.461920 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:18.462779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f] added
May 28 14:02:18.462779 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:18.462779 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:18.462779 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:18.462779 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:18.462779 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:18.462779 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:18.463176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:18.463176 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:18.463355 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:18.466455 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020791412',display_name='tempest-ServerRescueNegativeTestJSON-server-2020791412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020791412',id=8,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:52Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-7ieaqe8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:01:53Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=fb9d4d3f-f068-49a2-ba11-114989ee8d9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:eb:f8:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:18.467098 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:eb:f8:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:18.467883 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:18.468417 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'pci_devices' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:18.586404 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:18.616953 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Creating config drive at /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config
May 28 14:02:18.622554 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoz9r1qdh {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:18.669980 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoz9r1qdh" returned: 0 in 0.047s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:18.803181 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Releasing lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:18.804895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] Acquired lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:18.804895 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Refreshing network info cache for port 0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:18.806208 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:31Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:18.810838 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converting VIF {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:18.810838 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:18.810838 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:18.810838 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.810838 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:18.810838 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:18.813346 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.815979 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Updated VIF entry in instance network info cache for port a3c1b47a-6f08-4472-b43d-f02aad3c3ab4. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:02:18.816281 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Updating instance_info_cache with network_info: [{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:18.817499 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1938e31-63b9-5ede-a5c1-f0fcde746904', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:18.818230 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.819368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:18.828394 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.833394 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.833860 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0391cf13-91, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:18.834404 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0391cf13-91, col_values=(('qos', UUID('ab44cae9-8114-4bbe-b021-765a70702b7a')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:18.835108 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0391cf13-91, col_values=(('external_ids', {'iface-id': '0391cf13-9163-4dad-951b-e7158fd8630a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:29:7d', 'vm-uuid': '0c96a33a-84dd-4c95-82b3-94a6251e5404'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:18.835354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.838094 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:18.850303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.851402 np0000001643 nova-compute[98269]: INFO os_vif [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91')
May 28 14:02:18.852288 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:31Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:18.852541 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converting VIF {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:18.853125 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:18.854972 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] attach device xml: <interface type="ethernet">
May 28 14:02:18.854972 np0000001643 nova-compute[98269]:   <mac address="fa:16:3e:36:29:7d"/>
May 28 14:02:18.854972 np0000001643 nova-compute[98269]:   <model type="virtio"/>
May 28 14:02:18.854972 np0000001643 nova-compute[98269]:   <driver name="qemu"/>
May 28 14:02:18.854972 np0000001643 nova-compute[98269]:   <mtu size="1372"/>
May 28 14:02:18.854972 np0000001643 nova-compute[98269]:   <target dev="tap0391cf13-91"/>
May 28 14:02:18.854972 np0000001643 nova-compute[98269]: </interface>
May 28 14:02:18.854972 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:02:18.878976 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.918840 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Attempting to attach volume ef535692-e07a-439d-b3cf-b7b4f211673e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:02:18.932125 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:02:18.932125 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:18.932125 np0000001643 nova-compute[98269]:   <alias name="ua-ef535692-e07a-439d-b3cf-b7b4f211673e"/>
May 28 14:02:18.932125 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:02:18.932125 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:02:18.932125 np0000001643 nova-compute[98269]:   <serial>ef535692-e07a-439d-b3cf-b7b4f211673e</serial>
May 28 14:02:18.932125 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:18.932125 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:02:18.965135 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:18.967124 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-changed-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:18.969012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing instance network info cache due to event network-changed-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:18.969012 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] Acquiring lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:18.969012 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] Acquired lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:18.970718 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Refreshing network info cache for port a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:18.971823 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:18.975800 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <uuid>fb9d4d3f-f068-49a2-ba11-114989ee8d9e</uuid>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <name>instance-00000008</name>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020791412</nova:name>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:02:17</nova:creationTime>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:user uuid="3deb2050ffd5441bb38c08eb82707d7d">tempest-ServerRescueNegativeTestJSON-1154493123-project-member</nova:user>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:project uuid="9bfe2941b78c4f2e9f16f60e05ec5dcc">tempest-ServerRescueNegativeTestJSON-1154493123</nova:project>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         <nova:port uuid="e57ade8b-a180-4fd2-9951-a99aec03b52c">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <entry name="serial">fb9d4d3f-f068-49a2-ba11-114989ee8d9e</entry>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <entry name="uuid">fb9d4d3f-f068-49a2-ba11-114989ee8d9e</entry>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.rescue"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config.rescue"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:eb:f8:2e"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <target dev="tape57ade8b-a1"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/console.log" append="off"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:18.975800 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:18.984092 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance destroyed successfully.
May 28 14:02:19.032199 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.114244 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.161971 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1e6f935b-84f3-48b4-b228-56c64daf1bb8 req-6dbf9449-7fd8-4914-ab13-86b9a54ca146 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-plugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:19.162716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1e6f935b-84f3-48b4-b228-56c64daf1bb8 req-6dbf9449-7fd8-4914-ab13-86b9a54ca146 service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:19.162918 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1e6f935b-84f3-48b4-b228-56c64daf1bb8 req-6dbf9449-7fd8-4914-ab13-86b9a54ca146 service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:19.163082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1e6f935b-84f3-48b4-b228-56c64daf1bb8 req-6dbf9449-7fd8-4914-ab13-86b9a54ca146 service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:19.163217 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1e6f935b-84f3-48b4-b228-56c64daf1bb8 req-6dbf9449-7fd8-4914-ab13-86b9a54ca146 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No waiting events found dispatching network-vif-plugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:19.163390 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1e6f935b-84f3-48b4-b228-56c64daf1bb8 req-6dbf9449-7fd8-4914-ab13-86b9a54ca146 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received unexpected event network-vif-plugged-0391cf13-9163-4dad-951b-e7158fd8630a for instance with vm_state active and task_state None.
May 28 14:02:19.255956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.266479 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:19.266829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:19.267229 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Attaching volume 362fc806-7385-432f-8262-e0e7c2a0993a to /dev/sdc
May 28 14:02:19.270198 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.290746 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.313126 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.318876 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:19.322235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-03d935a5-6ebd-46b7-9fb9-84638bcf25a2 req-c3eada9a-2b3b-4b47-b0f1-d6e4b553e4bf service nova] Releasing lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:19.331694 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.346480 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:19.358750 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:02:19.386900 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:19.419387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:02:19.419782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:02:19.435009 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:02:19.437989 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feae:16a4', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:fe66:e9da', 'fe80::fc16:3eff:feee:e982', 'fe80::54c2:95ff:fe36:5e1', 'fe80::fc16:3eff:fe26:cfe0', 'fe80::fc16:3eff:fe9d:d1a7', 'fe80::fc16:3eff:fe09:469', 'fe80::fc16:3eff:fe69:8116', 'fe80::84c8:d5ff:fe78:370', 'fe80::fc16:3eff:fee0:d4e', 'fe80::809f:94ff:fe0f:c60', 'fe80::fc16:3eff:fe36:297d', 'fe80::9085:f8ff:fec2:20c9'] 
May 28 14:02:19.438212 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:02:19.438991 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:02:19.440174 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:19.441125 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Updating existing volume attachment record: e3e1961f-6692-48b3-8594-1998709ec8ac {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:02:19.462529 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:19.463997 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:19.475723 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:19.475723 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:19.482788 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:19.486164 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:19.490856 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:19.490856 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:19.507434 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:19.510697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:19.535519 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:19.542736 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.552526 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:19.554296 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:19.575180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:02:19.618122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:19.674422 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:02:19.676041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:02:19.694384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:02:19.698012 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feae:16a4', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:fe66:e9da', 'fe80::fc16:3eff:feee:e982', 'fe80::54c2:95ff:fe36:5e1', 'fe80::fc16:3eff:fe26:cfe0', 'fe80::fc16:3eff:fe9d:d1a7', 'fe80::fc16:3eff:fe09:469', 'fe80::fc16:3eff:fe69:8116', 'fe80::84c8:d5ff:fe78:370', 'fe80::fc16:3eff:fee0:d4e', 'fe80::809f:94ff:fe0f:c60', 'fe80::fc16:3eff:fe36:297d', 'fe80::9085:f8ff:fec2:20c9', 'fe80::fc16:3eff:feab:39d2'] 
May 28 14:02:19.698640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:02:19.698640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:02:19.699154 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:19.700466 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Updating existing volume attachment record: 45f6e68c-8788-4c3f-b3ee-ac3203ef5414 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:02:19.752219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:19.967526 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-68da7d1a-88e8-49ec-88d2-de9ac5b956c5 req-77fab8a1-8f11-486b-aa1f-16a420743d38 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:19.968170 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68da7d1a-88e8-49ec-88d2-de9ac5b956c5 req-77fab8a1-8f11-486b-aa1f-16a420743d38 service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:19.971529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68da7d1a-88e8-49ec-88d2-de9ac5b956c5 req-77fab8a1-8f11-486b-aa1f-16a420743d38 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:19.971529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68da7d1a-88e8-49ec-88d2-de9ac5b956c5 req-77fab8a1-8f11-486b-aa1f-16a420743d38 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:19.971529 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-68da7d1a-88e8-49ec-88d2-de9ac5b956c5 req-77fab8a1-8f11-486b-aa1f-16a420743d38 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Processing event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:20.036024 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:20.050977 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:20.051801 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '362fc806-7385-432f-8262-e0e7c2a0993a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:20.052009 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:20.074269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:20.091501 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:20.102542 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:20.129565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:20.139959 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:20.208329 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:20.321126 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updated VIF entry in instance network info cache for port 0391cf13-9163-4dad-951b-e7158fd8630a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:02:20.324618 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:20.407468 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updated VIF entry in instance network info cache for port a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:02:20.407764 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [{"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:20.521610 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:20.522052 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:20.522392 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:20.522582 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No VIF found with MAC fa:16:3e:eb:f8:2e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:20.523856 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Using config drive
May 28 14:02:20.564799 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:20.565080 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:20.565193 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No VIF found with MAC fa:16:3e:46:1d:78, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:20.628261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.50.100,3260]
May 28 14:02:20.628261 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.50.100,3260] successful.
May 28 14:02:20.628261 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:20.629972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.40.100,3260]
May 28 14:02:20.629972 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.40.100,3260] successful.
May 28 14:02:20.629972 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:20.649478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:20.656993 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.676677 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.254s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:20.676677 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:20.678375 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:20.678694 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:20.691703 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.269s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:20.691703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Scanning host 16 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:20.708359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:20.708667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:20.727113 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:20.727336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:20.819058 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976940.8186452, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:20.819543 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:02:20.819690 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Started (Lifecycle Event)
May 28 14:02:20.822987 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:02:20.824791 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance spawned successfully.
May 28 14:02:20.825174 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:02:20.830576 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f1003063-b1be-4d79-97d3-65f0a57fbd60 req-b20bced5-6cd5-4baa-9bf7-335cb3304dfb service nova] Releasing lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:20.910565 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-23e15b61-4c60-4524-9cd6-341b55adaa08 req-65663cf0-5c32-4287-aec9-35c4d2c88f15 service nova] Releasing lock "refresh_cache-986e86a9-d6cb-40b3-9c7b-263684816a96" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:21.023763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:21.023923 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:21.023923 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:21.024028 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No VIF found with MAC fa:16:3e:60:f8:70, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:21.028106 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'ec2_ids' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:21.071462 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1214174567', uuid='0c96a33a-84dd-4c95-82b3-94a6251e5404'), owner=OwnerMeta(userid='d7f2227d939749fba2d87d475eced3ad', username='tempest-TaggedAttachmentsTest-1796593045-project-member', projectid='8f26c4eed05b4d6787812ac3fb0c7803', projectname='tempest-TaggedAttachmentsTest-1796593045'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976941.0707672) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:21.072114 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:package version="33.1.0"/>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:creationTime>2026-05-28 14:02:21</nova:creationTime>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:flavor name="m1.nano" id="42">
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:memory>192</nova:memory>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:disk>1</nova:disk>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:swap>0</nova:swap>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:vcpus>1</nova:vcpus>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:extraSpecs>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     </nova:extraSpecs>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   </nova:flavor>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:minDisk>1</nova:minDisk>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:minRam>0</nova:minRam>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:properties>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     </nova:properties>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   </nova:image>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:owner>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   </nova:owner>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   <nova:ports>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     <nova:port uuid="0391cf13-9163-4dad-951b-e7158fd8630a">
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.10.10.86" ipVersion="4"/>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:   </nova:ports>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]: </nova:instance>
May 28 14:02:21.072114 np0000001643 nova-compute[98269]:  {{(pid=98269) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 14:02:21.097086 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.097692 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.097692 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.097967 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.098257 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.098509 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.098723 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.098950 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.099120 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:02:21.099348 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:02:21.245752 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-caf3f9dd-b87c-4eb8-be6c-6a54ab32fbda req-16111e56-f900-405b-a03b-41fcf1886452 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-plugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:21.247367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-caf3f9dd-b87c-4eb8-be6c-6a54ab32fbda req-16111e56-f900-405b-a03b-41fcf1886452 service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:21.247367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-caf3f9dd-b87c-4eb8-be6c-6a54ab32fbda req-16111e56-f900-405b-a03b-41fcf1886452 service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:21.247367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-caf3f9dd-b87c-4eb8-be6c-6a54ab32fbda req-16111e56-f900-405b-a03b-41fcf1886452 service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:21.247367 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-caf3f9dd-b87c-4eb8-be6c-6a54ab32fbda req-16111e56-f900-405b-a03b-41fcf1886452 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No waiting events found dispatching network-vif-plugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:21.247367 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-caf3f9dd-b87c-4eb8-be6c-6a54ab32fbda req-16111e56-f900-405b-a03b-41fcf1886452 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received unexpected event network-vif-plugged-0391cf13-9163-4dad-951b-e7158fd8630a for instance with vm_state active and task_state None.
May 28 14:02:21.322866 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:21.326736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:21.333782 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:21.333980 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:21.334458 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:21.334823 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:21.335167 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:21.335532 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:21.426653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:02:21.532017 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:21.532159 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'keypairs' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:21.579030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48ad4eab-64ca-4bdb-9175-4e07cc78f1f3 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "interface-0c96a33a-84dd-4c95-82b3-94a6251e5404-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 7.813s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:21.605409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:21.605967 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:21.606210 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:21.606430 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:02:21.833399 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:02:21.834052 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976941.833476, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:21.834052 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Paused (Lifecycle Event)
May 28 14:02:21.842821 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Took 8.43 seconds to spawn the instance on the hypervisor.
May 28 14:02:21.842821 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:21.849442 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:02:21.854087 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:02:21.854489 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Creating image(s)
May 28 14:02:21.855359 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:02:21.855604 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Ensure instance console log exists: /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:02:21.855865 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:21.856219 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:21.856219 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:21.856744 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Start _get_guest_xml network_info=[{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '45f6e68c-8788-4c3f-b3ee-ac3203ef5414', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '033c2245-10fc-4568-a15f-3b39ee5258ae', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'serial': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:02:21.858836 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:21.860051 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-137732219', uuid='033c2245-10fc-4568-a15f-3b39ee5258ae'), owner=OwnerMeta(userid='86dc22a5d6a7478dab81969f17d3daab', username='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member', projectid='b74df57519ea42009fcebcff7cfdf94e', projectname='tempest-ServerBootFromVolumeStableRescueTest-241739491'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976941.859696) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:21.861036 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:02:21.861704 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:02:21.862692 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:02:21.862939 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:02:21.864253 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:02:21.864700 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:02:21.864936 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:02:21.865132 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:02:21.865239 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:02:21.865358 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:02:21.865483 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:02:21.865639 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:02:21.865753 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:02:21.865863 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:02:21.866781 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:02:21.866781 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:02:21.881985 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:21.882465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:21.883167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:22.034997 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:22.038037 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:22.045602 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6df9384c-cc51-4573-b894-e07b37e8c7c1 req-87e71f44-75af-4b49-b92f-070017db8009 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:22.045602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6df9384c-cc51-4573-b894-e07b37e8c7c1 req-87e71f44-75af-4b49-b92f-070017db8009 service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:22.045602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6df9384c-cc51-4573-b894-e07b37e8c7c1 req-87e71f44-75af-4b49-b92f-070017db8009 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:22.045602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6df9384c-cc51-4573-b894-e07b37e8c7c1 req-87e71f44-75af-4b49-b92f-070017db8009 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:22.045602 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6df9384c-cc51-4573-b894-e07b37e8c7c1 req-87e71f44-75af-4b49-b92f-070017db8009 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:22.045602 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6df9384c-cc51-4573-b894-e07b37e8c7c1 req-87e71f44-75af-4b49-b92f-070017db8009 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state active and task_state None.
May 28 14:02:22.185119 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Creating config drive at /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config.rescue
May 28 14:02:22.188401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbzqn_5ha {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:22.232064 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbzqn_5ha" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:22.338222 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:22.340869 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976942.3404868, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:22.342947 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Resumed (Lifecycle Event)
May 28 14:02:22.358469 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Took 14.24 seconds to build instance.
May 28 14:02:22.450950 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Found WWN 330000000965e53be for multipath device dm-6 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:22.450950 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.046s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:22.450950 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] <== connect_volume: return (7073ms) {'type': 'block', 'scsi_wwn': '330000000965e53be', 'path': '/dev/dm-6', 'multipath_id': '330000000965e53be'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:22.450950 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000965e53be', 'path': '/dev/dm-6', 'multipath_id': '330000000965e53be'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:22.451808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.400s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:22.452180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '362fc806-7385-432f-8262-e0e7c2a0993a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:22.454508 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lazy-loading 'flavor' on Instance uuid 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:22.467389 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:22.468233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:22.469253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:22.470862 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:22.470862 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:22.470862 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:22.488310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:22.488310 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:22.494701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:22.494701 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:22.504039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a] added
May 28 14:02:22.504039 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:22.504039 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:22.504039 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:22.504039 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:22.504039 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:22.504039 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:22.504385 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:22.504672 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:22.504876 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:22.509089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a] added
May 28 14:02:22.509089 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:22.509089 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:22.509089 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:22.509089 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:22.509089 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:22.509089 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:22.509422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:22.509526 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:22.509674 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:22.591589 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41d24e92-cf0c-4483-ad5f-0cb9c4d616a9 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.961s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:22.600883 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:22.601078 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:22.653295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:22.740687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:22.741233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:22.785501 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:22.822291 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:22.825776 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:22.839194 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:22.845247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:22.848795 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:22.864005 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:22.871097 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.773s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:22.947758 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:22.949512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:22.950558 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:22.972374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Attempting to attach volume 8c2914e1-0030-4fd9-93ee-d6763a467c6f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:02:22.979613 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] attach device xml: <disk type="block" device="disk">
May 28 14:02:22.979613 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:22.979613 np0000001643 nova-compute[98269]:   <alias name="ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f"/>
May 28 14:02:22.979613 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-6"/>
May 28 14:02:22.979613 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:02:22.979613 np0000001643 nova-compute[98269]:   <serial>8c2914e1-0030-4fd9-93ee-d6763a467c6f</serial>
May 28 14:02:22.979613 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:22.979613 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:02:23.020780 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:23.053076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.057283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.106554 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'flavor' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:23.175251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.175888 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.286987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.292122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.354086 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8cfb4be-fba6-41c3-a673-4a6493637689 req-5818d9f6-d3d9-4ae1-87bb-f14780a6ad39 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:23.357400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8cfb4be-fba6-41c3-a673-4a6493637689 req-5818d9f6-d3d9-4ae1-87bb-f14780a6ad39 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:23.358336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8cfb4be-fba6-41c3-a673-4a6493637689 req-5818d9f6-d3d9-4ae1-87bb-f14780a6ad39 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:23.358336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8cfb4be-fba6-41c3-a673-4a6493637689 req-5818d9f6-d3d9-4ae1-87bb-f14780a6ad39 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:23.358623 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8cfb4be-fba6-41c3-a673-4a6493637689 req-5818d9f6-d3d9-4ae1-87bb-f14780a6ad39 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:23.358832 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e8cfb4be-fba6-41c3-a673-4a6493637689 req-5818d9f6-d3d9-4ae1-87bb-f14780a6ad39 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state active and task_state rescuing.
May 28 14:02:23.398032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.400293 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.499979 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.500583 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:02:23.504041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.514801 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:23.516472 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:23.534334 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:23.534334 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:23.543775 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:23.543775 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.556668 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.565412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.583371 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.594472 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:23.600714 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.605502 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.654499 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.50.100,3260]
May 28 14:02:23.654499 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.50.100,3260] successful.
May 28 14:02:23.654499 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.661095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.40.100,3260]
May 28 14:02:23.661095 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.40.100,3260] successful.
May 28 14:02:23.661095 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.671619 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.678902 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.701461 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.702748 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:23.704505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:23.704505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:23.707503 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:23.707503 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.719688 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:23.720290 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:23.720290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.252s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:23.720725 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:23.725214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:23.726149 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:23.726236 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.727647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.750900 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:23.751285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '362fc806-7385-432f-8262-e0e7c2a0993a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:23.759901 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:23.759901 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '362fc806-7385-432f-8262-e0e7c2a0993a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:23.836279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:23.838925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.838925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:23.940231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:23.947035 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.055532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.rescue --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.057308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.120765 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:24.139647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.538s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:24.154966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk.rescue --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.154966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.251016 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for fb9d4d3f-f068-49a2-ba11-114989ee8d9e due to new event <LifecycleEvent: 1779976944.2486424, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:02:24.251016 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976944.2486424, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:24.251016 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Resumed (Lifecycle Event)
May 28 14:02:24.253157 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9ac64bfc-5c01-4278-8827-e0aff110e445 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:24.254671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.255210 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.342815 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.347870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.443223 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.444585 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.471222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:02:24.513722 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-changed-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:24.514047 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Refreshing instance network info cache due to event network-changed-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:24.514229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] Acquiring lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:24.514395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] Acquired lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:24.515994 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Refreshing network info cache for port c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:24.560074 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.565136 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:02:24.565460 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:02:24.565626 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-4 (vdc) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:02:24.567539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.673741 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.674695 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.728912 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:24.729173 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:24.729282 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:24.729458 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] No VIF found with MAC fa:16:3e:c7:c2:75, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:24.755194 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:24.757680 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:24.763386 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.765833 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:24.767391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:24.809311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.041s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:24.809900 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12300MB free_disk=74.52031707763672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:02:24.810065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:24.810222 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:25.017994 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:25.244483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:25.244483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:25.244483 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Attaching volume 47ada01c-ff15-4a17-bf9d-f88b0e92d0dc to /dev/vdb
May 28 14:02:25.261666 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976945.2613168, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:25.263639 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Started (Lifecycle Event)
May 28 14:02:25.349373 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:25.366335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:02:25.398242 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:25.452269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:02:25.452753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:02:25.464675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:02:25.470131 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feae:16a4', 'fe80::fc16:3eff:fe60:f870', 'fe80::48e:83ff:fe21:60b7', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe46:1d78', 'fe80::481b:13ff:fec7:5d7d', 'fe80::fc16:3eff:fec7:c275', 'fe80::c498:a0ff:feab:524c', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:fe66:e9da', 'fe80::fc16:3eff:feee:e982', 'fe80::54c2:95ff:fe36:5e1', 'fe80::fc16:3eff:fe26:cfe0', 'fe80::fc16:3eff:fe9d:d1a7', 'fe80::fc16:3eff:fe09:469', 'fe80::fc16:3eff:fe69:8116', 'fe80::84c8:d5ff:fe78:370', 'fe80::fc16:3eff:fee0:d4e', 'fe80::809f:94ff:fe0f:c60', 'fe80::fc16:3eff:fe36:297d', 'fe80::9085:f8ff:fec2:20c9', 'fe80::fc16:3eff:feab:39d2', 'fe80::1cb4:a3ff:fe76:b1bf', 'fe80::fc16:3eff:feeb:f82e'] 
May 28 14:02:25.470474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:02:25.471524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:02:25.473304 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:25.474490 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating existing volume attachment record: 87182a00-f8dd-459f-a22e-f8928f89a0bb {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:02:25.503637 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-26f331de-deb4-4f21-94c0-960d9fca6958 req-be219272-e428-4b59-8de4-0498ee7c2692 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:25.503962 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-26f331de-deb4-4f21-94c0-960d9fca6958 req-be219272-e428-4b59-8de4-0498ee7c2692 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:25.504251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-26f331de-deb4-4f21-94c0-960d9fca6958 req-be219272-e428-4b59-8de4-0498ee7c2692 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:25.504475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-26f331de-deb4-4f21-94c0-960d9fca6958 req-be219272-e428-4b59-8de4-0498ee7c2692 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:25.504645 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-26f331de-deb4-4f21-94c0-960d9fca6958 req-be219272-e428-4b59-8de4-0498ee7c2692 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:25.504840 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-26f331de-deb4-4f21-94c0-960d9fca6958 req-be219272-e428-4b59-8de4-0498ee7c2692 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state rescued and task_state unrescuing.
May 28 14:02:25.507781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Found WWN 330000000a73d8079 for multipath device dm-7 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:25.509008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.057s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:25.509199 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] <== connect_volume: return (5457ms) {'type': 'block', 'scsi_wwn': '330000000a73d8079', 'path': '/dev/dm-7', 'multipath_id': '330000000a73d8079'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:25.510103 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a73d8079', 'path': '/dev/dm-7', 'multipath_id': '330000000a73d8079'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:25.510727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.628s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:25.511025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:25.520913 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lazy-loading 'flavor' on Instance uuid af52b758-781b-4980-9e1d-5cb5924eee22 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:25.534787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:25.534973 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:25.535530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:25.536581 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:25.536581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:25.536581 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:25.543565 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:25.557873 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:25.557873 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:25.560144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:25.560144 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:25.575058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289] added
May 28 14:02:25.575058 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:25.575058 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:25.575058 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:25.575058 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:25.575058 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:25.575058 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:25.576301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:25.577550 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:25.578324 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:25.580893 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289] added
May 28 14:02:25.580893 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:25.580893 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:25.580893 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:25.580893 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:25.580893 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:25.580893 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:25.581147 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:25.581735 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0448(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:25.583615 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:25.770331 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:25.776419 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:25.798197 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updated VIF entry in instance network info cache for port c438645f-c3e6-4778-91e5-ca2e1d7bbdd0. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:02:25.798892 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:25.802806 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Unrescuing
May 28 14:02:25.803000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:25.803189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:25.803271 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:25.903741 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance aaeff833-80ef-4909-96de-5958543e37ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.904347 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance af52b758-781b-4980-9e1d-5cb5924eee22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.904613 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.904726 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.904835 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 986e86a9-d6cb-40b3-9c7b-263684816a96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.904922 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 150a83f0-0070-4df3-ab14-6aa1c028be82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.905069 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance fb9d4d3f-f068-49a2-ba11-114989ee8d9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.905139 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 65c247b5-acbc-474a-bb88-a2edf9ac2d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.905389 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.905389 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 033c2245-10fc-4568-a15f-3b39ee5258ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:02:25.905703 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:02:25.905890 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:02:24 up 29 min,  2 users,  load average: 8.32, 3.74, 1.72\n', 'num_instances': '10', 'num_vm_active': '7', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_a792bdb63c954739ad33cb2fedeedee4': '1', 'io_workload': '1', 'num_proj_19f245e8060643a4a760a0d26845e019': '1', 'num_proj_8f26c4eed05b4d6787812ac3fb0c7803': '1', 'num_proj_ba104c9114f447d390a20808c754f519': '1', 'num_proj_bee69e237aa64213a01d0bf475569055': '1', 'num_proj_b74df57519ea42009fcebcff7cfdf94e': '2', 'num_vm_rescued': '2', 'num_proj_9bfe2941b78c4f2e9f16f60e05ec5dcc': '2', 'num_proj_161254855aa54c71a7ac0a8a7076750c': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:02:26.028436 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:02:26.028436 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:26.028436 np0000001643 nova-compute[98269]:   <alias name="ua-362fc806-7385-432f-8262-e0e7c2a0993a"/>
May 28 14:02:26.028436 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-7"/>
May 28 14:02:26.028436 np0000001643 nova-compute[98269]:   <target dev="sdc" bus="scsi"/>
May 28 14:02:26.028436 np0000001643 nova-compute[98269]:   <serial>362fc806-7385-432f-8262-e0e7c2a0993a</serial>
May 28 14:02:26.028436 np0000001643 nova-compute[98269]:   <address type="drive" controller="0" unit="2"/>
May 28 14:02:26.028436 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:26.028436 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:02:26.098519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:26.099092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:26.099202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:26.282297 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 14:02:26.305781 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:26.308607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a37c5c79-1eb2-463e-8d88-1f03c8ad1dbf req-7f6278a7-52f5-4df8-8204-540b56a0f7af service nova] Releasing lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:26.316578 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c5113fd-0742-4393-86d7-8c9123b24f25 tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.825s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:26.532278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "0c097fdc-e6f1-462e-b9de-72a07928e53a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:26.532584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:26.580043 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:26.582499 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:26.602787 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:26.602787 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:26.611229 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:26.611229 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:26.627470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:26.646256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:26.651594 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] volume_snapshot_create: create_info: {'snapshot_id': '5074ab9f-dcc0-41b4-979f-3a32ff481a93', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98269) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 28 14:02:26.653935 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] snap xml: <domainsnapshot>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:   <disks>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:     <disk name="/dev/dm-6" snapshot="external" type="file">
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:       <source file="/dev/new_file"/>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:     <disk name="vda" snapshot="no"/>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:     <disk name="hda" snapshot="no"/>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:   </disks>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]: </domainsnapshot>
May 28 14:02:26.653935 np0000001643 nova-compute[98269]:  {{(pid=98269) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 28 14:02:26.653935 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] Lazy-loading 'system_metadata' on Instance uuid 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.663618 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.666245 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:26.675142 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:26.675726 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.679090 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:26.755824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.50.100,3260]
May 28 14:02:26.755824 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.50.100,3260] successful.
May 28 14:02:26.755824 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:26.768040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-46688e30-0dae-42ae-b83e-822c44c045cf tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] volume_snapshot_delete: delete_info: {'volume_id': '8c2914e1-0030-4fd9-93ee-d6763a467c6f'} {{(pid=98269) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [None req-46688e30-0dae-42ae-b83e-822c44c045cf tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Traceback (most recent call last):
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     self._volume_snapshot_delete(context, instance, volume_id,
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     if delete_info['type'] != 'qcow2':
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]        ~~~~~~~~~~~^^^^^^^^
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] KeyError: 'type'
May 28 14:02:26.772818 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] 
May 28 14:02:26.777269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.805198 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:26.807667 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.271s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:26.807667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:26.809266 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('19', '-', '-', 0) found on session 17 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:26.809266 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:26.831064 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:26.838270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:26.839414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [None req-46688e30-0dae-42ae-b83e-822c44c045cf tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-78eb7796-fb10-43bf-8ea0-ee50c34d4823)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 14:02:26.845042 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server [None req-46688e30-0dae-42ae-b83e-822c44c045cf tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] Exception during message handling: KeyError: 'type'
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 28 14:02:26.864181 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server 
May 28 14:02:27.037919 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Updating instance_info_cache with network_info: [{"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:27.040996 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:02:27.161365 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Traceback (most recent call last):
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 14:02:27.168939 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] 
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Traceback (most recent call last):
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     self._volume_snapshot_create(context, instance, guest,
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 14:02:27.170062 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] 
May 28 14:02:27.181090 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5074ab9f-dcc0-41b4-979f-3a32ff481a93 could not be found.
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5074ab9f-dcc0-41b4-979f-3a32ff481a93 could not be found. (HTTP 404) (Request-ID: req-7b264f6b-caa2-4fe8-9d73-117bd1cbffde)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5074ab9f-dcc0-41b4-979f-3a32ff481a93 could not be found.
May 28 14:02:27.199920 np0000001643 nova-compute[98269]: ERROR nova.virt.libvirt.driver 
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server [None req-a23eb8d6-316f-4f63-b71d-0d00f1ffb236 tempest-VolumesAssistedSnapshotsTest-581596248 tempest-VolumesAssistedSnapshotsTest-581596248-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 14:02:27.206791 np0000001643 nova-compute[98269]: ERROR oslo_messaging.rpc.server 
May 28 14:02:27.540750 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-fb9d4d3f-f068-49a2-ba11-114989ee8d9e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:27.541076 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'flavor' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:27.600811 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:27.600811 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:27.629726 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:27.691804 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:02:27.692000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.882s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:27.692849 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.13 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:02:27.692849 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.064s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:27.695675 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:02:27.698223 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Claim successful on node np0000001643
May 28 14:02:27.763103 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] No BDM found with device name sda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:27.764503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:27.764503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:27.765022 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] No VIF found with MAC fa:16:3e:ae:16:a4, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:27.769305 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.40.100,3260]
May 28 14:02:27.769305 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.40.100,3260] successful.
May 28 14:02:27.769305 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:27.785020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:27.804670 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:27.805233 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:27.805233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.270s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:27.805751 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:27.807256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:27.807408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:27.826820 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:27.827046 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:28.074362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:28.080819 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:28.102359 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:28.111706 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Detaching volume 8c2914e1-0030-4fd9-93ee-d6763a467c6f
May 28 14:02:28.171713 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Attempting to driver detach volume 8c2914e1-0030-4fd9-93ee-d6763a467c6f from mountpoint /dev/vdb
May 28 14:02:28.182389 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Found disk vdb by alias ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:02:28.185161 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Found disk vdb by alias ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:02:28.185287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Attempting to detach device vdb from instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:02:28.185899 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] detach device xml: <disk type="block" device="disk">
May 28 14:02:28.185899 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:28.185899 np0000001643 nova-compute[98269]:   <alias name="ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f"/>
May 28 14:02:28.185899 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-6"/>
May 28 14:02:28.185899 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:02:28.185899 np0000001643 nova-compute[98269]:   <serial>8c2914e1-0030-4fd9-93ee-d6763a467c6f</serial>
May 28 14:02:28.185899 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:02:28.185899 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:28.185899 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:28.203981 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Successfully detached device vdb from instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca from the persistent domain config.
May 28 14:02:28.207476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] (1/8): Attempting to detach device vdb with device alias ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f from instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:02:28.207476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] detach device xml: <disk type="block" device="disk">
May 28 14:02:28.207476 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:28.207476 np0000001643 nova-compute[98269]:   <alias name="ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f"/>
May 28 14:02:28.207476 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-6"/>
May 28 14:02:28.207476 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:02:28.207476 np0000001643 nova-compute[98269]:   <serial>8c2914e1-0030-4fd9-93ee-d6763a467c6f</serial>
May 28 14:02:28.207476 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:02:28.207476 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:28.207476 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:28.310278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:28.318065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:28.334825 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aaf1fbb9-343f-4a56-8abd-ff46d16d372e req-b1d348ae-bec4-4994-a553-a9bf2993e264 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:28.335396 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aaf1fbb9-343f-4a56-8abd-ff46d16d372e req-b1d348ae-bec4-4994-a553-a9bf2993e264 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:28.335704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aaf1fbb9-343f-4a56-8abd-ff46d16d372e req-b1d348ae-bec4-4994-a553-a9bf2993e264 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:28.335810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aaf1fbb9-343f-4a56-8abd-ff46d16d372e req-b1d348ae-bec4-4994-a553-a9bf2993e264 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:28.335860 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aaf1fbb9-343f-4a56-8abd-ff46d16d372e req-b1d348ae-bec4-4994-a553-a9bf2993e264 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:28.335985 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-aaf1fbb9-343f-4a56-8abd-ff46d16d372e req-b1d348ae-bec4-4994-a553-a9bf2993e264 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state rescued and task_state unrescuing.
May 28 14:02:28.441711 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999486710999918 future=<Future at 0x71a78055a330 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:28.444515 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance destroyed successfully.
May 28 14:02:28.445332 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'numa_topology' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:28.565592 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:02:28.838064 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:28.847853 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779976948.8461325, 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca => ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:02:28.848066 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-8c2914e1-0030-4fd9-93ee-d6763a467c6f for instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:02:28.851477 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Successfully detached device vdb from instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca from the live domain config.
May 28 14:02:28.852916 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:02:28.853291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:28.853465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:28.947906 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<fb9d4d3f-f068-49a2-ba11-114989ee8d9e> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:29.120527 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:29.335676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c551c7ce-e7b4-4391-8cf2-582d585ad718 tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.069s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:29.410216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:29.410766 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:29.426668 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:29.473021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:29.480937 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:29.575843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:29.586279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798925 for multipath device dm-8 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:29.586970 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.076s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:29.587183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== connect_volume: return (7704ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798925', 'path': '/dev/dm-8', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798925'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:29.587353 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798925', 'path': '/dev/dm-8', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798925'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:29.588823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.489s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:29.589099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:29.608077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:29.608570 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:29.608971 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:29.609162 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:29.609639 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:29.609845 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:29.624428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:29.624428 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:29.636101 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:02:29.636101 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:29.645129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc] added
May 28 14:02:29.645129 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:29.645129 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:29.645129 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:29.645129 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:29.645129 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:29.645129 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:29.645477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:29.645521 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:29.645877 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:29.651498 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:29.653694 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:29.654800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc] added
May 28 14:02:29.654800 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:02:29.654800 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:29.654800 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:29.654800 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:02:29.654800 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:02:29.654800 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:29.655081 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:02:29.655340 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0461(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:02:29.655554 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:02:29.913646 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:30.107977 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-137732219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-137732219',id=11,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-9vnyws3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:15Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=033c2245-10fc-4568-a15f-3b39ee5258ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:30.108391 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:30.109057 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:30.110417 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'pci_devices' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:30.417771 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for fb9d4d3f-f068-49a2-ba11-114989ee8d9e due to new event <LifecycleEvent: 1779976950.4173093, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:02:30.418299 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976950.4173093, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:30.418299 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Resumed (Lifecycle Event)
May 28 14:02:30.421993 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.729s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:30.422639 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:02:30.427290 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2ed5f0fb-06c9-4711-af5d-5da05e3a6e02 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:30.435219 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:30.435475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:30.435715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:30.435878 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:30.436073 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:30.436494 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state rescued and task_state unrescuing.
May 28 14:02:30.439625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:30.439837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:30.440048 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:30.440939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:30.440939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:30.440939 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state rescued and task_state unrescuing.
May 28 14:02:30.440939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:30.441307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:30.441307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:30.441380 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:30.441720 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:30.441720 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-98f08d22-7aed-4221-acd4-447f0e0abc32 req-490950b9-21af-41e7-bb79-b9fe4a135a25 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received unexpected event network-vif-plugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with vm_state rescued and task_state unrescuing.
May 28 14:02:30.614726 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <uuid>033c2245-10fc-4568-a15f-3b39ee5258ae</uuid>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <name>instance-0000000b</name>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-137732219</nova:name>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:02:21</nova:creationTime>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:user uuid="86dc22a5d6a7478dab81969f17d3daab">tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member</nova:user>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:project uuid="b74df57519ea42009fcebcff7cfdf94e">tempest-ServerBootFromVolumeStableRescueTest-241739491</nova:project>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         <nova:port uuid="a3c1b47a-6f08-4472-b43d-f02aad3c3ab4">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <entry name="serial">033c2245-10fc-4568-a15f-3b39ee5258ae</entry>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <entry name="uuid">033c2245-10fc-4568-a15f-3b39ee5258ae</entry>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <alias name="ua-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-8"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <serial>a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289</serial>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:22:8d:7d"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <target dev="tapa3c1b47a-6f"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/console.log" append="off"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:30.614726 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Preparing to wait for external event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-137732219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-137732219',id=11,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-9vnyws3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:15Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=033c2245-10fc-4568-a15f-3b39ee5258ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:30.617220 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:30.617928 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:30.617928 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:30.618590 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:30.618721 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5b04926-1c80-51c2-ac25-321ef3a9c9ab', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:30.619518 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:30.622512 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:30.624067 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:30.624271 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3c1b47a-6f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:30.624670 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3c1b47a-6f, col_values=(('qos', UUID('368c7f27-6b1f-4aa7-84f0-4021b574795c')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:30.624870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3c1b47a-6f, col_values=(('external_ids', {'iface-id': 'a3c1b47a-6f08-4472-b43d-f02aad3c3ab4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:8d:7d', 'vm-uuid': '033c2245-10fc-4568-a15f-3b39ee5258ae'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:30.625816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:30.628557 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:30.633632 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:30.635838 np0000001643 nova-compute[98269]: INFO os_vif [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f')
May 28 14:02:30.646506 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:30.656319 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:30.668651 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:30.668651 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:30.680686 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:30.680686 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.689256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.699047 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.710784 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.711248 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.724862 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:30.777801 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.50.100,3260]
May 28 14:02:30.777801 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.50.100,3260] successful.
May 28 14:02:30.777801 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.788067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.40.100,3260]
May 28 14:02:30.788067 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.40.100,3260] successful.
May 28 14:02:30.788067 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.794639 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.803313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.819744 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.820671 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:30.820671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:30.822642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] HCTL ('21', '-', '-', 0) found on session 19 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:30.822795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:30.827292 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:30.827707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:30.833039 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] HCTL ('22', '-', '-', 0) found on session 20 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:30.833039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:30.861098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Searching for a device in session 19 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:30.861098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:30.861098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Searching for a device in session 20 and hctl ['22', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:30.930339 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:30.936974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:02:30.936974 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:02:30.944088 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:30.945216 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:30.947717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:31.032295 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.000371720999964964 future=<Future at 0x71a7802d2780 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:31.032471 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:31.032707 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=12.408522646999927 future=<Future at 0x71a78055a330 state=cancelled>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:31.032707 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=12.408423183999957 future=<Future at 0x71a78055a330 state=cancelled>) was cancelled while queued, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:31.032813 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:31.093212 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d135543093d4ca0849ab043df8e19ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a792bdb63c954739ad33cb2fedeedee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:02:31.347358 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Detaching volume 362fc806-7385-432f-8262-e0e7c2a0993a
May 28 14:02:31.425460 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Attempting to driver detach volume 362fc806-7385-432f-8262-e0e7c2a0993a from mountpoint /dev/sdc
May 28 14:02:31.429985 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Found disk sdc by alias ua-362fc806-7385-432f-8262-e0e7c2a0993a {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:02:31.430822 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Found disk sdc by alias ua-362fc806-7385-432f-8262-e0e7c2a0993a {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:02:31.431042 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Attempting to detach device sdc from instance af52b758-781b-4980-9e1d-5cb5924eee22 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:02:31.431250 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:02:31.431250 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:31.431250 np0000001643 nova-compute[98269]:   <alias name="ua-362fc806-7385-432f-8262-e0e7c2a0993a"/>
May 28 14:02:31.431250 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-7"/>
May 28 14:02:31.431250 np0000001643 nova-compute[98269]:   <target dev="sdc" bus="scsi"/>
May 28 14:02:31.431250 np0000001643 nova-compute[98269]:   <serial>362fc806-7385-432f-8262-e0e7c2a0993a</serial>
May 28 14:02:31.431250 np0000001643 nova-compute[98269]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 14:02:31.431250 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:31.431250 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:31.438210 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Successfully detached device sdc from instance af52b758-781b-4980-9e1d-5cb5924eee22 from the persistent domain config.
May 28 14:02:31.438339 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] (1/8): Attempting to detach device sdc with device alias ua-362fc806-7385-432f-8262-e0e7c2a0993a from instance af52b758-781b-4980-9e1d-5cb5924eee22 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:02:31.438614 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:02:31.438614 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:31.438614 np0000001643 nova-compute[98269]:   <alias name="ua-362fc806-7385-432f-8262-e0e7c2a0993a"/>
May 28 14:02:31.438614 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-7"/>
May 28 14:02:31.438614 np0000001643 nova-compute[98269]:   <target dev="sdc" bus="scsi"/>
May 28 14:02:31.438614 np0000001643 nova-compute[98269]:   <serial>362fc806-7385-432f-8262-e0e7c2a0993a</serial>
May 28 14:02:31.438614 np0000001643 nova-compute[98269]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 14:02:31.438614 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:31.438614 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:31.444094 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:02:31.459303 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976951.458811, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:31.459666 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Started (Lifecycle Event)
May 28 14:02:31.619499 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-362fc806-7385-432f-8262-e0e7c2a0993a for instance af52b758-781b-4980-9e1d-5cb5924eee22 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:02:31.805256 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Successfully created port: ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:02:31.854474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Searching for a device in session 20 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:31.854474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:31.952210 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:02:31.964022 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:31.967507 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:32.156291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:32.156438 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:32.156544 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No VIF found with MAC fa:16:3e:22:8d:7d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:32.157040 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Using config drive
May 28 14:02:32.470685 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779976952.4702377, af52b758-781b-4980-9e1d-5cb5924eee22 => ua-362fc806-7385-432f-8262-e0e7c2a0993a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:02:32.478486 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Successfully detached device sdc from instance af52b758-781b-4980-9e1d-5cb5924eee22 from the live domain config.
May 28 14:02:32.485371 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:02:32.485547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '362fc806-7385-432f-8262-e0e7c2a0993a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:32.485733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:32.545259 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Successfully updated port: ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:02:32.607169 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Received event network-changed-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:32.607280 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Refreshing instance network info cache due to event network-changed-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:32.607462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] Acquiring lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:32.607560 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] Acquired lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:32.607670 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Refreshing network info cache for port ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:32.638003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Found WWN 3300000006f2b45f8 for multipath device dm-9 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:32.638422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:32.639662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.785s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:32.640690 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] <== connect_volume: return (6539ms) {'type': 'block', 'scsi_wwn': '3300000006f2b45f8', 'path': '/dev/dm-9', 'multipath_id': '3300000006f2b45f8'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:32.640973 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8c2914e1-0030-4fd9-93ee-d6763a467c6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:02:32.641306 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006f2b45f8', 'path': '/dev/dm-9', 'multipath_id': '3300000006f2b45f8'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:32.641519 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:02:32.645098 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'flavor' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:32.663722 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:32.680091 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:32.680634 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:32.680634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '9')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:02:32.681610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', '13')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:02:32.683476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f', '14')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:02:32.685057 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c757560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f'): ({'sdk'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:02:32.686120 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Removing multipathed devices sdj, sdk {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:02:32.686832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Flush multipath device 330000000965e53be {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:02:32.715087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:02:32.766183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:02:32.803225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:02:32.803507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:02:32.805205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:02:32.817246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:02:32.817683 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:02:32.834968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:32.856226 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Creating config drive at /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config
May 28 14:02:32.859309 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_l5fektr {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:32.878969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.40.100,3260]
May 28 14:02:32.878969 np0000001643 nova-compute[98269]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.40.100,3260] successful.
May 28 14:02:32.878969 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:32.907020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:32.908040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_l5fektr" returned: 0 in 0.049s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:32.920929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:32.961475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.50.100,3260]
May 28 14:02:32.961475 np0000001643 nova-compute[98269]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-8c2914e1-0030-4fd9-93ee-d6763a467c6f, portal: 192.168.50.100,3260] successful.
May 28 14:02:32.961475 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:32.971709 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:02:32.973405 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:02:32.973695 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Creating image(s)
May 28 14:02:32.974341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:32.974603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:32.975564 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:32.976411 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:32.982273 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:32.983789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:33.002792 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:33.004573 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:33.006218 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.520s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:33.007524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] <== disconnect_volume: return (4152ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:33.007524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '362fc806-7385-432f-8262-e0e7c2a0993a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:02:33.010914 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:02:33.010914 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:02:33.049210 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:33.058588 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:33.058927 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:33.062467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '9')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:02:33.062467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', '16')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:02:33.062467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a', '15')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:02:33.062467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781a5620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a'): ({'sdl'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:02:33.062716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Removing multipathed devices sdm, sdl {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:02:33.063156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Flush multipath device 330000000a73d8079 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:02:33.086388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:33.086950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:33.087601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:33.088302 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:33.091335 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:33.091771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:33.106301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:02:33.111732 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:33.152472 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Attempting to attach volume 47ada01c-ff15-4a17-bf9d-f88b0e92d0dc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:02:33.154782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:02:33.155893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:02:33.155893 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:33.155893 np0000001643 nova-compute[98269]:   <alias name="ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc"/>
May 28 14:02:33.155893 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-9"/>
May 28 14:02:33.155893 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:02:33.155893 np0000001643 nova-compute[98269]:   <serial>47ada01c-ff15-4a17-bf9d-f88b0e92d0dc</serial>
May 28 14:02:33.155893 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:33.155893 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:02:33.196307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:02:33.197350 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:02:33.199370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:02:33.200922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:33.201505 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:33.230106 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:02:33.235038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:02:33.235749 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:02:33.251728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:33.258059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk 1073741824" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:33.258059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:33.258059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:33.306836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.40.100,3260]
May 28 14:02:33.306836 np0000001643 nova-compute[98269]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.40.100,3260] successful.
May 28 14:02:33.306836 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:33.339484 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:33.357070 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:33.357828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:33.358296 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:02:33.359629 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:33.404776 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.50.100,3260]
May 28 14:02:33.404776 np0000001643 nova-compute[98269]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-362fc806-7385-432f-8262-e0e7c2a0993a, portal: 192.168.50.100,3260] successful.
May 28 14:02:33.404776 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:33.430270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:33.431942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:33.432271 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] <== disconnect_volume: return (946ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:33.432592 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:02:33.471917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:33.472736 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Cannot resize image /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:02:33.473183 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:02:33.473429 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Ensure instance console log exists: /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:02:33.473752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:33.474069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:33.474245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:33.494810 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:33.616519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:33.639590 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lazy-loading 'flavor' on Instance uuid 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:33.649615 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:33.743489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:33.836068 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:33.839914 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:34.000860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7ccc9b12-150e-4a6b-9a29-dd0282cb5551 req-df50d257-ce3c-4d3b-b634-63eaf34494cf service nova] Releasing lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:34.003476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquired lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:34.003476 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:34.046372 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lazy-loading 'flavor' on Instance uuid af52b758-781b-4980-9e1d-5cb5924eee22 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:34.123385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:34.628134 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:02:34.653504 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976954.6530159, 033c2245-10fc-4568-a15f-3b39ee5258ae => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:34.653758 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Started (Lifecycle Event)
May 28 14:02:34.665168 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-491a8369-a635-4159-a091-85a430e1816f tempest-VolumesAssistedSnapshotsTest-1231321287 tempest-VolumesAssistedSnapshotsTest-1231321287-project-admin] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.065s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Processing event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:02:34.722160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:34.723091 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:34.723091 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:34.723091 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:34.723091 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-3f41a3c7-950c-4dba-8ff5-344fd56fbcec req-8436eb4c-6c54-4718-af06-725a91f959a4 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state building and task_state spawning.
May 28 14:02:34.726758 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:02:34.731207 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance spawned successfully.
May 28 14:02:34.732029 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:02:34.880721 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:35.041762 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Updating instance_info_cache with network_info: [{"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:35.047292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:35.047292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:35.047292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] No VIF found with MAC fa:16:3e:46:1d:78, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:35.061735 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4989ae39-e85f-48cd-b544-56ccffa74d9e tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.234s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:35.159417 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:35.163939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:35.238438 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:35.238742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:35.239141 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:35.239456 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:35.239813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:35.240335 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:35.454143 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:35.456742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:35.456742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:35.456742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:35.456742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:35.459162 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Terminating instance
May 28 14:02:35.544927 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Releasing lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:35.545488 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Instance network_info: |[{"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:02:35.548028 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Start _get_guest_xml network_info=[{"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:02:35.556218 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:35.557893 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1922866190', uuid='0c097fdc-e6f1-462e-b9de-72a07928e53a'), owner=OwnerMeta(userid='2d135543093d4ca0849ab043df8e19ca', username='tempest-AttachVolumeNegativeTest-703881462-project-member', projectid='a792bdb63c954739ad33cb2fedeedee4', projectname='tempest-AttachVolumeNegativeTest-703881462'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976955.5573716) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:35.559529 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:02:35.560019 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:02:35.561990 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:02:35.561990 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:02:35.565299 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:02:35.566096 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:02:35.566994 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:02:35.566994 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:02:35.567484 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:02:35.567818 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:02:35.568247 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:02:35.570521 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:02:35.570521 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:02:35.570521 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:02:35.570521 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:02:35.570521 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:02:35.592061 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1922866190',display_name='tempest-AttachVolumeNegativeTest-server-1922866190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-1922866190',id=12,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHKNe+1ajEg6x9Qzq+AubsmcKPHoTy8MbuMyJRr3bqQmC/eXpDnm8smRPCHNvjhGjV+gAPoKQLR3u3/kADDoSZVsjLko0hShmEtYlYG1SPKfOmuncne0IFIiWAhzOaP4Q==',key_name='tempest-keypair-684236112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-0q3ucxcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=0c097fdc-e6f1-462e-b9de-72a07928e53a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:35.593267 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:35.595503 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:75:34,bridge_name='br-int',has_traffic_filtering=True,id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded2b2d9-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:35.595677 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c097fdc-e6f1-462e-b9de-72a07928e53a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:35.602975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:35.603266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:35.627300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:35.669757 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:02:35.670169 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976955.6697774, 033c2245-10fc-4568-a15f-3b39ee5258ae => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:35.670213 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Paused (Lifecycle Event)
May 28 14:02:35.745839 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Took 13.89 seconds to spawn the instance on the hypervisor.
May 28 14:02:35.745975 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:35.962202 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:02:35.985847 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:35.994368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.020722 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.023658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.042775 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.048717 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <uuid>0c097fdc-e6f1-462e-b9de-72a07928e53a</uuid>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <name>instance-0000000c</name>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1922866190</nova:name>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:02:35</nova:creationTime>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:user uuid="2d135543093d4ca0849ab043df8e19ca">tempest-AttachVolumeNegativeTest-703881462-project-member</nova:user>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:project uuid="a792bdb63c954739ad33cb2fedeedee4">tempest-AttachVolumeNegativeTest-703881462</nova:project>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         <nova:port uuid="ded2b2d9-d0ce-4f7f-a72d-3494805a7cee">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <entry name="serial">0c097fdc-e6f1-462e-b9de-72a07928e53a</entry>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <entry name="uuid">0c097fdc-e6f1-462e-b9de-72a07928e53a</entry>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk.config"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:1f:75:34"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <target dev="tapded2b2d9-d0"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/console.log" append="off"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:36.106889 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Preparing to wait for external event network-vif-plugged-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1922866190',display_name='tempest-AttachVolumeNegativeTest-server-1922866190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-1922866190',id=12,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHKNe+1ajEg6x9Qzq+AubsmcKPHoTy8MbuMyJRr3bqQmC/eXpDnm8smRPCHNvjhGjV+gAPoKQLR3u3/kADDoSZVsjLko0hShmEtYlYG1SPKfOmuncne0IFIiWAhzOaP4Q==',key_name='tempest-keypair-684236112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-0q3ucxcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=0c097fdc-e6f1-462e-b9de-72a07928e53a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:36.106889 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:36.110182 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:75:34,bridge_name='br-int',has_traffic_filtering=True,id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded2b2d9-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:36.110182 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:02:36.113606 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:75:34,bridge_name='br-int',has_traffic_filtering=True,id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded2b2d9-d0') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:36.113606 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.113606 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:36.113606 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:36.115938 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.116187 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c135e34-b92e-542d-b18f-a2432fb097ee', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:36.118402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.118402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:36.128203 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.132770 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.134610 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapded2b2d9-d0, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:36.135188 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapded2b2d9-d0, col_values=(('qos', UUID('b9845aaf-811a-43e3-876b-6958f4f296c5')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:36.136114 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapded2b2d9-d0, col_values=(('external_ids', {'iface-id': 'ded2b2d9-d0ce-4f7f-a72d-3494805a7cee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:75:34', 'vm-uuid': '0c097fdc-e6f1-462e-b9de-72a07928e53a'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:36.136902 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.138978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:36.152679 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.153829 np0000001643 nova-compute[98269]: INFO os_vif [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:75:34,bridge_name='br-int',has_traffic_filtering=True,id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded2b2d9-d0')
May 28 14:02:36.173318 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:36.185937 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976956.185632, 033c2245-10fc-4568-a15f-3b39ee5258ae => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:36.186175 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Resumed (Lifecycle Event)
May 28 14:02:36.222795 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3d6e8b37-4228-4e0a-9bd7-44f794cbe9c2 req-cb5945cf-c58a-4f84-a5f6-9f2694f77f25 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:36.222795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d6e8b37-4228-4e0a-9bd7-44f794cbe9c2 req-cb5945cf-c58a-4f84-a5f6-9f2694f77f25 service nova] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:36.222795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d6e8b37-4228-4e0a-9bd7-44f794cbe9c2 req-cb5945cf-c58a-4f84-a5f6-9f2694f77f25 service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:36.222795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d6e8b37-4228-4e0a-9bd7-44f794cbe9c2 req-cb5945cf-c58a-4f84-a5f6-9f2694f77f25 service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:36.222795 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3d6e8b37-4228-4e0a-9bd7-44f794cbe9c2 req-cb5945cf-c58a-4f84-a5f6-9f2694f77f25 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] No waiting events found dispatching network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:36.222795 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3d6e8b37-4228-4e0a-9bd7-44f794cbe9c2 req-cb5945cf-c58a-4f84-a5f6-9f2694f77f25 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:02:36.256935 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Took 26.14 seconds to build instance.
May 28 14:02:36.339598 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Instance destroyed successfully.
May 28 14:02:36.341022 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lazy-loading 'resources' on Instance uuid af52b758-781b-4980-9e1d-5cb5924eee22 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:36.394292 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.444921 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:36.445085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:36.445260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:36.446086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:36.446086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:36.449686 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Terminating instance
May 28 14:02:36.648025 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270456a2-fa10-4853-9e6f-0b7c94cda266 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.405s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:36.690294 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:36.693108 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:36.693376 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:36.700041 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:02:36.700764 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Claim successful on node np0000001643
May 28 14:02:36.706129 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:36.765345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0d976123-0621-4653-b972-037645586dfb tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.660s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:36.848798 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-389486882',display_name='tempest-AttachSCSIVolumeTestJSON-server-389486882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachscsivolumetestjson-server-389486882',id=3,image_ref='316e6a5d-83ed-4422-87b4-30badb1c9930',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtkvWaiZIq6LTOp6Gsz1I77N3P5UWkcFTkEV0AHtyFEQnGT5hintB6L+vg6Cyi1fPO7nJ9fZEGmIXsFyhgy+oVXAS5togWbiW/MVapP5bdmQt436BI98zod/3DK9PoJBQ==',key_name='tempest-keypair-237655966',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:36Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19f245e8060643a4a760a0d26845e019',ramdisk_id='',reservation_id='r-58emjmdw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='316e6a5d-83ed-4422-87b4-30badb1c9930',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-448475147',owner_user_name='tempest-AttachSCSIVolumeTestJSON-448475147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04df1c95329f4b4e96ae705243c3fd6a',uuid=af52b758-781b-4980-9e1d-5cb5924eee22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:02:36.851239 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Converting VIF {"id": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "address": "fa:16:3e:ae:16:a4", "network": {"id": "fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-461830103-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19f245e8060643a4a760a0d26845e019", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffb73f5-b4", "ovs_interfaceid": "5ffb73f5-b443-4237-982b-9b6e2ee5aa36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:36.852183 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:16:a4,bridge_name='br-int',has_traffic_filtering=True,id=5ffb73f5-b443-4237-982b-9b6e2ee5aa36,network=Network(fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffb73f5-b4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:36.854027 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:16:a4,bridge_name='br-int',has_traffic_filtering=True,id=5ffb73f5-b443-4237-982b-9b6e2ee5aa36,network=Network(fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffb73f5-b4') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:02:36.854218 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.854425 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ffb73f5-b4, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:36.867945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.870866 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:36.877477 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.881728 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.882020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4360d373-2de6-444c-98fb-91ea1f40ff5f) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:36.882932 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.883719 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:36.892828 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.895936 np0000001643 nova-compute[98269]: INFO os_vif [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:16:a4,bridge_name='br-int',has_traffic_filtering=True,id=5ffb73f5-b443-4237-982b-9b6e2ee5aa36,network=Network(fefdcd34-e4f7-4ce9-a95e-4eb6f1d42bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffb73f5-b4')
May 28 14:02:36.896390 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Deleting instance files /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22_del
May 28 14:02:36.897395 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Deletion of /opt/stack/data/nova/instances/af52b758-781b-4980-9e1d-5cb5924eee22_del complete
May 28 14:02:36.953719 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:02:36.993859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:36.999388 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.020099 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.037492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.070219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.216719 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.996318947999953 future=<Future at 0x71a75c30b350 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:37.218865 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.993694498999957 future=<Future at 0x71a75c30b350 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:37.218998 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99349499899995 future=<Future at 0x71a75c30b350 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:37.278774 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ece2ee4f-9a5f-4b27-9be7-0924e365682d req-be15b7a2-40e5-48ba-a4cd-acb972569b01 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-vif-unplugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:37.278774 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ece2ee4f-9a5f-4b27-9be7-0924e365682d req-be15b7a2-40e5-48ba-a4cd-acb972569b01 service nova] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:37.278774 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ece2ee4f-9a5f-4b27-9be7-0924e365682d req-be15b7a2-40e5-48ba-a4cd-acb972569b01 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:37.278774 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ece2ee4f-9a5f-4b27-9be7-0924e365682d req-be15b7a2-40e5-48ba-a4cd-acb972569b01 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:37.278774 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ece2ee4f-9a5f-4b27-9be7-0924e365682d req-be15b7a2-40e5-48ba-a4cd-acb972569b01 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] No waiting events found dispatching network-vif-unplugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:37.278774 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ece2ee4f-9a5f-4b27-9be7-0924e365682d req-be15b7a2-40e5-48ba-a4cd-acb972569b01 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-vif-unplugged-42b51fb3-cbd7-4828-8620-124136ac1391 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:02:37.289565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.312354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.319655 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999621950999881 future=<Future at 0x71a7804b41d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:37.321958 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Instance destroyed successfully.
May 28 14:02:37.323079 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lazy-loading 'resources' on Instance uuid 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:37.410397 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 14:02:37.412972 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:02:37.414782 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:02:37.414782 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:02:37.414782 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:37.504519 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:37.684250 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:37.684565 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:37.684679 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No VIF found with MAC fa:16:3e:1f:75:34, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:37.685180 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Using config drive
May 28 14:02:37.828479 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1205548759',display_name='tempest-VolumesAssistedSnapshotsTest-server-1205548759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesassistedsnapshotstest-server-1205548759',id=5,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuktH9yNPc5v5+7EamfRlN6xcOEgp5iSIefF4v4QiQJLw62Kq3qWOuL4zBgwj5gPnzA7UaCn88e2VwrAM+/vvjo/9xMaSaHXHbfbyb/Wh6ZtQHx9SsI0tgJtR1+QSe6Ng==',key_name='tempest-keypair-643212401',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:32Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba104c9114f447d390a20808c754f519',ramdisk_id='',reservation_id='r-kznumsyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1574201677',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1574201677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f09ed5266ee9487f837a6d029481f8a2',uuid=5a5e8316-ba70-4c95-b9d8-30fdac3f8bca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:02:37.828479 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Converting VIF {"id": "42b51fb3-cbd7-4828-8620-124136ac1391", "address": "fa:16:3e:c7:c2:75", "network": {"id": "febe37ed-4d4c-4129-b4e8-3d943cea631a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-29040301-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba104c9114f447d390a20808c754f519", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b51fb3-cb", "ovs_interfaceid": "42b51fb3-cbd7-4828-8620-124136ac1391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:37.828479 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=42b51fb3-cbd7-4828-8620-124136ac1391,network=Network(febe37ed-4d4c-4129-b4e8-3d943cea631a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b51fb3-cb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:37.828479 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=42b51fb3-cbd7-4828-8620-124136ac1391,network=Network(febe37ed-4d4c-4129-b4e8-3d943cea631a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b51fb3-cb') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:02:37.828479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.828479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42b51fb3-cb, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:37.832511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.833341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:37.842195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.843286 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.843491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c7a0775-0593-4e57-bf41-362fddd18e58) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:37.844822 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.845486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:37.852658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:37.860546 np0000001643 nova-compute[98269]: INFO os_vif [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=42b51fb3-cbd7-4828-8620-124136ac1391,network=Network(febe37ed-4d4c-4129-b4e8-3d943cea631a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b51fb3-cb')
May 28 14:02:37.860955 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Deleting instance files /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca_del
May 28 14:02:37.862843 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Deletion of /opt/stack/data/nova/instances/5a5e8316-ba70-4c95-b9d8-30fdac3f8bca_del complete
May 28 14:02:38.194300 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:38.378300 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 14:02:38.379509 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:02:38.380043 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:02:38.380253 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:02:38.380561 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:38.400640 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Creating config drive at /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk.config
May 28 14:02:38.411111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj1lzvw0h {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:38.452749 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9c09346d-11d4-431c-b3bf-50208b3790bb req-09f45dda-d389-4b3a-be8d-0df567de9b33 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:38.453515 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9c09346d-11d4-431c-b3bf-50208b3790bb req-09f45dda-d389-4b3a-be8d-0df567de9b33 service nova] Acquiring lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:38.453808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9c09346d-11d4-431c-b3bf-50208b3790bb req-09f45dda-d389-4b3a-be8d-0df567de9b33 service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:38.453977 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9c09346d-11d4-431c-b3bf-50208b3790bb req-09f45dda-d389-4b3a-be8d-0df567de9b33 service nova] Lock "af52b758-781b-4980-9e1d-5cb5924eee22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:38.454175 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9c09346d-11d4-431c-b3bf-50208b3790bb req-09f45dda-d389-4b3a-be8d-0df567de9b33 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] No waiting events found dispatching network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:38.454342 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9c09346d-11d4-431c-b3bf-50208b3790bb req-09f45dda-d389-4b3a-be8d-0df567de9b33 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-unplugged-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:02:38.474840 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj1lzvw0h" returned: 0 in 0.064s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:38.654779 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:38.738490 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:38.738490 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:39.128644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:39.153327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:39.182743 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:39.188753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:39.242214 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:39.304076 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:39.331835 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:39.405478 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-be5dab07-d1bd-49e2-85e6-2d758a6353da req-46d8503f-51b9-4430-8a83-34634ed622f5 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-vif-unplugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:39.408528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be5dab07-d1bd-49e2-85e6-2d758a6353da req-46d8503f-51b9-4430-8a83-34634ed622f5 service nova] Acquiring lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:39.408528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be5dab07-d1bd-49e2-85e6-2d758a6353da req-46d8503f-51b9-4430-8a83-34634ed622f5 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:39.408528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be5dab07-d1bd-49e2-85e6-2d758a6353da req-46d8503f-51b9-4430-8a83-34634ed622f5 service nova] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:39.408528 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-be5dab07-d1bd-49e2-85e6-2d758a6353da req-46d8503f-51b9-4430-8a83-34634ed622f5 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] No waiting events found dispatching network-vif-unplugged-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:39.408528 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-be5dab07-d1bd-49e2-85e6-2d758a6353da req-46d8503f-51b9-4430-8a83-34634ed622f5 service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-vif-unplugged-42b51fb3-cbd7-4828-8620-124136ac1391 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:02:39.427634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:39.428939 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:39.478420 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Rescuing
May 28 14:02:39.478701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:39.478893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:39.479109 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:39.749431 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.056s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:39.749897 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:02:39.834198 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Took 2.42 seconds to deallocate network for instance.
May 28 14:02:39.893524 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:39.982617 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:40.178674 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:40.179212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:40.211399 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976960.2109425, 0c097fdc-e6f1-462e-b9de-72a07928e53a => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:40.211838 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] VM Started (Lifecycle Event)
May 28 14:02:40.258129 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:02:40.258129 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:02:40.258129 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:40.258824 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:40.341742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:40.342418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:40.374568 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3deb2050ffd5441bb38c08eb82707d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bfe2941b78c4f2e9f16f60e05ec5dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:02:40.396633 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Took 2.02 seconds to deallocate network for instance.
May 28 14:02:40.416328 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:40.524358 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Received event network-vif-deleted-5ffb73f5-b443-4237-982b-9b6e2ee5aa36 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:40.524813 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Received event network-vif-plugged-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:40.525140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] Acquiring lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:40.525140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:40.525251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:40.525532 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Processing event network-vif-plugged-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:40.525532 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Received event network-vif-plugged-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:40.525938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] Acquiring lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:40.525938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:40.525938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:40.526054 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] No waiting events found dispatching network-vif-plugged-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:40.526780 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:02:40.526979 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a0990893-7b1c-4908-b92e-1fefb3ed7669 req-c3727a08-5840-4742-a80e-ca2ddc48f0a0 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Received unexpected event network-vif-plugged-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee for instance with vm_state building and task_state spawning.
May 28 14:02:40.536198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:02:40.543976 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Instance spawned successfully.
May 28 14:02:40.544326 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:02:40.644057 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Updating instance_info_cache with network_info: [{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:40.684144 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Detaching volume 47ada01c-ff15-4a17-bf9d-f88b0e92d0dc
May 28 14:02:40.714487 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:40.718691 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:40.752079 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Attempting to driver detach volume 47ada01c-ff15-4a17-bf9d-f88b0e92d0dc from mountpoint /dev/vdb
May 28 14:02:40.758271 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Found disk vdb by alias ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:02:40.761049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Found disk vdb by alias ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:02:40.761049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Attempting to detach device vdb from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:02:40.761049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:02:40.761049 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:40.761049 np0000001643 nova-compute[98269]:   <alias name="ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc"/>
May 28 14:02:40.761049 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-9"/>
May 28 14:02:40.761049 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:02:40.761049 np0000001643 nova-compute[98269]:   <serial>47ada01c-ff15-4a17-bf9d-f88b0e92d0dc</serial>
May 28 14:02:40.761049 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:02:40.761049 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:40.761049 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:40.762675 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:02:40.770380 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully detached device vdb from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the persistent domain config.
May 28 14:02:40.770560 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] (1/8): Attempting to detach device vdb with device alias ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:02:40.776275 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:02:40.776275 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:40.776275 np0000001643 nova-compute[98269]:   <alias name="ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc"/>
May 28 14:02:40.776275 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-9"/>
May 28 14:02:40.776275 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:02:40.776275 np0000001643 nova-compute[98269]:   <serial>47ada01c-ff15-4a17-bf9d-f88b0e92d0dc</serial>
May 28 14:02:40.776275 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:02:40.776275 np0000001643 nova-compute[98269]: </disk>
May 28 14:02:40.776275 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:40.907396 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:41.059481 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:41.059481 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:41.059481 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:41.059811 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:41.062575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:41.064519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:41.106314 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Successfully created port: 441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:02:41.147433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:41.222638 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:02:41.223023 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976961.22272, 0c097fdc-e6f1-462e-b9de-72a07928e53a => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:41.223093 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] VM Paused (Lifecycle Event)
May 28 14:02:41.269847 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:02:41.318982 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:41.319272 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:41.441518 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc for instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:02:41.480301 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-19451409-38bf-4c7e-8854-dbce414af815 req-b4d46ffc-37d7-432f-90f8-970da7b0b6fc service nova] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Received event network-vif-deleted-42b51fb3-cbd7-4828-8620-124136ac1391 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:41.572844 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Took 8.60 seconds to spawn the instance on the hypervisor.
May 28 14:02:41.572844 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:41.727695 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:41.729252 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976961.728903, 0c097fdc-e6f1-462e-b9de-72a07928e53a => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:41.729406 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] VM Resumed (Lifecycle Event)
May 28 14:02:41.823621 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:41.835363 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Successfully updated port: 441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:02:41.889322 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:41.889529 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing instance network info cache due to event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:41.889699 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] Acquiring lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:41.889826 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] Acquired lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:41.889960 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing network info cache for port 441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:42.028523 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:02:42.087167 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Took 14.53 seconds to build instance.
May 28 14:02:42.233226 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:42.235285 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:42.284717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:02:42.286412 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:02:42.286799 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Creating image(s)
May 28 14:02:42.287401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:42.287622 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:42.288208 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:42.288908 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:42.293133 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:42.294340 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:42.344188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:42.347372 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.440s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:42.351785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:42.390525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:42.390525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:42.390739 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:42.393341 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:42.399037 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:42.403144 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:42.408698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:42.495484 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Deleted allocations for instance af52b758-781b-4980-9e1d-5cb5924eee22
May 28 14:02:42.547098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.139s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:42.548658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:42.552565 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:02:42.591357 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.058s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:42.618619 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk 1073741824" returned: 0 in 0.070s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:42.618920 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:42.619345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:42.725356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:42.725948 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:02:42.726474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:42.748069 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779976962.7455616, 0c96a33a-84dd-4c95-82b3-94a6251e5404 => ua-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:02:42.758873 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully detached device vdb from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the live domain config.
May 28 14:02:42.761974 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:02:42.762588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:42.763205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:42.766086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:42.766086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:02:42.766086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:42.805231 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '9')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:02:42.805231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '20')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:02:42.811415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc', '19')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:02:42.811415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c301b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc'): ({'sdp'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:02:42.811415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Removing multipathed devices sdp, sdq {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:02:42.811415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Flush multipath device 3300000006f2b45f8 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:02:42.816670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:42.818316 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Cannot resize image /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:02:42.818316 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:02:42.818316 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Ensure instance console log exists: /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:02:42.818316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:42.818316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:42.818316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:42.847418 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:42.849346 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:42.851715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:02:42.888270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:02:42.909720 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:42.931341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:42.932056 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:02:42.932743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:02:42.934297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:02:42.950128 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:02:42.950278 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:02:42.969745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:43.017320 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.40.100,3260]
May 28 14:02:43.017320 np0000001643 nova-compute[98269]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.40.100,3260] successful.
May 28 14:02:43.017320 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:43.048782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:43.066842 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:43.118075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.50.100,3260]
May 28 14:02:43.118075 np0000001643 nova-compute[98269]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-47ada01c-ff15-4a17-bf9d-f88b0e92d0dc, portal: 192.168.50.100,3260] successful.
May 28 14:02:43.118075 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:43.144840 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:43.154478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:43.154478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:43.154478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] <== disconnect_volume: return (391ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:43.154478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:02:43.157165 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:43.223387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:43.237104 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:43.255912 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999566407999964 future=<Future at 0x71a75c34a600 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:43.258299 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance destroyed successfully.
May 28 14:02:43.258762 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'numa_topology' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:43.305898 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:43.305898 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:43.350758 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a98b4424-cddc-45db-aa2b-7fa3f618cc17 req-44ad5968-b8fe-4a36-9ca8-5ea743a5319d service nova] Releasing lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:43.351391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:43.351700 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:43.512616 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29bb1be3-7cc5-442b-9d6b-269eb0c32e8a tempest-AttachSCSIVolumeTestJSON-448475147 tempest-AttachSCSIVolumeTestJSON-448475147-project-member] Lock "af52b758-781b-4980-9e1d-5cb5924eee22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.058s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:43.739684 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'flavor' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:43.768570 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Attempting a stable device rescue
May 28 14:02:43.810000 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:43.930106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 14:02:43.935637 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:02:43.935801 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Creating image(s)
May 28 14:02:43.936510 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:43.936719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:43.937315 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:43.938252 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'trusted_certs' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:43.975044 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:02:43.981530 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:43.982584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:43.982584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:43.982584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:43.982584 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:43.982777 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state active and task_state rescuing.
May 28 14:02:43.983003 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:43.983237 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:43.983467 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:43.983592 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:43.983923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:43.983923 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state active and task_state rescuing.
May 28 14:02:43.984122 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Received event network-changed-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:43.984533 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Refreshing instance network info cache due to event network-changed-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:43.984746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Acquiring lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:43.984746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Acquired lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:43.985366 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Refreshing network info cache for port ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:44.131160 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:44.213909 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:44.325477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.978s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:44.412428 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Deleted allocations for instance 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca
May 28 14:02:44.428131 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:44.442733 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:44.443052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:44.443422 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:44.487877 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:44.509779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "interface-0c96a33a-84dd-4c95-82b3-94a6251e5404-0391cf13-9163-4dad-951b-e7158fd8630a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:44.510098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "interface-0c96a33a-84dd-4c95-82b3-94a6251e5404-0391cf13-9163-4dad-951b-e7158fd8630a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:44.876076 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:44.934429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:44.934646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance network_info: |[{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:02:44.937893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Start _get_guest_xml network_info=[{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:02:44.941568 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:44.942938 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1960360925', uuid='4dc73d91-4d87-4283-9a77-607c0e512265'), owner=OwnerMeta(userid='3deb2050ffd5441bb38c08eb82707d7d', username='tempest-ServerRescueNegativeTestJSON-1154493123-project-member', projectid='9bfe2941b78c4f2e9f16f60e05ec5dcc', projectname='tempest-ServerRescueNegativeTestJSON-1154493123'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976964.9425256) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:44.944696 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:02:44.945391 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:02:44.951720 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:02:44.952167 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:02:44.954081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:02:44.954325 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:02:44.954525 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:02:44.954638 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:02:44.955248 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:02:44.955351 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:02:44.955490 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:02:44.955660 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:02:44.955774 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:02:44.955888 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:02:44.956020 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:02:44.956234 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:02:44.976576 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1960360925',display_name='tempest-ServerRescueNegativeTestJSON-server-1960360925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-1960360925',id=13,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPY7gcyM15HNMgUUrWL0PnUGvfKERrlJnRdaJjn6fmYO1DMIBfebiD81LEUfKQS34wQzehV/k1KDg8WmREMFPeUgC7522BiSxNEo2YvLvOoa2G23jVYDsxb/94YmFCZRw==',key_name='tempest-keypair-462257235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-3jxixxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=4dc73d91-4d87-4283-9a77-607c0e512265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:44.976832 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:44.977803 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:44.978301 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:45.019011 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'flavor' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:45.052268 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Updated VIF entry in instance network info cache for port ded2b2d9-d0ce-4f7f-a72d-3494805a7cee. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:02:45.053018 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Updating instance_info_cache with network_info: [{"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:45.259660 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-255aced2-8c3e-49dd-945c-bb767e8dc6f0 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.080s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:45.421916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3cb80af2-4e72-425d-bcd8-149a6616d23a tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Lock "5a5e8316-ba70-4c95-b9d8-30fdac3f8bca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.977s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:45.482590 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <uuid>4dc73d91-4d87-4283-9a77-607c0e512265</uuid>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <name>instance-0000000d</name>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1960360925</nova:name>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:02:44</nova:creationTime>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:user uuid="3deb2050ffd5441bb38c08eb82707d7d">tempest-ServerRescueNegativeTestJSON-1154493123-project-member</nova:user>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:project uuid="9bfe2941b78c4f2e9f16f60e05ec5dcc">tempest-ServerRescueNegativeTestJSON-1154493123</nova:project>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         <nova:port uuid="441edb5a-a183-4686-ad86-714a3ab59d5f">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <entry name="serial">4dc73d91-4d87-4283-9a77-607c0e512265</entry>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <entry name="uuid">4dc73d91-4d87-4283-9a77-607c0e512265</entry>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:1a:79:0d"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <target dev="tap441edb5a-a1"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/console.log" append="off"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:45.482590 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:45.486385 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Preparing to wait for external event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:02:45.486385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:45.486385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:45.486385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:45.486385 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1960360925',display_name='tempest-ServerRescueNegativeTestJSON-server-1960360925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-1960360925',id=13,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPY7gcyM15HNMgUUrWL0PnUGvfKERrlJnRdaJjn6fmYO1DMIBfebiD81LEUfKQS34wQzehV/k1KDg8WmREMFPeUgC7522BiSxNEo2YvLvOoa2G23jVYDsxb/94YmFCZRw==',key_name='tempest-keypair-462257235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-3jxixxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=4dc73d91-4d87-4283-9a77-607c0e512265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:02:45.486385 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:45.486385 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:45.487396 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:02:45.487396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:45.487548 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:45.487825 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:45.489217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:45.489400 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afb2a7d9-d8cb-5e16-ae27-9d4beec3d6f9', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:45.493492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:45.496418 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:45.501406 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:45.505437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:45.505684 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap441edb5a-a1, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:45.506172 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap441edb5a-a1, col_values=(('qos', UUID('9f44400c-e3a5-491d-978a-7a7a2b087411')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:45.506417 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap441edb5a-a1, col_values=(('external_ids', {'iface-id': '441edb5a-a183-4686-ad86-714a3ab59d5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:79:0d', 'vm-uuid': '4dc73d91-4d87-4283-9a77-607c0e512265'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:45.510350 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:45.521537 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:45.523870 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:31Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:45.524116 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converting VIF {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:45.524674 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:45.526218 np0000001643 nova-compute[98269]: INFO os_vif [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1')
May 28 14:02:45.528216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface> {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 14:02:45.533580 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface> {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 14:02:45.536820 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Attempting to detach device tap0391cf13-91 from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:02:45.537701 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] detach device xml: <interface type="ethernet">
May 28 14:02:45.537701 np0000001643 nova-compute[98269]:   <mac address="fa:16:3e:36:29:7d"/>
May 28 14:02:45.537701 np0000001643 nova-compute[98269]:   <model type="virtio"/>
May 28 14:02:45.537701 np0000001643 nova-compute[98269]:   <driver name="qemu"/>
May 28 14:02:45.537701 np0000001643 nova-compute[98269]:   <mtu size="1372"/>
May 28 14:02:45.537701 np0000001643 nova-compute[98269]:   <target dev="tap0391cf13-91"/>
May 28 14:02:45.537701 np0000001643 nova-compute[98269]: </interface>
May 28 14:02:45.537701 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:45.542379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface> {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 14:02:45.546186 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <name>instance-00000004</name>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <uuid>0c96a33a-84dd-4c95-82b3-94a6251e5404</uuid>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:package version="33.1.0"/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:creationTime>2026-05-28 14:02:21</nova:creationTime>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:flavor name="m1.nano" id="42">
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:memory>192</nova:memory>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:disk>1</nova:disk>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:swap>0</nova:swap>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:vcpus>1</nova:vcpus>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:extraSpecs>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </nova:extraSpecs>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </nova:flavor>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:minDisk>1</nova:minDisk>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:minRam>0</nova:minRam>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:properties>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </nova:properties>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </nova:image>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:owner>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </nova:owner>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <nova:ports>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <nova:port uuid="0391cf13-9163-4dad-951b-e7158fd8630a">
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.10.10.86" ipVersion="4"/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </nova:ports>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]: </nova:instance>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <memory unit='KiB'>196608</memory>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <vcpu placement='static'>1</vcpu>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <resource>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <partition>/machine</partition>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </resource>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <sysinfo type='smbios'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <entry name='product'>OpenStack Nova</entry>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <entry name='version'>33.1.0</entry>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <entry name='serial'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <entry name='uuid'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <entry name='family'>Virtual Machine</entry>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <boot dev='hd'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <smbios mode='sysinfo'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <vmcoreinfo state='on'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <cpu mode='custom' match='exact' check='full'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <model fallback='forbid'>Nehalem</model>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <feature policy='require' name='hypervisor'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <clock offset='utc'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <on_poweroff>destroy</on_poweroff>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <on_reboot>restart</on_reboot>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <on_crash>destroy</on_crash>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <disk type='file' device='disk'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk' index='2'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <backingStore type='file' index='3'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:         <format type='raw'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:         <source file='/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:         <backingStore/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       </backingStore>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <target dev='vda' bus='virtio'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='virtio-disk0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <disk type='file' device='cdrom'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <driver name='qemu' type='raw' cache='none'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config' index='1'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <backingStore/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <target dev='hda' bus='ide'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <readonly/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='ide0-0-0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <controller type='usb' index='0' model='none'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='usb'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <controller type='pci' index='0' model='pci-root'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='pci.0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <controller type='ide' index='0'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='ide'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <interface type='ethernet'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <mac address='fa:16:3e:46:1d:78'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <target dev='tap830e8040-3d'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <model type='virtio'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <driver name='qemu'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <mtu size='1372'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='net0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <interface type='ethernet'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <mac address='fa:16:3e:36:29:7d'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <target dev='tap0391cf13-91'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <model type='virtio'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <driver name='qemu'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <mtu size='1372'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='net1'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <serial type='pty'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <target type='isa-serial' port='0'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:         <model name='isa-serial'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       </target>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <console type='pty' tty='/dev/pts/3'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <target type='serial' port='0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </console>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <input type='mouse' bus='ps2'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='input0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <input type='keyboard' bus='ps2'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='input1'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <listen type='address' address='0.0.0.0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </graphics>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <audio id='1' type='none'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <model type='virtio' heads='1' primary='yes'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='video0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <stats period='10'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='balloon0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <rng model='virtio'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <backend model='random'>/dev/urandom</backend>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <alias name='rng0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <label>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</label>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <imagelabel>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</imagelabel>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <label>+64055:+993</label>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:     <imagelabel>+64055:+993</imagelabel>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:45.546186 np0000001643 nova-compute[98269]:  {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 14:02:45.555397 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully detached device tap0391cf13-91 from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the persistent domain config.
May 28 14:02:45.555397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] (1/8): Attempting to detach device tap0391cf13-91 with device alias net1 from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:02:45.555397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] detach device xml: <interface type="ethernet">
May 28 14:02:45.555397 np0000001643 nova-compute[98269]:   <mac address="fa:16:3e:36:29:7d"/>
May 28 14:02:45.555397 np0000001643 nova-compute[98269]:   <model type="virtio"/>
May 28 14:02:45.555397 np0000001643 nova-compute[98269]:   <driver name="qemu"/>
May 28 14:02:45.555397 np0000001643 nova-compute[98269]:   <mtu size="1372"/>
May 28 14:02:45.555397 np0000001643 nova-compute[98269]:   <target dev="tap0391cf13-91"/>
May 28 14:02:45.555397 np0000001643 nova-compute[98269]: </interface>
May 28 14:02:45.555397 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:02:45.557722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a122d5ac-ee30-4ffd-807d-824116b146a8 req-3bd93207-163a-4ccf-8e6e-b86135392b18 service nova] Releasing lock "refresh_cache-0c097fdc-e6f1-462e-b9de-72a07928e53a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:45.663891 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:45.668002 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:45.668427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:45.757822 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.part --force-share --output=json" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:45.758630 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] e78198f6-9deb-4e59-b98f-aa6f76e79fad was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:02:45.759216 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:02:45.759609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.part /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:45.842053 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.part /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.converted" returned: 0 in 0.082s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:45.847855 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:45.925305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b.converted --force-share --output=json" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:45.926724 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.483s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:45.927354 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:45.932403 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:45.933934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:45.934461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:45.934842 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:45.939273 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:02:45.939868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:46.042145 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:46.043000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b,backing_fmt=raw /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.rescue {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:46.108736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b,backing_fmt=raw /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.rescue" returned: 0 in 0.065s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:46.109459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:46.109873 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'migration_context' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:46.613174 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:46.613850 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:02:46.616893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Start _get_guest_xml network_info=[{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:22:8d:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e78198f6-9deb-4e59-b98f-aa6f76e79fad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '45f6e68c-8788-4c3f-b3ee-ac3203ef5414', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, 'status': 'reserved', 'instance': '033c2245-10fc-4568-a15f-3b39ee5258ae', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'serial': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:02:46.617242 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'resources' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:46.700259 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779976966.6993191, 0c96a33a-84dd-4c95-82b3-94a6251e5404 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:02:46.703246 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Start waiting for the detach event from libvirt for device tap0391cf13-91 with device alias net1 for instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:02:46.703246 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface> {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 14:02:46.707301 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <name>instance-00000004</name>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <uuid>0c96a33a-84dd-4c95-82b3-94a6251e5404</uuid>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:package version="33.1.0"/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:creationTime>2026-05-28 14:02:21</nova:creationTime>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:flavor name="m1.nano" id="42">
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:memory>192</nova:memory>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:disk>1</nova:disk>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:swap>0</nova:swap>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:vcpus>1</nova:vcpus>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:extraSpecs>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </nova:extraSpecs>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </nova:flavor>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:minDisk>1</nova:minDisk>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:minRam>0</nova:minRam>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:properties>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </nova:properties>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </nova:image>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:owner>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </nova:owner>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <nova:ports>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <nova:port uuid="0391cf13-9163-4dad-951b-e7158fd8630a">
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.10.10.86" ipVersion="4"/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </nova:ports>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]: </nova:instance>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <memory unit='KiB'>196608</memory>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <vcpu placement='static'>1</vcpu>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <resource>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <partition>/machine</partition>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </resource>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <sysinfo type='smbios'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <entry name='product'>OpenStack Nova</entry>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <entry name='version'>33.1.0</entry>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <entry name='serial'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <entry name='uuid'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <entry name='family'>Virtual Machine</entry>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <boot dev='hd'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <smbios mode='sysinfo'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <vmcoreinfo state='on'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <cpu mode='custom' match='exact' check='full'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <model fallback='forbid'>Nehalem</model>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <feature policy='require' name='hypervisor'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <clock offset='utc'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <on_poweroff>destroy</on_poweroff>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <on_reboot>restart</on_reboot>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <on_crash>destroy</on_crash>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <disk type='file' device='disk'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk' index='2'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <backingStore type='file' index='3'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:         <format type='raw'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:         <source file='/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:         <backingStore/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       </backingStore>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <target dev='vda' bus='virtio'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='virtio-disk0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <disk type='file' device='cdrom'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <driver name='qemu' type='raw' cache='none'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config' index='1'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <backingStore/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <target dev='hda' bus='ide'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <readonly/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='ide0-0-0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <controller type='usb' index='0' model='none'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='usb'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <controller type='pci' index='0' model='pci-root'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='pci.0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <controller type='ide' index='0'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='ide'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <interface type='ethernet'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <mac address='fa:16:3e:46:1d:78'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <target dev='tap830e8040-3d'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <model type='virtio'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <driver name='qemu'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <mtu size='1372'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='net0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <serial type='pty'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <target type='isa-serial' port='0'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:         <model name='isa-serial'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       </target>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <console type='pty' tty='/dev/pts/3'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <target type='serial' port='0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </console>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <input type='mouse' bus='ps2'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='input0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <input type='keyboard' bus='ps2'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='input1'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <listen type='address' address='0.0.0.0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </graphics>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <audio id='1' type='none'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <model type='virtio' heads='1' primary='yes'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='video0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <stats period='10'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='balloon0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <rng model='virtio'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <backend model='random'>/dev/urandom</backend>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <alias name='rng0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <label>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</label>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <imagelabel>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</imagelabel>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <label>+64055:+993</label>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:     <imagelabel>+64055:+993</imagelabel>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:46.707301 np0000001643 nova-compute[98269]:  {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 14:02:46.712757 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully detached device tap0391cf13-91 from instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 from the live domain config.
May 28 14:02:46.712757 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:31Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:02:46.712757 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converting VIF {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:46.712757 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:46.712757 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:02:46.713704 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.713704 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0391cf13-91, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:46.716390 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.717559 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:46.754527 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.758037 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.783185 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.791577 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.794429 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.794749 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab44cae9-8114-4bbe-b021-765a70702b7a) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:46.797568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.797964 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:46.830039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:46.834333 np0000001643 nova-compute[98269]: INFO os_vif [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91')
May 28 14:02:46.837545 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1214174567', uuid='0c96a33a-84dd-4c95-82b3-94a6251e5404'), owner=OwnerMeta(userid='d7f2227d939749fba2d87d475eced3ad', username='tempest-TaggedAttachmentsTest-1796593045-project-member', projectid='8f26c4eed05b4d6787812ac3fb0c7803', projectname='tempest-TaggedAttachmentsTest-1796593045'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976966.8360062) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:46.837807 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:package version="33.1.0"/>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:creationTime>2026-05-28 14:02:46</nova:creationTime>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:flavor name="m1.nano" id="42">
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:memory>192</nova:memory>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:disk>1</nova:disk>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:swap>0</nova:swap>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:vcpus>1</nova:vcpus>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:extraSpecs>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     </nova:extraSpecs>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   </nova:flavor>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:minDisk>1</nova:minDisk>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:minRam>0</nova:minRam>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:properties>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     </nova:properties>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   </nova:image>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:owner>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   </nova:owner>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   <nova:ports>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:   </nova:ports>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]: </nova:instance>
May 28 14:02:46.837807 np0000001643 nova-compute[98269]:  {{(pid=98269) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 14:02:46.840993 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:46.840993 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:47.051487 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:47.051677 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:47.051873 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No VIF found with MAC fa:16:3e:1a:79:0d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:47.053775 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Using config drive
May 28 14:02:47.120014 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:47.125086 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:02:47.127280 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-137732219', uuid='033c2245-10fc-4568-a15f-3b39ee5258ae'), owner=OwnerMeta(userid='86dc22a5d6a7478dab81969f17d3daab', username='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member', projectid='b74df57519ea42009fcebcff7cfdf94e', projectname='tempest-ServerBootFromVolumeStableRescueTest-241739491'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:22:8d:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976967.1263187) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:47.131161 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:02:47.131161 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:02:47.134671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:02:47.134967 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:02:47.136311 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:02:47.136735 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:02:47.136876 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:02:47.137481 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:02:47.137481 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:02:47.137481 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:02:47.137872 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:02:47.138008 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:02:47.138901 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:02:47.138901 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:02:47.139343 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:02:47.139683 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:02:47.139920 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'vcpu_model' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:47.343046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cd66a178-600a-4041-89cb-79d5014b6340 req-0a5928e3-f7b4-4d78-9787-670c177ed63b service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-unplugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:47.343170 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd66a178-600a-4041-89cb-79d5014b6340 req-0a5928e3-f7b4-4d78-9787-670c177ed63b service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:47.350627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd66a178-600a-4041-89cb-79d5014b6340 req-0a5928e3-f7b4-4d78-9787-670c177ed63b service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:47.350627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd66a178-600a-4041-89cb-79d5014b6340 req-0a5928e3-f7b4-4d78-9787-670c177ed63b service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:47.350627 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cd66a178-600a-4041-89cb-79d5014b6340 req-0a5928e3-f7b4-4d78-9787-670c177ed63b service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No waiting events found dispatching network-vif-unplugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:47.350627 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-cd66a178-600a-4041-89cb-79d5014b6340 req-0a5928e3-f7b4-4d78-9787-670c177ed63b service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received unexpected event network-vif-unplugged-0391cf13-9163-4dad-951b-e7158fd8630a for instance with vm_state active and task_state None.
May 28 14:02:47.565726 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:47.644289 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:47.662382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:47.776807 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:47.777941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:47.777941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:47.778745 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:47.779386 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:02:47.779993 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:02:47.780381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:47.780898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:47.781327 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:02:47.793765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:47.794267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:02:47.794911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:47.795134 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:02:47.795436 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:02:47.798071 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:47.808489 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:47.808489 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:02:47.819776 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:02:47.819776 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:47.827942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:47.847839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.856559 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.858313 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:47.858313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:47.859853 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('20', '0', '0', 0) found on session 18 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:47.860185 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:47.869880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 18 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:47.869880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.872674 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:02:47.872887 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:02:47.873096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.078s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:47.873157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:02:47.873752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('19', '0', '0', 0) found on session 17 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:02:47.873850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:02:47.885665 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 17 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:02:47.885855 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:02:47.967491 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Creating config drive at /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config
May 28 14:02:47.972299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptts3quou {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:48.031332 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptts3quou" returned: 0 in 0.059s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:48.504202 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:48.594468 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:48.636627 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:48.640900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:48.749487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:48.796109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:02:48.833487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:48.842810 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:48.982361 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bc04ea6b-1ee7-48e5-a70a-9428f585b0cc req-f062b442-c021-455d-b981-9136b0545555 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:48.984258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bc04ea6b-1ee7-48e5-a70a-9428f585b0cc req-f062b442-c021-455d-b981-9136b0545555 service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:48.984490 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bc04ea6b-1ee7-48e5-a70a-9428f585b0cc req-f062b442-c021-455d-b981-9136b0545555 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:48.984627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bc04ea6b-1ee7-48e5-a70a-9428f585b0cc req-f062b442-c021-455d-b981-9136b0545555 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:48.984751 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bc04ea6b-1ee7-48e5-a70a-9428f585b0cc req-f062b442-c021-455d-b981-9136b0545555 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Processing event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:02:49.027839 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:49.137247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:49.361011 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:49.361011 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquired lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:49.361011 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:49.452008 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-unplugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:49.452204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:49.452353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:49.452353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:49.452510 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No waiting events found dispatching network-vif-unplugged-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:49.452925 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received unexpected event network-vif-unplugged-0391cf13-9163-4dad-951b-e7158fd8630a for instance with vm_state active and task_state None.
May 28 14:02:49.454473 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-deleted-0391cf13-9163-4dad-951b-e7158fd8630a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:49.454666 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Neutron deleted interface 0391cf13-9163-4dad-951b-e7158fd8630a; detaching it from the instance and deleting it from the info cache
May 28 14:02:49.458275 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Lazy-loading 'system_metadata' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:49.678747 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976969.678133, 4dc73d91-4d87-4283-9a77-607c0e512265 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:49.679477 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Started (Lifecycle Event)
May 28 14:02:49.681111 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:02:49.684200 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:02:49.689707 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance spawned successfully.
May 28 14:02:49.690084 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:02:49.817423 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Found WWN 330000000e9f80fd7 for multipath device dm-8 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:02:49.818048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:02:49.818048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== connect_volume: return (2037ms) {'type': 'block', 'scsi_wwn': '330000000e9f80fd7', 'path': '/dev/dm-8', 'multipath_id': '330000000e9f80fd7'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:02:49.818222 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e9f80fd7', 'path': '/dev/dm-8', 'multipath_id': '330000000e9f80fd7'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:02:49.862957 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:49.970243 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Lazy-loading 'flavor' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:50.183471 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:50.190616 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:50.198153 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:50.201383 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:50.201852 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:50.202171 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:50.205489 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:50.209635 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:02:50.331242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-137732219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-137732219',id=11,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:35Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-9vnyws3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:36Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=033c2245-10fc-4568-a15f-3b39ee5258ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:22:8d:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:50.331551 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:22:8d:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:50.332467 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:50.333973 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'pci_devices' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:50.459315 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:50.474592 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Object Instance<0c96a33a-84dd-4c95-82b3-94a6251e5404> lazy-loaded attributes: system_metadata,flavor {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:50.475563 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:31Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001643',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:02:50.475845 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Converting VIF {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:50.476482 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:50.478727 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface> {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 14:02:50.482552 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <name>instance-00000004</name>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <uuid>0c96a33a-84dd-4c95-82b3-94a6251e5404</uuid>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:package version="33.1.0"/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:creationTime>2026-05-28 14:02:46</nova:creationTime>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:flavor name="m1.nano" id="42">
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:memory>192</nova:memory>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:disk>1</nova:disk>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:swap>0</nova:swap>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:vcpus>1</nova:vcpus>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:extraSpecs>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </nova:extraSpecs>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </nova:flavor>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:minDisk>1</nova:minDisk>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:minRam>0</nova:minRam>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:properties>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </nova:properties>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </nova:image>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:owner>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </nova:owner>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <nova:ports>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </nova:ports>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]: </nova:instance>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <memory unit='KiB'>196608</memory>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <vcpu placement='static'>1</vcpu>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <resource>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <partition>/machine</partition>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </resource>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <sysinfo type='smbios'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <entry name='product'>OpenStack Nova</entry>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <entry name='version'>33.1.0</entry>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <entry name='serial'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <entry name='uuid'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <entry name='family'>Virtual Machine</entry>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <boot dev='hd'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <smbios mode='sysinfo'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <vmcoreinfo state='on'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <cpu mode='custom' match='exact' check='full'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <model fallback='forbid'>Nehalem</model>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <feature policy='require' name='hypervisor'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <clock offset='utc'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <on_poweroff>destroy</on_poweroff>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <on_reboot>restart</on_reboot>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <on_crash>destroy</on_crash>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <disk type='file' device='disk'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk' index='2'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <backingStore type='file' index='3'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:         <format type='raw'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:         <source file='/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:         <backingStore/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       </backingStore>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <target dev='vda' bus='virtio'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='virtio-disk0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <disk type='file' device='cdrom'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <driver name='qemu' type='raw' cache='none'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config' index='1'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <backingStore/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <target dev='hda' bus='ide'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <readonly/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='ide0-0-0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <controller type='usb' index='0' model='none'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='usb'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <controller type='pci' index='0' model='pci-root'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='pci.0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <controller type='ide' index='0'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='ide'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <interface type='ethernet'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <mac address='fa:16:3e:46:1d:78'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <target dev='tap830e8040-3d'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <model type='virtio'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <driver name='qemu'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <mtu size='1372'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='net0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <serial type='pty'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <target type='isa-serial' port='0'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:         <model name='isa-serial'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       </target>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <console type='pty' tty='/dev/pts/3'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <target type='serial' port='0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </console>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <input type='mouse' bus='ps2'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='input0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <input type='keyboard' bus='ps2'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='input1'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <listen type='address' address='0.0.0.0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </graphics>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <audio id='1' type='none'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <model type='virtio' heads='1' primary='yes'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='video0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <stats period='10'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='balloon0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <rng model='virtio'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <backend model='random'>/dev/urandom</backend>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <alias name='rng0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <label>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</label>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <imagelabel>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</imagelabel>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <label>+64055:+993</label>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:     <imagelabel>+64055:+993</imagelabel>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:50.482552 np0000001643 nova-compute[98269]:  {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 14:02:50.488183 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface> {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 14:02:50.488183 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:36:29:7d"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap0391cf13-91"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <name>instance-00000004</name>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <uuid>0c96a33a-84dd-4c95-82b3-94a6251e5404</uuid>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:package version="33.1.0"/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:creationTime>2026-05-28 14:02:46</nova:creationTime>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:flavor name="m1.nano" id="42">
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:memory>192</nova:memory>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:disk>1</nova:disk>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:swap>0</nova:swap>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:vcpus>1</nova:vcpus>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:extraSpecs>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </nova:extraSpecs>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </nova:flavor>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:minDisk>1</nova:minDisk>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:minRam>0</nova:minRam>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:properties>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </nova:properties>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </nova:image>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:owner>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </nova:owner>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <nova:ports>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </nova:ports>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]: </nova:instance>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <memory unit='KiB'>196608</memory>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <vcpu placement='static'>1</vcpu>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <resource>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <partition>/machine</partition>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </resource>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <sysinfo type='smbios'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <entry name='product'>OpenStack Nova</entry>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <entry name='version'>33.1.0</entry>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <entry name='serial'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <entry name='uuid'>0c96a33a-84dd-4c95-82b3-94a6251e5404</entry>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <entry name='family'>Virtual Machine</entry>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <boot dev='hd'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <smbios mode='sysinfo'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <vmcoreinfo state='on'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <cpu mode='custom' match='exact' check='full'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <model fallback='forbid'>Nehalem</model>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <feature policy='require' name='hypervisor'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <clock offset='utc'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <on_poweroff>destroy</on_poweroff>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <on_reboot>restart</on_reboot>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <on_crash>destroy</on_crash>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <disk type='file' device='disk'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk' index='2'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <backingStore type='file' index='3'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:         <format type='raw'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:         <source file='/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:         <backingStore/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       </backingStore>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <target dev='vda' bus='virtio'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='virtio-disk0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <disk type='file' device='cdrom'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <driver name='qemu' type='raw' cache='none'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <source file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/disk.config' index='1'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <backingStore/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <target dev='hda' bus='ide'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <readonly/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='ide0-0-0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <controller type='usb' index='0' model='none'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='usb'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <controller type='pci' index='0' model='pci-root'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='pci.0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <controller type='ide' index='0'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='ide'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </controller>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <interface type='ethernet'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <mac address='fa:16:3e:46:1d:78'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <target dev='tap830e8040-3d'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <model type='virtio'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <driver name='qemu'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <mtu size='1372'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='net0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <serial type='pty'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <target type='isa-serial' port='0'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:         <model name='isa-serial'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       </target>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <console type='pty' tty='/dev/pts/3'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <source path='/dev/pts/3'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <log file='/opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404/console.log' append='off'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <target type='serial' port='0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='serial0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </console>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <input type='mouse' bus='ps2'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='input0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <input type='keyboard' bus='ps2'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='input1'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </input>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <listen type='address' address='0.0.0.0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </graphics>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <audio id='1' type='none'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <model type='virtio' heads='1' primary='yes'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='video0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <stats period='10'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='balloon0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <rng model='virtio'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <backend model='random'>/dev/urandom</backend>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <alias name='rng0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <label>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</label>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <imagelabel>libvirt-0c96a33a-84dd-4c95-82b3-94a6251e5404</imagelabel>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <label>+64055:+993</label>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:     <imagelabel>+64055:+993</imagelabel>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:   </seclabel>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:50.488183 np0000001643 nova-compute[98269]:  {{(pid=98269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 14:02:50.488183 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Detaching interface fa:16:3e:36:29:7d failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0391cf13-91' not found.
May 28 14:02:50.488183 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:31Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001643',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:02:50.488183 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Converting VIF {"id": "0391cf13-9163-4dad-951b-e7158fd8630a", "address": "fa:16:3e:36:29:7d", "network": {"id": "0aa284f4-c1bb-4f88-8add-44258315ad68", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1733462941", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0391cf13-91", "ovs_interfaceid": "0391cf13-9163-4dad-951b-e7158fd8630a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:50.492437 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:50.492437 np0000001643 nova-compute[98269]: DEBUG os_vif [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:02:50.492437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:50.493137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0391cf13-91, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:50.493137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:02:50.497511 np0000001643 nova-compute[98269]: INFO os_vif [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=0391cf13-9163-4dad-951b-e7158fd8630a,network=Network(0aa284f4-c1bb-4f88-8add-44258315ad68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0391cf13-91')
May 28 14:02:50.498608 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1214174567', uuid='0c96a33a-84dd-4c95-82b3-94a6251e5404'), owner=OwnerMeta(userid='d7f2227d939749fba2d87d475eced3ad', username='tempest-TaggedAttachmentsTest-1796593045-project-member', projectid='8f26c4eed05b4d6787812ac3fb0c7803', projectname='tempest-TaggedAttachmentsTest-1796593045'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779976970.498139) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:02:50.499163 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:package version="33.1.0"/>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:name>tempest-device-tagging-server-1214174567</nova:name>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:creationTime>2026-05-28 14:02:50</nova:creationTime>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:flavor name="m1.nano" id="42">
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:memory>192</nova:memory>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:disk>1</nova:disk>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:swap>0</nova:swap>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:vcpus>1</nova:vcpus>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:extraSpecs>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     </nova:extraSpecs>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   </nova:flavor>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:minDisk>1</nova:minDisk>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:minRam>0</nova:minRam>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:properties>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     </nova:properties>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   </nova:image>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:owner>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:user uuid="d7f2227d939749fba2d87d475eced3ad">tempest-TaggedAttachmentsTest-1796593045-project-member</nova:user>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:project uuid="8f26c4eed05b4d6787812ac3fb0c7803">tempest-TaggedAttachmentsTest-1796593045</nova:project>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   </nova:owner>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   <nova:ports>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     <nova:port uuid="830e8040-3da9-453c-b4fa-7fa9197d9a4f">
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:       <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:     </nova:port>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:   </nova:ports>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]: </nova:instance>
May 28 14:02:50.499163 np0000001643 nova-compute[98269]:  {{(pid=98269) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 14:02:50.502001 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3299b2b1-021d-4def-b19c-dc37ae37543e req-fdbd6e25-4000-46ad-b871-b7c2475f4610 service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:50.685488 np0000001643 nova-compute[98269]: INFO nova.network.neutron [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Port 0391cf13-9163-4dad-951b-e7158fd8630a from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
May 28 14:02:50.686165 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [{"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:50.693333 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:02:50.694208 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976970.6933675, 4dc73d91-4d87-4283-9a77-607c0e512265 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:50.694208 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Paused (Lifecycle Event)
May 28 14:02:50.719255 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Took 8.43 seconds to spawn the instance on the hypervisor.
May 28 14:02:50.719398 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:50.843135 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:50.844799 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] End _get_guest_xml xml=<domain type="qemu">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <uuid>033c2245-10fc-4568-a15f-3b39ee5258ae</uuid>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <name>instance-0000000b</name>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-137732219</nova:name>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:02:47</nova:creationTime>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:user uuid="86dc22a5d6a7478dab81969f17d3daab">tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member</nova:user>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:project uuid="b74df57519ea42009fcebcff7cfdf94e">tempest-ServerBootFromVolumeStableRescueTest-241739491</nova:project>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         <nova:port uuid="a3c1b47a-6f08-4472-b43d-f02aad3c3ab4">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <system>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <entry name="serial">033c2245-10fc-4568-a15f-3b39ee5258ae</entry>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <entry name="uuid">033c2245-10fc-4568-a15f-3b39ee5258ae</entry>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </system>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <os>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   </os>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <features>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   </features>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   <devices>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <alias name="ua-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-8"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <serial>a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289</serial>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.rescue"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <boot order="1"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </disk>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:22:8d:7d"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <target dev="tapa3c1b47a-6f"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </interface>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/console.log" append="off"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </serial>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <video>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </video>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </rng>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:   </devices>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]: </domain>
May 28 14:02:50.844799 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:02:50.850475 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance destroyed successfully.
May 28 14:02:51.087372 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-509ea88c-e8ca-462b-9092-0824e24c1b23 req-be7ebea6-75d0-4f95-ada5-bf95265e5bf2 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:51.088492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-509ea88c-e8ca-462b-9092-0824e24c1b23 req-be7ebea6-75d0-4f95-ada5-bf95265e5bf2 service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:51.090816 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-509ea88c-e8ca-462b-9092-0824e24c1b23 req-be7ebea6-75d0-4f95-ada5-bf95265e5bf2 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:51.091348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-509ea88c-e8ca-462b-9092-0824e24c1b23 req-be7ebea6-75d0-4f95-ada5-bf95265e5bf2 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:51.092474 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-509ea88c-e8ca-462b-9092-0824e24c1b23 req-be7ebea6-75d0-4f95-ada5-bf95265e5bf2 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:51.092474 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-509ea88c-e8ca-462b-9092-0824e24c1b23 req-be7ebea6-75d0-4f95-ada5-bf95265e5bf2 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state active and task_state None.
May 28 14:02:51.189356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Releasing lock "refresh_cache-0c96a33a-84dd-4c95-82b3-94a6251e5404" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:51.197496 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:51.205429 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976971.2050867, 4dc73d91-4d87-4283-9a77-607c0e512265 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:51.205957 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Resumed (Lifecycle Event)
May 28 14:02:51.230187 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Took 14.61 seconds to build instance.
May 28 14:02:51.466984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:51.674854 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:51.693776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6f59bd5d-bff3-4c1b-bb28-62d4627967b5 tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "interface-0c96a33a-84dd-4c95-82b3-94a6251e5404-0391cf13-9163-4dad-951b-e7158fd8630a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 7.184s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:51.709548 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:51.713030 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:51.732067 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-167930db-d70d-4d28-b693-55802c0b3fd0 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.129s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:51.798646 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:52.213023 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00046553499987567193 future=<Future at 0x71a75c30b350 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.213506 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.213506 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.10585103699986576 future=<Future at 0x71a7804b41d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.213506 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.10573282999985167 future=<Future at 0x71a7804b41d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.215765 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Emitting event <LifecycleEvent: 1779976957.212419, af52b758-781b-4980-9e1d-5cb5924eee22 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:52.217104 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] VM Stopped (Lifecycle Event)
May 28 14:02:52.319666 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00043625900002552953 future=<Future at 0x71a7804b41d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.319843 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.319986 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.933181162999972 future=<Future at 0x71a75c34a600 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.320091 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.933073713999875 future=<Future at 0x71a75c34a600 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:52.321029 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Emitting event <LifecycleEvent: 1779976957.3191082, 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:52.322614 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] VM Stopped (Lifecycle Event)
May 28 14:02:52.382406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:52.382406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:52.382406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:02:52.382406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No VIF found with MAC fa:16:3e:22:8d:7d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:02:52.383193 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Using config drive
May 28 14:02:52.571736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:52.571736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing instance network info cache due to event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:02:52.571736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] Acquiring lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:52.571736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] Acquired lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:52.571736 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing network info cache for port 441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:02:52.722907 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: af52b758-781b-4980-9e1d-5cb5924eee22] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:52.757305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:52.757305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:52.757633 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:52.758501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:52.758501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:52.760868 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Terminating instance
May 28 14:02:52.827997 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1924da5e-de67-490a-8269-b3d9d827800d tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 5a5e8316-ba70-4c95-b9d8-30fdac3f8bca] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:52.888624 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'ec2_ids' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:53.074767 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:53.267614 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:02:53.307541 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:53.310029 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:53.336804 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:53.347046 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:53.386303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:53.394741 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:53.398060 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'keypairs' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:53.648056 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999667134999981 future=<Future at 0x71a75c3082f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:53.649646 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Instance destroyed successfully.
May 28 14:02:53.650847 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lazy-loading 'resources' on Instance uuid 0c96a33a-84dd-4c95-82b3-94a6251e5404 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:53.678779 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:53.912657 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:02:53.923472 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:54.007713 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updated VIF entry in instance network info cache for port 441edb5a-a183-4686-ad86-714a3ab59d5f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:02:54.007713 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:54.127196 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Creating config drive at /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config.rescue
May 28 14:02:54.131307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpazpg5yaa {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:02:54.143045 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.155527 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214174567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1214174567',id=4,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtVc+4tgMvIaRFlt7NsoOIARV7JdNBGW7O0/wVlaK0t2JpsUPbqsWhgXZzX0UIN0hgouTHikKm0EiyFGrWJCmIfDEXjgVtjL2FlMYliXVCkpu8A4GcqhoBGphjMONauQ==',key_name='tempest-keypair-538313549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:31Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f26c4eed05b4d6787812ac3fb0c7803',ramdisk_id='',reservation_id='r-exxjv5ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1796593045',owner_user_name='tempest-TaggedAttachmentsTest-1796593045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7f2227d939749fba2d87d475eced3ad',uuid=0c96a33a-84dd-4c95-82b3-94a6251e5404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:02:54.157480 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converting VIF {"id": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "address": "fa:16:3e:46:1d:78", "network": {"id": "19f2a949-8d33-47a7-a5d6-9d974b4c3cbc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-512120210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8f26c4eed05b4d6787812ac3fb0c7803", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8040-3d", "ovs_interfaceid": "830e8040-3da9-453c-b4fa-7fa9197d9a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:02:54.158004 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=830e8040-3da9-453c-b4fa-7fa9197d9a4f,network=Network(19f2a949-8d33-47a7-a5d6-9d974b4c3cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8040-3d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:02:54.158491 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=830e8040-3da9-453c-b4fa-7fa9197d9a4f,network=Network(19f2a949-8d33-47a7-a5d6-9d974b4c3cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8040-3d') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:02:54.161100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.161470 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap830e8040-3d, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:54.164726 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.165555 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:54.172960 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.176164 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.177298 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a805486-d014-4962-9934-5c64838f99b2) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:02:54.177958 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.178625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:02:54.185917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpazpg5yaa" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:02:54.186774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.190316 np0000001643 nova-compute[98269]: INFO os_vif [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=830e8040-3da9-453c-b4fa-7fa9197d9a4f,network=Network(19f2a949-8d33-47a7-a5d6-9d974b4c3cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8040-3d')
May 28 14:02:54.191261 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Deleting instance files /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404_del
May 28 14:02:54.192795 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Deletion of /opt/stack/data/nova/instances/0c96a33a-84dd-4c95-82b3-94a6251e5404_del complete
May 28 14:02:54.510422 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1c618f0a-7555-4598-a2a2-3c6708f2e4ca req-49d8c99f-4687-41b4-81a2-20c215c5f466 service nova] Releasing lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:54.658438 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:54.658918 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:54.659426 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:54.659908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:54.661061 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No waiting events found dispatching network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:54.661061 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:02:54.661061 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:54.661061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] Acquiring lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:54.661061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:54.661511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:54.661795 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] No waiting events found dispatching network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:54.662088 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc0e4a6f-9bfa-4f73-8ff4-591138e4a407 req-56d18efd-4db6-4f6a-be9d-c65828d9339c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-unplugged-830e8040-3da9-453c-b4fa-7fa9197d9a4f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:02:54.681044 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.701636 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 14:02:54.703646 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:02:54.703933 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:02:54.704051 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:02:54.704496 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:54.768330 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.793654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.889417 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:54.916371 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:54.986683 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:55.654915 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fb6fc7e1-c186-4a35-aa32-4cd5f919e580 req-4583fbb4-d6e3-4311-b488-82dff0c6de4c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Received event network-vif-deleted-830e8040-3da9-453c-b4fa-7fa9197d9a4f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:55.654915 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-fb6fc7e1-c186-4a35-aa32-4cd5f919e580 req-4583fbb4-d6e3-4311-b488-82dff0c6de4c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Neutron deleted interface 830e8040-3da9-453c-b4fa-7fa9197d9a4f; detaching it from the instance and deleting it from the info cache
May 28 14:02:55.656983 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fb6fc7e1-c186-4a35-aa32-4cd5f919e580 req-4583fbb4-d6e3-4311-b488-82dff0c6de4c service nova] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Detach interface failed, port_id=830e8040-3da9-453c-b4fa-7fa9197d9a4f, reason: Instance 0c96a33a-84dd-4c95-82b3-94a6251e5404 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:02:55.892529 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 033c2245-10fc-4568-a15f-3b39ee5258ae due to new event <LifecycleEvent: 1779976975.892046, 033c2245-10fc-4568-a15f-3b39ee5258ae => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:02:55.892712 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976975.892046, 033c2245-10fc-4568-a15f-3b39ee5258ae => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:55.892911 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Resumed (Lifecycle Event)
May 28 14:02:55.900240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0fb2e364-5440-46c1-b298-74e99a569c9b tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:56.059299 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:56.396428 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:56.400470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:56.562723 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Took 1.86 seconds to deallocate network for instance.
May 28 14:02:56.775367 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:56.775956 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:56.776244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:56.776355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:56.776667 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:56.776719 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state rescued and task_state None.
May 28 14:02:56.777046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:02:56.777046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:56.777238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:56.777387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:56.777576 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:02:56.777773 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a9cf9ddc-4168-419d-8752-79310ab95f3e req-01f77522-491f-45f7-bc99-615829002d2e service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state rescued and task_state None.
May 28 14:02:56.906138 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976976.9058604, 033c2245-10fc-4568-a15f-3b39ee5258ae => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:02:56.906285 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Started (Lifecycle Event)
May 28 14:02:57.070572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:02:57.075457 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:02:57.408654 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:02:57.414990 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:02:57.522269 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Unrescuing
May 28 14:02:57.523160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:02:57.523372 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:02:57.523547 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:02:57.819568 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:02:57.820132 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:02:57.922061 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 14:02:58.030871 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:58.255107 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.001902360000030967 future=<Future at 0x71a75c34a600 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:58.255307 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:58.255307 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.392304440000089 future=<Future at 0x71a75c3082f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:58.255423 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.392196369999965 future=<Future at 0x71a75c3082f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:02:58.325897 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:02:58.562300 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:02:58.574156 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:58.842843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.772s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:02:58.918047 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Deleted allocations for instance 0c96a33a-84dd-4c95-82b3-94a6251e5404
May 28 14:02:59.045634 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Updating instance_info_cache with network_info: [{"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:02:59.145377 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:59.179507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:02:59.548304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-033c2245-10fc-4568-a15f-3b39ee5258ae" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:02:59.549757 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'flavor' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:02:59.929880 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-76d1c4a2-c8c7-4a27-9bf0-5675db06e43a tempest-TaggedAttachmentsTest-1796593045 tempest-TaggedAttachmentsTest-1796593045-project-member] Lock "0c96a33a-84dd-4c95-82b3-94a6251e5404" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.172s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:00.093431 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:00.100567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:00.126824 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:00.315825 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:00.322901 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:00.437753 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99970994399996 future=<Future at 0x71a7801f4650 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:00.443976 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance destroyed successfully.
May 28 14:03:00.444544 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'numa_topology' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:00.521051 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e122978f-2bdc-4a25-8bdd-5d6725c1de09 req-0aa2722c-6a6e-4aa2-84fd-e5f936d0cd61 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:00.525093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e122978f-2bdc-4a25-8bdd-5d6725c1de09 req-0aa2722c-6a6e-4aa2-84fd-e5f936d0cd61 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:00.525297 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e122978f-2bdc-4a25-8bdd-5d6725c1de09 req-0aa2722c-6a6e-4aa2-84fd-e5f936d0cd61 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:00.526227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e122978f-2bdc-4a25-8bdd-5d6725c1de09 req-0aa2722c-6a6e-4aa2-84fd-e5f936d0cd61 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:00.526377 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e122978f-2bdc-4a25-8bdd-5d6725c1de09 req-0aa2722c-6a6e-4aa2-84fd-e5f936d0cd61 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:00.527292 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e122978f-2bdc-4a25-8bdd-5d6725c1de09 req-0aa2722c-6a6e-4aa2-84fd-e5f936d0cd61 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:00.947134 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<033c2245-10fc-4568-a15f-3b39ee5258ae> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:01.236109 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:01.550838 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:01.574181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:01.711309 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:01.871813 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:02.625204 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:02.626511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:02.627293 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:02.627293 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:02.628324 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:02.628324 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:02.628324 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:02.628324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:02.628324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:02.628324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:02.628324 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:02.628717 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:02.628717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:02.628717 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:02.628861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:02.628997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:02.629105 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:02.629260 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-cca9e3a0-a7b4-4096-958c-77650f4c0580 req-a02b7726-04c8-45b3-a541-8e48f43405e9 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received unexpected event network-vif-plugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:02.781283 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 033c2245-10fc-4568-a15f-3b39ee5258ae due to new event <LifecycleEvent: 1779976982.7805796, 033c2245-10fc-4568-a15f-3b39ee5258ae => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:03:02.781522 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976982.7805796, 033c2245-10fc-4568-a15f-3b39ee5258ae => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:02.782249 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-61f33e42-cfd2-42ee-84ff-b8cf9b31a026 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:02.782249 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Resumed (Lifecycle Event)
May 28 14:03:02.852353 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:03.291535 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:03.294431 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:03.644473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:03.644473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:03.800563 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779976983.799064, 033c2245-10fc-4568-a15f-3b39ee5258ae => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:03.800563 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Started (Lifecycle Event)
May 28 14:03:04.149960 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lazy-loading 'flavor' on Instance uuid 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:04.158679 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:04.180710 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:04.302575 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:04.309386 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:05.173814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.531s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:05.628158 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:05.835788 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:06.204726 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:06.269584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:06.269584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:06.269584 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Attaching volume 9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd to /dev/vdb
May 28 14:03:06.329777 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:06.349847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:03:06.384036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:06.423053 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:03:06.424032 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:03:06.438029 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:03:06.439883 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe60:f870', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:fe66:e9da', 'fe80::fc16:3eff:feee:e982', 'fe80::54c2:95ff:fe36:5e1', 'fe80::fc16:3eff:fe26:cfe0', 'fe80::fc16:3eff:fe9d:d1a7', 'fe80::fc16:3eff:fe09:469', 'fe80::fc16:3eff:fe69:8116', 'fe80::84c8:d5ff:fe78:370', 'fe80::fc16:3eff:fee0:d4e', 'fe80::809f:94ff:fe0f:c60', 'fe80::fc16:3eff:feab:39d2', 'fe80::1cb4:a3ff:fe76:b1bf', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe1f:7534', 'fe80::fc16:3eff:fe1a:790d', 'fe80::fc16:3eff:fe22:8d7d'] 
May 28 14:03:06.440069 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:03:06.440117 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:03:06.440392 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:06.440883 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating existing volume attachment record: ae23fc50-9cef-4368-bac5-b38587c37f60 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:03:07.021504 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:03:07.021504 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:07.021504 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:07.022094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:07.022394 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:03:07.038489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:07.039569 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:07.040634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:07.042061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:07.042476 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:07.043153 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:07.066495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:07.066495 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:07.072996 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:07.072996 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:07.080823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd] added
May 28 14:03:07.080823 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:07.080823 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:07.080823 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:07.080823 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:07.080823 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:07.080823 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:07.083066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:07.083066 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:07.083066 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:07.092014 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd] added
May 28 14:03:07.092014 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:07.092014 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:07.092014 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:07.092014 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:07.092014 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:07.092014 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:07.092342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:07.092342 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.05(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:07.092773 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:07.561887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:07.561887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:08.067898 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:03:08.083961 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:08.095481 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:08.107824 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:08.107824 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:08.116075 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:08.116075 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:08.125751 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:08.137375 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.150717 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.165606 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:08.237338 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260]
May 28 14:03:08.237338 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260] successful.
May 28 14:03:08.237338 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:08.254756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.280809 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:08.281377 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:08.281377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.240s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:08.281897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:08.283026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] HCTL ('16', '-', '-', 0) found on session 22 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:08.283573 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:08.305522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching for a device in session 22 and hctl ['16', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:08.305831 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:08.632978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:08.633475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:08.637081 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:08.637324 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Claim successful on node np0000001643
May 28 14:03:08.649815 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00046419899990723934 future=<Future at 0x71a75c3082f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:08.649815 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Emitting event <LifecycleEvent: 1779976973.6475582, 0c96a33a-84dd-4c95-82b3-94a6251e5404 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:08.649815 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:08.649815 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] VM Stopped (Lifecycle Event)
May 28 14:03:08.650293 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.787133149000056 future=<Future at 0x71a7801f4650 state=cancelled>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:08.650483 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.786966111000083 future=<Future at 0x71a7801f4650 state=cancelled>) was cancelled while queued, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:08.650533 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:09.151848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:09.158574 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 0c96a33a-84dd-4c95-82b3-94a6251e5404] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:09.182124 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:09.231176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260]
May 28 14:03:09.231176 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260] successful.
May 28 14:03:09.231176 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:09.245215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:09.268301 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:09.269120 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.228s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:09.269120 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:09.270343 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] HCTL ('15', '-', '-', 0) found on session 21 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:09.270515 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:09.308398 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching for a device in session 21 and hctl ['15', '*', '*', 0] yield: sdk {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:09.308398 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:09.806388 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:10.076693 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:03:10.210173 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:10.418633 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:10.418633 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:10.628425 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:10.922554 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:11.094707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798927 for multipath device dm-6 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:03:11.094982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.073s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:11.095211 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== connect_volume: return (4073ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798927', 'path': '/dev/dm-6', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798927'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:11.095385 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798927', 'path': '/dev/dm-6', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798927'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:03:11.102407 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lazy-loading 'flavor' on Instance uuid 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:11.430230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.797s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:11.430726 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:03:11.607433 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Attempting to attach volume 9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:03:11.608870 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:03:11.608870 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:03:11.608870 np0000001643 nova-compute[98269]:   <alias name="ua-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd"/>
May 28 14:03:11.608870 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-6"/>
May 28 14:03:11.608870 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:03:11.608870 np0000001643 nova-compute[98269]:   <serial>9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd</serial>
May 28 14:03:11.608870 np0000001643 nova-compute[98269]: </disk>
May 28 14:03:11.608870 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:03:11.939662 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:03:11.941299 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:03:11.944468 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:11.944468 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:12.112694 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86dc22a5d6a7478dab81969f17d3daab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74df57519ea42009fcebcff7cfdf94e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:03:12.442837 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:03:12.897377 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Successfully created port: d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:03:12.946254 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:03:13.317229 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:13.317414 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:13.317537 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:13.318272 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No VIF found with MAC fa:16:3e:ab:39:d2, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:13.624021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:13.955223 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:03:13.956401 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:03:13.956745 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Creating image(s)
May 28 14:03:13.957317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "/opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:13.961483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:13.961483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:13.961483 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:13.966114 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:13.972472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:14.075120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:14.075681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:14.076261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:14.076799 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:14.082142 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:14.082142 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:14.155112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:14.179162 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:14.180060 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:14.191606 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:14.239934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk 1073741824" returned: 0 in 0.060s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:14.240722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:14.241323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:14.321737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.080s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:14.322301 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:03:14.322683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:14.424069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:14.425098 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Cannot resize image /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:03:14.427384 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:03:14.427384 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Ensure instance console log exists: /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:03:14.428908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:14.428908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:14.428908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:14.589847 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Successfully updated port: d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:03:14.670249 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-changed-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:14.671749 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Refreshing instance network info cache due to event network-changed-d6433bbd-634c-4b65-a0a6-256154bfb0cd. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:14.671749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] Acquiring lock "refresh_cache-8937adb3-1191-477e-a01d-76d29db6b224" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:14.671749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] Acquired lock "refresh_cache-8937adb3-1191-477e-a01d-76d29db6b224" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:14.671749 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Refreshing network info cache for port d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:14.913661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09dd9b8e-7189-4721-94bc-e40f89b4ead8 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.646s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:15.092972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-8937adb3-1191-477e-a01d-76d29db6b224" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:15.174037 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:15.711267 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:15.734778 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:15.827437 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:15.827700 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:03:16.331875 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:03:16.333318 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:16.333318 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:03:16.422874 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:16.499291 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:16.837592 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:17.002141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd0c1cb3-6b2b-4aa5-80ac-597633dadda3 req-30087032-4fb8-4e17-95ce-e5e09d8af51c service nova] Releasing lock "refresh_cache-8937adb3-1191-477e-a01d-76d29db6b224" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:17.003103 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-8937adb3-1191-477e-a01d-76d29db6b224" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:17.003264 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:17.342037 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:03:18.046812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:18.046812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:18.046812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:18.046812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:18.046812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:18.048944 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Terminating instance
May 28 14:03:18.495949 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.553485 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:03:18.585123 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.592101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.619302 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.630315 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.648209 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.656968 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.722906 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.749430 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.754163 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:18.830993 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.837158 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.838622 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.852569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.961281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.982153 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:18.982153 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.090594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.104887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.175568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.180754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.195893 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.277681 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999354356999902 future=<Future at 0x71a78056d490 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:19.280506 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Instance destroyed successfully.
May 28 14:03:19.282636 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lazy-loading 'resources' on Instance uuid 986e86a9-d6cb-40b3-9c7b-263684816a96 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:19.284391 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.993070541999941 future=<Future at 0x71a78056d490 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:19.290043 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.986936944999798 future=<Future at 0x71a78056d490 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:19.341795 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:19.342828 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:19.343215 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:19.343494 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:03:19.344644 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:03:19.614395 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2ed0270c-b7da-44d3-b8e9-ef65b9c92ac0 req-608c8d18-aa7a-4ea1-9d2f-7f560452e2e4 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:19.614395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2ed0270c-b7da-44d3-b8e9-ef65b9c92ac0 req-608c8d18-aa7a-4ea1-9d2f-7f560452e2e4 service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:19.614395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2ed0270c-b7da-44d3-b8e9-ef65b9c92ac0 req-608c8d18-aa7a-4ea1-9d2f-7f560452e2e4 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:19.614395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2ed0270c-b7da-44d3-b8e9-ef65b9c92ac0 req-608c8d18-aa7a-4ea1-9d2f-7f560452e2e4 service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:19.616790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2ed0270c-b7da-44d3-b8e9-ef65b9c92ac0 req-608c8d18-aa7a-4ea1-9d2f-7f560452e2e4 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No waiting events found dispatching network-vif-unplugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:19.616790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2ed0270c-b7da-44d3-b8e9-ef65b9c92ac0 req-608c8d18-aa7a-4ea1-9d2f-7f560452e2e4 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:19.766794 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Stashing vm_state: active {{(pid=98269) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 14:03:19.791298 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:19.793165 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "address": "fa:16:3e:66:e9:da", "network": {"id": "2e7b5e36-5909-4a0d-b5ab-a29026b3af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515308423-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3498e0c-df", "ovs_interfaceid": "a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:19.793165 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec,network=Network(2e7b5e36-5909-4a0d-b5ab-a29026b3af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3498e0c-df') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:19.793165 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec,network=Network(2e7b5e36-5909-4a0d-b5ab-a29026b3af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3498e0c-df') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:19.798113 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.798412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3498e0c-df, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:19.800803 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.801965 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:19.830375 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:19.830375 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:03:19.839001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.841387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.841387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf72f010-2751-4314-ab83-37a5a895bfc6) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:19.841714 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.842288 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:19.874541 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:19.878646 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.881593 np0000001643 nova-compute[98269]: INFO os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e9:da,bridge_name='br-int',has_traffic_filtering=True,id=a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec,network=Network(2e7b5e36-5909-4a0d-b5ab-a29026b3af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3498e0c-df')
May 28 14:03:19.882471 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:19.884884 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "address": "fa:16:3e:ee:e9:82", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d0e8d8-44", "ovs_interfaceid": "34d0e8d8-44e7-460e-8bad-b2a3110164da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:19.885499 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e9:82,bridge_name='br-int',has_traffic_filtering=True,id=34d0e8d8-44e7-460e-8bad-b2a3110164da,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34d0e8d8-44') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:19.885936 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e9:82,bridge_name='br-int',has_traffic_filtering=True,id=34d0e8d8-44e7-460e-8bad-b2a3110164da,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34d0e8d8-44') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:19.889027 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.889347 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34d0e8d8-44, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:19.891678 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.891791 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:19.920385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.922047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.922226 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd642c16-c152-4d32-bf29-8edb4d78e743) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:19.922773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.923284 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:19.949794 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.953241 np0000001643 nova-compute[98269]: INFO os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e9:82,bridge_name='br-int',has_traffic_filtering=True,id=34d0e8d8-44e7-460e-8bad-b2a3110164da,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34d0e8d8-44')
May 28 14:03:19.954168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:19.954406 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "0313acab-d072-4ead-9186-1a6bc350a825", "address": "fa:16:3e:26:cf:e0", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313acab-d0", "ovs_interfaceid": "0313acab-d072-4ead-9186-1a6bc350a825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:19.955567 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:cf:e0,bridge_name='br-int',has_traffic_filtering=True,id=0313acab-d072-4ead-9186-1a6bc350a825,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0313acab-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:19.955567 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:cf:e0,bridge_name='br-int',has_traffic_filtering=True,id=0313acab-d072-4ead-9186-1a6bc350a825,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0313acab-d0') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:19.957395 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.957689 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0313acab-d0, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:19.958777 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.959629 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:19.981978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.983285 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.983608 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f06fb4e5-1d69-4462-899d-5d7eab87eaea) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:19.984793 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:19.985270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.012037 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.016135 np0000001643 nova-compute[98269]: INFO os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:cf:e0,bridge_name='br-int',has_traffic_filtering=True,id=0313acab-d072-4ead-9186-1a6bc350a825,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0313acab-d0')
May 28 14:03:20.016998 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:20.017210 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "address": "fa:16:3e:9d:d1:a7", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fa2b3e-b5", "ovs_interfaceid": "00fa2b3e-b595-4f5e-b9a7-ed2df9302c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:20.021394 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:a7,bridge_name='br-int',has_traffic_filtering=True,id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fa2b3e-b5') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:20.022563 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:a7,bridge_name='br-int',has_traffic_filtering=True,id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fa2b3e-b5') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:20.023691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.023920 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00fa2b3e-b5, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.025221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.028215 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.047009 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9a269cac-ad9d-445b-917f-e3069dabfca5 req-3bb62d0f-ce44-47c1-86d0-1c88fc9223e8 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:20.049247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a269cac-ad9d-445b-917f-e3069dabfca5 req-3bb62d0f-ce44-47c1-86d0-1c88fc9223e8 service nova] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:20.049247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a269cac-ad9d-445b-917f-e3069dabfca5 req-3bb62d0f-ce44-47c1-86d0-1c88fc9223e8 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:20.049247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a269cac-ad9d-445b-917f-e3069dabfca5 req-3bb62d0f-ce44-47c1-86d0-1c88fc9223e8 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:20.049247 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9a269cac-ad9d-445b-917f-e3069dabfca5 req-3bb62d0f-ce44-47c1-86d0-1c88fc9223e8 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] No waiting events found dispatching network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:20.049247 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9a269cac-ad9d-445b-917f-e3069dabfca5 req-3bb62d0f-ce44-47c1-86d0-1c88fc9223e8 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received unexpected event network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd for instance with vm_state building and task_state spawning.
May 28 14:03:20.049247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.052402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.052777 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c6a3036-ab9d-4afe-b570-bf2f3846ce53) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.053381 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.054181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.071784 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.076017 np0000001643 nova-compute[98269]: INFO os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:a7,bridge_name='br-int',has_traffic_filtering=True,id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fa2b3e-b5')
May 28 14:03:20.076762 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:20.076927 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "0bfe536e-457d-4275-a0ff-78f03834d29e", "address": "fa:16:3e:09:04:69", "network": {"id": "3934731c-3929-457e-aada-e8d237e13b96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1575827606", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfe536e-45", "ovs_interfaceid": "0bfe536e-457d-4275-a0ff-78f03834d29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:20.077363 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:69,bridge_name='br-int',has_traffic_filtering=True,id=0bfe536e-457d-4275-a0ff-78f03834d29e,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfe536e-45') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:20.077590 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:69,bridge_name='br-int',has_traffic_filtering=True,id=0bfe536e-457d-4275-a0ff-78f03834d29e,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfe536e-45') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:20.080423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.080423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bfe536e-45, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.082861 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.084401 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.089618 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Updating instance_info_cache with network_info: [{"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:20.099675 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.101760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.101760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0b3d16e-0e7b-43e1-af1d-f25130cfe4c7) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.102787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.104064 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.117022 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.120253 np0000001643 nova-compute[98269]: INFO os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:69,bridge_name='br-int',has_traffic_filtering=True,id=0bfe536e-457d-4275-a0ff-78f03834d29e,network=Network(3934731c-3929-457e-aada-e8d237e13b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfe536e-45')
May 28 14:03:20.120924 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:20.121072 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "address": "fa:16:3e:69:81:16", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bc3f96-3f", "ovs_interfaceid": "09bc3f96-3fb8-4529-9d98-e63533eb5d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:20.121595 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:16,bridge_name='br-int',has_traffic_filtering=True,id=09bc3f96-3fb8-4529-9d98-e63533eb5d45,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bc3f96-3f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:20.121798 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:16,bridge_name='br-int',has_traffic_filtering=True,id=09bc3f96-3fb8-4529-9d98-e63533eb5d45,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bc3f96-3f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:20.123327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.123645 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09bc3f96-3f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.124871 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.125997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.132561 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.134101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.134264 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=061b65f7-4073-4752-9868-42172c1dbe36) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.135636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.135636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.141823 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.145822 np0000001643 nova-compute[98269]: INFO os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:16,bridge_name='br-int',has_traffic_filtering=True,id=09bc3f96-3fb8-4529-9d98-e63533eb5d45,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bc3f96-3f')
May 28 14:03:20.146700 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1935911609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-1935911609',id=6,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+fUUd03hzLQQsMvi2SdRouN086TwRAKBHfOKodg9UFjZ9U8aFTUCeRgZa2BAmvJX4pnnLcnOsH4s2bFyI2qwrNeKf1qv3Fi/nrqpoym6dgoBsKxiwAEe6l+OXAPZfJng==',key_name='tempest-keypair-1968584253',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee69e237aa64213a01d0bf475569055',ramdisk_id='',reservation_id='r-dqn88qn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-769083887',owner_user_name='tempest-TaggedBootDevicesTest_v242-769083887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='365296e0ff384bad9ae6b97762431f99',uuid=986e86a9-d6cb-40b3-9c7b-263684816a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:20.146913 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converting VIF {"id": "f97897ad-8223-4e94-a0d2-30e968ae948f", "address": "fa:16:3e:e0:0d:4e", "network": {"id": "a2ccab4e-6252-4b30-b521-8d3987bccdb8", "bridge": "br-int", "label": "tempest-device-tagging-net2-771183710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bee69e237aa64213a01d0bf475569055", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf97897ad-82", "ovs_interfaceid": "f97897ad-8223-4e94-a0d2-30e968ae948f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:20.147550 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:0d:4e,bridge_name='br-int',has_traffic_filtering=True,id=f97897ad-8223-4e94-a0d2-30e968ae948f,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf97897ad-82') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:20.147802 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:0d:4e,bridge_name='br-int',has_traffic_filtering=True,id=f97897ad-8223-4e94-a0d2-30e968ae948f,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf97897ad-82') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:20.151742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.152040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf97897ad-82, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.154724 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.154842 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.156486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.156670 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbd93758-4214-4cce-aa9e-043fd19f195f) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:20.157270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.157938 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:20.160221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:20.162963 np0000001643 nova-compute[98269]: INFO os_vif [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:0d:4e,bridge_name='br-int',has_traffic_filtering=True,id=f97897ad-8223-4e94-a0d2-30e968ae948f,network=Network(a2ccab4e-6252-4b30-b521-8d3987bccdb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf97897ad-82')
May 28 14:03:20.167553 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:03:20.167939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:20.168134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:20.168701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:20.169080 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e328b1f5-924b-4abc-b089-5b9f05b0fecb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:03:20.169270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.208746 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.209096 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:20.209096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '9')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:03:20.209585 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '5')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:20.210266 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb', '6')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:20.211301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c303740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:03:20.211301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:03:20.212369 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Flush multipath device 33000000086bf4ed4 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:03:20.277229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:20.324819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:20.354000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:20.354223 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:20.373106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:03:20.373505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:03:20.375310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:03:20.392902 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:03:20.393818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:03:20.413218 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.462984 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.40.100,3260]
May 28 14:03:20.462984 np0000001643 nova-compute[98269]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.40.100,3260] successful.
May 28 14:03:20.462984 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.492909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.508389 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.548915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.50.100,3260]
May 28 14:03:20.548915 np0000001643 nova-compute[98269]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-e328b1f5-924b-4abc-b089-5b9f05b0fecb, portal: 192.168.50.100,3260] successful.
May 28 14:03:20.548915 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.576106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.576387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:20.576587 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== disconnect_volume: return (408ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:20.576708 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:03:20.578527 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:03:20.578874 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:20.579064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:20.579459 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:20.580481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0498706f-7c10-44e6-ac4c-96485dd9e12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:03:20.580481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:03:20.592730 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-8937adb3-1191-477e-a01d-76d29db6b224" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:20.592730 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Instance network_info: |[{"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:03:20.595368 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Start _get_guest_xml network_info=[{"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:20.602893 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:20.605604 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1190212760', uuid='8937adb3-1191-477e-a01d-76d29db6b224'), owner=OwnerMeta(userid='86dc22a5d6a7478dab81969f17d3daab', username='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member', projectid='b74df57519ea42009fcebcff7cfdf94e', projectname='tempest-ServerBootFromVolumeStableRescueTest-241739491'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977000.6039133) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:20.609897 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:20.610270 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:20.612598 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:20.612914 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:20.614218 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:20.614635 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:20.615131 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:20.615131 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:20.615131 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:20.615131 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:20.615131 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:20.615285 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:20.615380 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:20.616332 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:20.616507 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:20.616695 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:20.633764 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:20.633764 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '9')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:03:20.634504 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '7')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:20.637151 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f', '8')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:20.640935 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1190212760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1190212760',id=14,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-y0zp9ixx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:13Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=8937adb3-1191-477e-a01d-76d29db6b224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:03:20.640935 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:20.641321 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ab:40,bridge_name='br-int',has_traffic_filtering=True,id=d6433bbd-634c-4b65-a0a6-256154bfb0cd,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6433bbd-63') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:20.642169 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'pci_devices' on Instance uuid 8937adb3-1191-477e-a01d-76d29db6b224 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:20.644216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778160180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:03:20.644216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:03:20.644486 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Flush multipath device 3300000009d6bdc37 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:03:20.682382 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:20.735081 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:20.787195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:03:20.787363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:03:20.788546 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:03:20.808428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:03:20.808428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:03:20.820655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.823464 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:20.823738 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:03:20.827712 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:20.828015 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:03:20.855250 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.40.100,3260]
May 28 14:03:20.855250 np0000001643 nova-compute[98269]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.40.100,3260] successful.
May 28 14:03:20.855250 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.864666 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:20.864864 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Claim successful on node np0000001643
May 28 14:03:20.878222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.896759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.936484 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.50.100,3260]
May 28 14:03:20.936484 np0000001643 nova-compute[98269]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-0498706f-7c10-44e6-ac4c-96485dd9e12f, portal: 192.168.50.100,3260] successful.
May 28 14:03:20.936484 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.963203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:20.963614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:20.963691 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== disconnect_volume: return (385ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:20.963814 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:03:20.965932 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:03:20.966699 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:20.966699 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:20.967504 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:20.968513 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8e72339-2641-4e2f-b2b8-94b12a1226f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:03:20.968513 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:03:21.000287 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "0c097fdc-e6f1-462e-b9de-72a07928e53a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:21.000287 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:21.000934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:21.000934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:21.000934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:21.004510 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Terminating instance
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:21.006640 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1 (non-flash)
May 28 14:03:21.007083 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:21.007083 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '9')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:03:21.007368 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '10')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:21.008502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1', '9')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:21.013125 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a77811f240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:03:21.013342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:03:21.013675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Flush multipath device 330000000b08d2609 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:03:21.048778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:21.101277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:21.145710 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] End _get_guest_xml xml=<domain type="qemu">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <uuid>8937adb3-1191-477e-a01d-76d29db6b224</uuid>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <name>instance-0000000e</name>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1190212760</nova:name>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:20</nova:creationTime>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:user uuid="86dc22a5d6a7478dab81969f17d3daab">tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member</nova:user>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:project uuid="b74df57519ea42009fcebcff7cfdf94e">tempest-ServerBootFromVolumeStableRescueTest-241739491</nova:project>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         <nova:port uuid="d6433bbd-634c-4b65-a0a6-256154bfb0cd">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <system>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <entry name="serial">8937adb3-1191-477e-a01d-76d29db6b224</entry>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <entry name="uuid">8937adb3-1191-477e-a01d-76d29db6b224</entry>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </system>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <os>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   </os>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <features>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   </features>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   <devices>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk.config"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:0a:ab:40"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <target dev="tapd6433bbd-63"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </interface>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/console.log" append="off"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </serial>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <video>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </video>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </rng>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:   </devices>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]: </domain>
May 28 14:03:21.145710 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:03:21.148416 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Preparing to wait for external event network-vif-plugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:03:21.148416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:21.148416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:21.148416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:21.148416 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1190212760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1190212760',id=14,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-y0zp9ixx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:13Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=8937adb3-1191-477e-a01d-76d29db6b224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:03:21.148416 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:21.148825 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ab:40,bridge_name='br-int',has_traffic_filtering=True,id=d6433bbd-634c-4b65-a0a6-256154bfb0cd,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6433bbd-63') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:21.148825 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ab:40,bridge_name='br-int',has_traffic_filtering=True,id=d6433bbd-634c-4b65-a0a6-256154bfb0cd,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6433bbd-63') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:03:21.151890 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.151890 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:21.151890 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:03:21.151890 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.151890 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5404e56-b495-539c-abab-6144f56fe435', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:21.152925 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.154372 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:21.154950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.157134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:03:21.157134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:03:21.158109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:03:21.162038 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.162268 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6433bbd-63, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:21.162767 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6433bbd-63, col_values=(('qos', UUID('9b3e1ff9-f4d2-480b-a7f8-d418c4521212')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:21.162767 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6433bbd-63, col_values=(('external_ids', {'iface-id': 'd6433bbd-634c-4b65-a0a6-256154bfb0cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:ab:40', 'vm-uuid': '8937adb3-1191-477e-a01d-76d29db6b224'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:21.163865 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.164986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:21.174325 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:03:21.174325 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:03:21.175593 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.178463 np0000001643 nova-compute[98269]: INFO os_vif [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ab:40,bridge_name='br-int',has_traffic_filtering=True,id=d6433bbd-634c-4b65-a0a6-256154bfb0cd,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6433bbd-63')
May 28 14:03:21.187555 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:21.230759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.40.100,3260]
May 28 14:03:21.230759 np0000001643 nova-compute[98269]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.40.100,3260] successful.
May 28 14:03:21.230759 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:21.249626 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:21.263654 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:21.300513 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.50.100,3260]
May 28 14:03:21.300513 np0000001643 nova-compute[98269]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-e8e72339-2641-4e2f-b2b8-94b12a1226f1, portal: 192.168.50.100,3260] successful.
May 28 14:03:21.300513 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:21.320856 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:21.321054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:21.321181 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] <== disconnect_volume: return (354ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:21.321308 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:03:21.321671 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Deleting instance files /opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96_del
May 28 14:03:21.322218 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Deletion of /opt/stack/data/nova/instances/986e86a9-d6cb-40b3-9c7b-263684816a96_del complete
May 28 14:03:21.371051 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating resource usage from migration bc298aab-78c2-450d-aa27-d846f35c2c0b
May 28 14:03:21.513769 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:03:21.548148 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.552395 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.572916 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.740941 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:21.741582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:21.741582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:21.742834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:21.743045 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No waiting events found dispatching network-vif-unplugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:21.743233 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:21.743412 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No waiting events found dispatching network-vif-unplugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-0bfe536e-457d-4275-a0ff-78f03834d29e for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Acquiring lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] No waiting events found dispatching network-vif-unplugged-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:21.746644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a8b05227-78ff-4c81-92fe-3a43bc798bb2 req-9b96447c-a081-4912-b375-2b33c62349ec service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-unplugged-0bfe536e-457d-4275-a0ff-78f03834d29e for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:21.773553 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.786213 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:21.829484 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:21.829484 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:03:21.829484 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Took 3.27 seconds to destroy the instance on the hypervisor.
May 28 14:03:21.829700 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:03:21.829931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:03:21.830066 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:03:21.830362 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:21.877214 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99974410699997 future=<Future at 0x71a75c4f7590 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:21.879202 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Instance destroyed successfully.
May 28 14:03:21.879744 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'resources' on Instance uuid 0c097fdc-e6f1-462e-b9de-72a07928e53a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:22.039547 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:22.039820 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:22.256693 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.259726 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.329614 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.337937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:22.383814 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1922866190',display_name='tempest-AttachVolumeNegativeTest-server-1922866190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-1922866190',id=12,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHKNe+1ajEg6x9Qzq+AubsmcKPHoTy8MbuMyJRr3bqQmC/eXpDnm8smRPCHNvjhGjV+gAPoKQLR3u3/kADDoSZVsjLko0hShmEtYlYG1SPKfOmuncne0IFIiWAhzOaP4Q==',key_name='tempest-keypair-684236112',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:41Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-0q3ucxcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=0c097fdc-e6f1-462e-b9de-72a07928e53a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:22.383814 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "address": "fa:16:3e:1f:75:34", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapded2b2d9-d0", "ovs_interfaceid": "ded2b2d9-d0ce-4f7f-a72d-3494805a7cee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:22.384376 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:75:34,bridge_name='br-int',has_traffic_filtering=True,id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded2b2d9-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:22.384648 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:75:34,bridge_name='br-int',has_traffic_filtering=True,id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded2b2d9-d0') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:22.385568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.385790 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapded2b2d9-d0, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:22.388343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.389258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:22.395075 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.396249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.396406 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9845aaf-811a-43e3-876b-6958f4f296c5) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:22.397540 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.398139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:22.404711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:22.407842 np0000001643 nova-compute[98269]: INFO os_vif [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:75:34,bridge_name='br-int',has_traffic_filtering=True,id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded2b2d9-d0')
May 28 14:03:22.408171 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Deleting instance files /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a_del
May 28 14:03:22.408934 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Deletion of /opt/stack/data/nova/instances/0c097fdc-e6f1-462e-b9de-72a07928e53a_del complete
May 28 14:03:22.507984 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:22.542464 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:22.708141 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:22.708306 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:22.708503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No VIF found with MAC fa:16:3e:0a:ab:40, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:22.709266 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Using config drive
May 28 14:03:22.919830 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 14:03:22.920949 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:03:22.921216 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:03:22.921515 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:03:22.922628 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:23.035670 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:23.053809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.699s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:23.054520 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.716s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:23.054707 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Migrating
May 28 14:03:23.055239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:23.055239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:23.055425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:23.056577 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:03:23.220476 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:23.558560 np0000001643 nova-compute[98269]: INFO nova.compute.rpcapi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 28 14:03:23.559506 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:23.559567 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:03:23.621332 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Creating config drive at /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk.config
May 28 14:03:23.627486 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1xkkqkq2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:23.675201 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cfa352d3-ba8a-46e3-826e-70827f6ea27e req-30a05789-8939-4dd0-926a-e2df3f73a546 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Received event network-vif-deleted-ded2b2d9-d0ce-4f7f-a72d-3494805a7cee {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:23.675201 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-cfa352d3-ba8a-46e3-826e-70827f6ea27e req-30a05789-8939-4dd0-926a-e2df3f73a546 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Neutron deleted interface ded2b2d9-d0ce-4f7f-a72d-3494805a7cee; detaching it from the instance and deleting it from the info cache
May 28 14:03:23.678614 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cfa352d3-ba8a-46e3-826e-70827f6ea27e req-30a05789-8939-4dd0-926a-e2df3f73a546 service nova] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Detach interface failed, port_id=ded2b2d9-d0ce-4f7f-a72d-3494805a7cee, reason: Instance 0c097fdc-e6f1-462e-b9de-72a07928e53a could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:03:23.680177 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1xkkqkq2" returned: 0 in 0.053s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:23.824849 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:23.825424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:24.081821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:24.081821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquired lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:24.082360 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:24.097178 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:24.113324 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-24ad0b01-4b66-4605-927e-84c6f13d8236 req-7d17a6d9-9f48-46d6-b935-c3116ee3391e service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-deleted-00fa2b3e-b595-4f5e-b9a7-ed2df9302c80 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:24.113324 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-24ad0b01-4b66-4605-927e-84c6f13d8236 req-7d17a6d9-9f48-46d6-b935-c3116ee3391e service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Neutron deleted interface 00fa2b3e-b595-4f5e-b9a7-ed2df9302c80; detaching it from the instance and deleting it from the info cache
May 28 14:03:24.114491 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-24ad0b01-4b66-4605-927e-84c6f13d8236 req-7d17a6d9-9f48-46d6-b935-c3116ee3391e service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Detach interface failed, port_id=00fa2b3e-b595-4f5e-b9a7-ed2df9302c80, reason: Instance 986e86a9-d6cb-40b3-9c7b-263684816a96 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:03:24.203402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:24.230755 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:24.240601 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:24.330262 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:03:24.345481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:24.422395 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:24.423907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:24.442176 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:24.541143 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:24.544596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:24.588737 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:24.601148 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Took 1.68 seconds to deallocate network for instance.
May 28 14:03:24.620284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:24.620716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:24.645499 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:24.650833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:24.775688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:24.777171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:24.890278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:24.899244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:24.925228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:24.928472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:24.935884 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:24.935943 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Claim successful on node np0000001643
May 28 14:03:25.000938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.003658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.099320 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:25.104536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.109895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.135257 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:03:25.148779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:25.201034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.201920 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.242140 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0255d309-844e-4393-b72b-f985b456a702 req-b7baf829-862b-4880-b6e7-833bc4e69e11 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-deleted-09bc3f96-3fb8-4529-9d98-e63533eb5d45 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:25.242331 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-0255d309-844e-4393-b72b-f985b456a702 req-b7baf829-862b-4880-b6e7-833bc4e69e11 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Neutron deleted interface 09bc3f96-3fb8-4529-9d98-e63533eb5d45; detaching it from the instance and deleting it from the info cache
May 28 14:03:25.246630 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0255d309-844e-4393-b72b-f985b456a702 req-b7baf829-862b-4880-b6e7-833bc4e69e11 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Detach interface failed, port_id=09bc3f96-3fb8-4529-9d98-e63533eb5d45, reason: Instance 986e86a9-d6cb-40b3-9c7b-263684816a96 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:03:25.294618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.294837 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:03:25.298230 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:03:25.299601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.331346 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:25.334461 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977005.3339894, 8937adb3-1191-477e-a01d-76d29db6b224 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:25.334810 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] VM Started (Lifecycle Event)
May 28 14:03:25.410008 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.410463 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.532629 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.533049 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.618383 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.619162 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.702337 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.705606 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:25.707479 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.744030 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c4734b81-333a-4638-bd59-deb06e65cf8f req-70faab5c-f307-424d-97c3-52e92652c752 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-deleted-f97897ad-8223-4e94-a0d2-30e968ae948f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:25.744508 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-c4734b81-333a-4638-bd59-deb06e65cf8f req-70faab5c-f307-424d-97c3-52e92652c752 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Neutron deleted interface f97897ad-8223-4e94-a0d2-30e968ae948f; detaching it from the instance and deleting it from the info cache
May 28 14:03:25.745985 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c4734b81-333a-4638-bd59-deb06e65cf8f req-70faab5c-f307-424d-97c3-52e92652c752 service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Detach interface failed, port_id=f97897ad-8223-4e94-a0d2-30e968ae948f, reason: Instance 986e86a9-d6cb-40b3-9c7b-263684816a96 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:03:25.793768 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.794246 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.839939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:25.841147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Releasing lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:25.845536 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977005.8451207, 8937adb3-1191-477e-a01d-76d29db6b224 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:25.845692 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] VM Paused (Lifecycle Event)
May 28 14:03:25.885907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.889210 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:25.973931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:25.974284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:26.061787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:26.062154 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:03:26.066718 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:26.067799 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:26.103704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.035s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:26.104314 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12403MB free_disk=74.45028686523438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:03:26.104673 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:26.207098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-134e74ee-b609-4680-9b8c-f1920858bb72 req-aea63c74-51e2-419a-85cb-7285ae20c6df service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-deleted-0bfe536e-457d-4275-a0ff-78f03834d29e {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:26.207098 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-134e74ee-b609-4680-9b8c-f1920858bb72 req-aea63c74-51e2-419a-85cb-7285ae20c6df service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Neutron deleted interface 0bfe536e-457d-4275-a0ff-78f03834d29e; detaching it from the instance and deleting it from the info cache
May 28 14:03:26.209380 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-134e74ee-b609-4680-9b8c-f1920858bb72 req-aea63c74-51e2-419a-85cb-7285ae20c6df service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Detach interface failed, port_id=0bfe536e-457d-4275-a0ff-78f03834d29e, reason: Instance 986e86a9-d6cb-40b3-9c7b-263684816a96 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:03:26.350254 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:26.352567 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:26.445692 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:26.726465 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:26.726711 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:26.855385 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:03:26.948758 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Took 5.12 seconds to deallocate network for instance.
May 28 14:03:27.230133 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:27.362780 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Starting migrate_disk_and_power_off {{(pid=98269) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 14:03:27.384240 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.397146 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.405098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.432154 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.724695 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999661165000134 future=<Future at 0x71a75c72c170 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:27.727073 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance destroyed successfully.
May 28 14:03:27.728172 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:21Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:27.728559 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:27.729767 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:27.730341 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:27.734011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.734011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc438645f-c3, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:27.735656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.735656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:27.735968 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.740009 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.814s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:27.744154 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:03:27.746155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.593s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:27.746870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.746870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cec5e9ec-4651-4572-8f4f-a8b67fdb461a) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:27.748854 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:27.752111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:27.758053 np0000001643 nova-compute[98269]: INFO os_vif [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3')
May 28 14:03:27.759618 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:03:27.760021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:27.760237 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:27.760697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:27.761077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:03:27.761594 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:27.795026 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:27.795442 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '22')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:03:27.795442 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '21')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:27.798272 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '22')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:27.799465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c729620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'): ({'sdj'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:03:27.799622 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Removing multipathed devices sdj, sdk {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:03:27.799923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flush multipath device 3300000005c17c7b0 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:03:27.823535 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38986a78-d8b2-4436-a8ba-779e0cf9a900 req-9920082e-7131-4a8f-9207-7821535bc7cb service nova] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Received event network-vif-deleted-a3498e0c-dfc2-4161-84bb-bfd60b6aa5ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:27.836567 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:27.888272 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:27.936415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:03:27.939586 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:03:27.940940 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:03:27.954233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:03:27.955474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:03:27.971233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:28.012788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260]
May 28 14:03:28.012788 np0000001643 nova-compute[98269]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260] successful.
May 28 14:03:28.012788 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:28.031007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:28.044492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:28.081021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260]
May 28 14:03:28.081021 np0000001643 nova-compute[98269]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260] successful.
May 28 14:03:28.081021 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:28.104261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:28.104686 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:28.104900 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== disconnect_volume: return (345ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:28.105067 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:03:28.108823 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:28.199861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:28.200547 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:28.253700 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:03:28.253700 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:03:28.253700 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:28.253700 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:28.300559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:28.301024 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:03:28.301772 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_resize/disk /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:28.412640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:28.417919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:28.422582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "cp -r /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_resize/disk /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:28.422582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_resize/disk.config /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:28.457199 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2ab771f08c245c7a7dffca595835dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706c08c92c6844b3ab7b4019269eabad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:03:28.478066 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:28.482671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "cp -r /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_resize/disk.config /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:28.483226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:28.484766 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_resize/disk.info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:28.529995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "cp -r /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_resize/disk.info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" returned: 0 in 0.047s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:28.597488 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:28.597748 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:28.636766 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Took 1.69 seconds to detach 3 volumes for instance.
May 28 14:03:28.684847 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:28.685123 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:28.756062 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:03:28.923068 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:03:29.011905 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:03:29.104185 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'flavor' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:29.154281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:29.167046 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Successfully created port: bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:03:29.188362 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:29.244418 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:29.263046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:03:29.474276 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:29.560685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:29.695050 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.953s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:29.697635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.990s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:29.706575 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:29.706575 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Claim successful on node np0000001643
May 28 14:03:29.725758 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:29.725758 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:29.775362 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Deleted allocations for instance 0c097fdc-e6f1-462e-b9de-72a07928e53a
May 28 14:03:29.781924 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Successfully updated port: bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:03:29.834281 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Port c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 binding to destination host np0000001643 is already ACTIVE {{(pid=98269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 14:03:29.891029 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-changed-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:29.891202 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Refreshing instance network info cache due to event network-changed-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:29.891919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] Acquiring lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:29.891919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] Acquired lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:29.891919 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Refreshing network info cache for port bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:29.918094 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-plugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:29.919618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:29.919849 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:29.920042 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:29.920213 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Processing event network-vif-plugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:03:29.920460 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-plugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:29.920587 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:29.920726 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:29.920820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:29.920923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] No waiting events found dispatching network-vif-plugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:29.921032 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-dea022a1-2d7c-4476-9b7c-ed9c9aed1d18 req-87898bff-7514-4da1-be7b-a8aab1f4da03 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received unexpected event network-vif-plugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd for instance with vm_state building and task_state spawning.
May 28 14:03:29.921506 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:03:29.928094 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977009.9277136, 8937adb3-1191-477e-a01d-76d29db6b224 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:29.928244 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] VM Resumed (Lifecycle Event)
May 28 14:03:29.929631 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:03:29.932364 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Instance spawned successfully.
May 28 14:03:29.932673 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:03:30.113735 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:30.278607 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:03:30.279463 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:03:30.280778 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Creating image(s)
May 28 14:03:30.280778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:30.280778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:30.281189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:30.281935 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:30.284861 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:30.288216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:30.288941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:30.371057 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.082s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:30.372513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:30.372513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:30.372513 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:30.375267 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:30.375650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:30.398526 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:30.433732 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:30.443384 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:30.449928 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:30.450067 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:30.450567 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:30.450874 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:30.452037 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:30.452432 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:30.471256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:30.471704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:30.511640 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:30.515207 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk 1073741824" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:30.515623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:30.515893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:30.592636 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.076s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:30.593004 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:03:30.593200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:30.683521 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:30.692374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:30.692538 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Cannot resize image /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:03:30.692984 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:03:30.693169 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:03:30.693817 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:30.693817 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:30.693817 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:30.803154 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a198853d-a0f3-45a3-921b-16c95b9d64cc tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "0c097fdc-e6f1-462e-b9de-72a07928e53a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.803s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:30.844358 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:03:30.852941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:30.855262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:30.855463 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:30.951690 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:03:30.960506 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Took 17.00 seconds to spawn the instance on the hypervisor.
May 28 14:03:30.960746 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:31.186969 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6e131734-2d36-4957-9b69-11da85f8afc7 req-ece87e5a-fbe7-4ef3-a1c7-b919a5fff459 service nova] Releasing lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:31.190145 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquired lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:31.190145 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:31.208650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:31.208793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:31.208956 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Attaching volume 993e9269-3030-4b35-a005-a04e51b6695e to /dev/vdb
May 28 14:03:31.260410 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:31.271428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:03:31.293853 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:31.331358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:03:31.332556 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:03:31.347416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:03:31.348925 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe60:f870', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe1a:790d', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:fe0a:ab40'] 
May 28 14:03:31.349119 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:03:31.349190 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:03:31.351566 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:31.351915 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating existing volume attachment record: b08048a8-22b4-4a13-96bb-ebede9475e34 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:03:31.477509 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Took 22.91 seconds to build instance.
May 28 14:03:31.585187 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:31.585187 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:31.759306 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:31.870979 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:31.940767 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:03:31.941158 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '993e9269-3030-4b35-a005-a04e51b6695e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:31.941408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:31.941881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:31.942098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '993e9269-3030-4b35-a005-a04e51b6695e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:03:31.950484 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:31.959065 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:31.959697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:31.960231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:31.960537 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:31.960836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:31.960982 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:31.975554 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:31.975554 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:31.980837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a2f9ab5b-a01b-42f3-803c-e11d900e303c tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.419s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:31.984260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:31.984260 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:31.989157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e] added
May 28 14:03:31.989157 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:31.989157 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:31.989157 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:31.989157 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:31.989157 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:31.989157 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:31.989521 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:31.989563 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:31.989764 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:31.995533 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e] added
May 28 14:03:31.995533 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:31.995533 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:31.995533 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:31.995533 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:31.995533 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:31.995533 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:31.995775 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:31.995877 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:31.996048 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:32.014787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:32.015035 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquired lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:32.015184 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:32.080852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:32.081104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:32.089660 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:32.119631 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updating instance_info_cache with network_info: [{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:32.519754 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:32.585271 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Detaching volume ef535692-e07a-439d-b3cf-b7b4f211673e
May 28 14:03:32.597636 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.902s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:32.598970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 6.493s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:32.599809 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:03:32.624123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Releasing lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:32.624512 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance network_info: |[{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:03:32.626767 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Start _get_guest_xml network_info=[{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:32.629276 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:32.630877 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1095431235', uuid='0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc'), owner=OwnerMeta(userid='d2ab771f08c245c7a7dffca595835dba', username='tempest-AttachVolumeTestJSON-1658324310-project-member', projectid='706c08c92c6844b3ab7b4019269eabad', projectname='tempest-AttachVolumeTestJSON-1658324310'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977012.6303725) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:32.631904 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:32.632392 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:32.635482 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:32.639195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:32.639313 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:32.639757 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:32.639954 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:32.641655 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:32.641778 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:32.641928 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:32.642054 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:32.642215 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:32.642380 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:32.642557 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:32.642680 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:32.642800 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:32.653109 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Attempting to driver detach volume ef535692-e07a-439d-b3cf-b7b4f211673e from mountpoint /dev/vdb
May 28 14:03:32.666429 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:03:32.667023 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:32.667837 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:32.669293 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:32.671326 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found disk vdb by alias ua-ef535692-e07a-439d-b3cf-b7b4f211673e {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:03:32.673155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found disk vdb by alias ua-ef535692-e07a-439d-b3cf-b7b4f211673e {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:03:32.673155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Attempting to detach device vdb from instance aaeff833-80ef-4909-96de-5958543e37ba from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:03:32.674976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:03:32.674976 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:03:32.674976 np0000001643 nova-compute[98269]:   <alias name="ua-ef535692-e07a-439d-b3cf-b7b4f211673e"/>
May 28 14:03:32.674976 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:03:32.674976 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:03:32.674976 np0000001643 nova-compute[98269]:   <serial>ef535692-e07a-439d-b3cf-b7b4f211673e</serial>
May 28 14:03:32.674976 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:03:32.674976 np0000001643 nova-compute[98269]: </disk>
May 28 14:03:32.674976 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:03:32.685384 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully detached device vdb from instance aaeff833-80ef-4909-96de-5958543e37ba from the persistent domain config.
May 28 14:03:32.685888 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] (1/8): Attempting to detach device vdb with device alias ua-ef535692-e07a-439d-b3cf-b7b4f211673e from instance aaeff833-80ef-4909-96de-5958543e37ba from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:03:32.686214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:03:32.686214 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:03:32.686214 np0000001643 nova-compute[98269]:   <alias name="ua-ef535692-e07a-439d-b3cf-b7b4f211673e"/>
May 28 14:03:32.686214 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:03:32.686214 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:03:32.686214 np0000001643 nova-compute[98269]:   <serial>ef535692-e07a-439d-b3cf-b7b4f211673e</serial>
May 28 14:03:32.686214 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:03:32.686214 np0000001643 nova-compute[98269]: </disk>
May 28 14:03:32.686214 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:03:32.747983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:32.944435 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:32.991012 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:33.002306 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:33.011323 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:33.011323 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:33.017768 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:33.017768 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.029569 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.044470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.045290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.045290 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.045290 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.045290 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.045290 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:33.048659 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.048659 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.048659 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.048659 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.048659 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:33.061957 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.061957 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.061957 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.061957 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.061957 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:33.062184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.062184 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.062184 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.062184 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.062184 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:33.089922 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.50.100,3260]
May 28 14:03:33.089922 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.50.100,3260] successful.
May 28 14:03:33.089922 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.101316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.115651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.40.100,3260]
May 28 14:03:33.115651 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.40.100,3260] successful.
May 28 14:03:33.115651 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.123975 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:03:33.126207 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:03:33.126207 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:33.126207 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:33.131785 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.131785 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.131785 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.131785 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.131785 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.131785 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.131785 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:33.132359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.132359 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.132359 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.132359 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.132359 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.132359 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.132359 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:33.133297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:33.133689 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:33.137823 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:33.141471 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:33.144550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] HCTL ('7', '-', '-', 0) found on session 23 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:33.144550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:33.167595 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:33.167595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:33.173762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] HCTL ('8', '-', '-', 0) found on session 24 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:33.173762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:33.177471 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] End _get_guest_xml xml=<domain type="qemu">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <uuid>0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</uuid>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <name>instance-0000000f</name>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeTestJSON-server-1095431235</nova:name>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:32</nova:creationTime>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:user uuid="d2ab771f08c245c7a7dffca595835dba">tempest-AttachVolumeTestJSON-1658324310-project-member</nova:user>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:project uuid="706c08c92c6844b3ab7b4019269eabad">tempest-AttachVolumeTestJSON-1658324310</nova:project>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         <nova:port uuid="bd542e8b-1f1b-4e59-8c1b-fe44bfd93140">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <system>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <entry name="serial">0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</entry>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <entry name="uuid">0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</entry>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </system>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <os>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   </os>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <features>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   </features>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   <devices>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:16:45:16"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <target dev="tapbd542e8b-1f"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </interface>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/console.log" append="off"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </serial>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <video>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </video>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </rng>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:   </devices>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]: </domain>
May 28 14:03:33.177471 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:03:33.180998 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Preparing to wait for external event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:03:33.180998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:33.182123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:33.183806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.005s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:33.187156 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:03:33.187894 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:33.190506 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:33.190801 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:03:33.198343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:33.198343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:33.198343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:03:33.198343 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching for a device in session 23 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:33.200358 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '993e9269-3030-4b35-a005-a04e51b6695e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:33.201088 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:33.201413 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4429436-e6bf-56b1-90db-da3d24573a22', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:33.204220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching for a device in session 24 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:33.204220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '993e9269-3030-4b35-a005-a04e51b6695e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:33.204467 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:33.205506 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:33.208025 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:33.210773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:33.210999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd542e8b-1f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:33.212880 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd542e8b-1f, col_values=(('qos', UUID('d62cc8ac-138a-4ecd-b2b8-9d2fb08400e0')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:33.212880 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd542e8b-1f, col_values=(('external_ids', {'iface-id': 'bd542e8b-1f1b-4e59-8c1b-fe44bfd93140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:45:16', 'vm-uuid': '0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:33.212880 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:33.215656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:33.220648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:33.221937 np0000001643 nova-compute[98269]: INFO os_vif [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f')
May 28 14:03:33.265854 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd53f3f915c2d4a1fbe831e9c2c3ed43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0362446d0eb54dcfbf5fde3177bcdd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:03:33.305631 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977013.3052907, aaeff833-80ef-4909-96de-5958543e37ba => ua-ef535692-e07a-439d-b3cf-b7b4f211673e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:03:33.313854 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ef535692-e07a-439d-b3cf-b7b4f211673e for instance aaeff833-80ef-4909-96de-5958543e37ba {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:03:33.316416 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully detached device vdb from instance aaeff833-80ef-4909-96de-5958543e37ba from the live domain config.
May 28 14:03:33.317283 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:03:33.317650 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef535692-e07a-439d-b3cf-b7b4f211673e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:33.317818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:33.615899 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:03:33.624095 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Applying migration context for instance 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 as it has an incoming, in-progress migration bc298aab-78c2-450d-aa27-d846f35c2c0b. Migration status is post-migrating {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 14:03:33.625325 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating resource usage from migration bc298aab-78c2-450d-aa27-d846f35c2c0b
May 28 14:03:33.642626 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Releasing lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:33.683336 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance aaeff833-80ef-4909-96de-5958543e37ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.683682 np0000001643 nova-compute[98269]: WARNING nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 986e86a9-d6cb-40b3-9c7b-263684816a96 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 28 14:03:33.683816 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 150a83f0-0070-4df3-ab14-6aa1c028be82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.683929 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance fb9d4d3f-f068-49a2-ba11-114989ee8d9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.684032 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 65c247b5-acbc-474a-bb88-a2edf9ac2d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.684128 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 033c2245-10fc-4568-a15f-3b39ee5258ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.684226 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 4dc73d91-4d87-4283-9a77-607c0e512265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.684369 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 8937adb3-1191-477e-a01d-76d29db6b224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.684478 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Migration bc298aab-78c2-450d-aa27-d846f35c2c0b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 14:03:33.684605 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.684708 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.684806 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 49f763dd-7f92-4295-87ec-b3d5bee75e1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:03:33.780941 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Successfully created port: 05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:03:33.814597 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-23c4d086-ea9e-4cbc-9c6b-4bb74154e065 req-4bb2e9cc-de07-4ae6-8ece-cfd11d65fc5b service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:33.814754 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-23c4d086-ea9e-4cbc-9c6b-4bb74154e065 req-4bb2e9cc-de07-4ae6-8ece-cfd11d65fc5b service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:33.815391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-23c4d086-ea9e-4cbc-9c6b-4bb74154e065 req-4bb2e9cc-de07-4ae6-8ece-cfd11d65fc5b service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:33.815391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-23c4d086-ea9e-4cbc-9c6b-4bb74154e065 req-4bb2e9cc-de07-4ae6-8ece-cfd11d65fc5b service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:33.815391 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-23c4d086-ea9e-4cbc-9c6b-4bb74154e065 req-4bb2e9cc-de07-4ae6-8ece-cfd11d65fc5b service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:33.815391 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-23c4d086-ea9e-4cbc-9c6b-4bb74154e065 req-4bb2e9cc-de07-4ae6-8ece-cfd11d65fc5b service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state active and task_state resize_finish.
May 28 14:03:33.962274 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:03:34.120048 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:03:34.152553 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:34.166735 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:03:34.187141 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 14:03:34.192467 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:34.223767 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:03:34.224552 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:03:34.234977 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:03:34.236339 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe60:f870', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe1a:790d', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:fe0a:ab40'] 
May 28 14:03:34.237043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:03:34.237181 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:03:34.237432 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:34.245170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:34.278705 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:34.280851 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0038461650001409 future=<Future at 0x71a78056d490 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:34.281016 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:34.281089 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=2.595887828000059 future=<Future at 0x71a75c4f7590 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:34.281089 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=2.59581214800005 future=<Future at 0x71a75c4f7590 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:34.282336 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Emitting event <LifecycleEvent: 1779976999.276868, 986e86a9-d6cb-40b3-9c7b-263684816a96 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:34.284817 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] VM Stopped (Lifecycle Event)
May 28 14:03:34.375437 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Successfully updated port: 05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:03:34.439319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-changed-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:34.439422 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Refreshing instance network info cache due to event network-changed-05dae846-999f-4371-bad1-7abd3de08673. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:34.439637 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] Acquiring lock "refresh_cache-49f763dd-7f92-4295-87ec-b3d5bee75e1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:34.439788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] Acquired lock "refresh_cache-49f763dd-7f92-4295-87ec-b3d5bee75e1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:34.439892 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Refreshing network info cache for port 05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:34.689432 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 7c6f49c3-6903-4440-987d-dc99e23240bf has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 14:03:34.689979 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:03:34.689979 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=2688MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:03:26 up 30 min,  2 users,  load average: 9.25, 4.94, 2.27\n', 'num_instances': '10', 'num_vm_active': '7', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_a792bdb63c954739ad33cb2fedeedee4': '1', 'io_workload': '2', 'num_proj_b74df57519ea42009fcebcff7cfdf94e': '3', 'num_proj_9bfe2941b78c4f2e9f16f60e05ec5dcc': '3', 'num_vm_rescued': '1', 'num_task_resize_migrated': '1', 'num_proj_161254855aa54c71a7ac0a8a7076750c': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_706c08c92c6844b3ab7b4019269eabad': '1', 'num_proj_0362446d0eb54dcfbf5fde3177bcdd09': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:03:34.753879 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:34.754076 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:34.754265 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No VIF found with MAC fa:16:3e:16:45:16, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:34.754945 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Using config drive
May 28 14:03:34.789992 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] instance snapshotting
May 28 14:03:34.795879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-75cd1c47-fa07-4fa8-a12f-dbc65c12a733 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 986e86a9-d6cb-40b3-9c7b-263684816a96] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:34.877872 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "refresh_cache-49f763dd-7f92-4295-87ec-b3d5bee75e1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:34.906551 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Beginning live snapshot process
May 28 14:03:34.942208 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:34.980994 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Found WWN 330000000f847571a for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:03:34.981642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:34.981888 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000f847571a', 'path': '/dev/dm-0', 'multipath_id': '330000000f847571a'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:34.982061 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f847571a', 'path': '/dev/dm-0', 'multipath_id': '330000000f847571a'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:03:34.982527 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.665s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:34.982904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef535692-e07a-439d-b3cf-b7b4f211673e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:03:34.983038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:03:34.985151 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'flavor' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:35.010941 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:35.010941 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:35.010941 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:35.010941 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:35.010941 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:35.010941 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:35.010941 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e (non-flash)
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:35.011346 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '24')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:03:35.011346 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '12')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:35.012289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e', '11')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:35.013279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778163e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e'): ({'sdh'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:03:35.013279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:03:35.013392 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flush multipath device 33000000049a23265 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:03:35.032572 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:35.053494 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:35.090097 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:35.130842 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:03:35.133787 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:03:35.134172 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Creating image(s)
May 28 14:03:35.134537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "/opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:35.134725 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "/opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:35.139053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:03:35.139372 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:03:35.139781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "/opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:35.141141 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:35.145872 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:35.147107 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.167152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:03:35.180109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:03:35.180374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:03:35.200477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:35.227268 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.080s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.227895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:35.228418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:35.232466 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:35.234001 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:35.234421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.266540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.40.100,3260]
May 28 14:03:35.266540 np0000001643 nova-compute[98269]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.40.100,3260] successful.
May 28 14:03:35.266540 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:35.276464 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:35.280611 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:35.290463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:35.306641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:35.338730 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.50.100,3260]
May 28 14:03:35.338730 np0000001643 nova-compute[98269]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ef535692-e07a-439d-b3cf-b7b4f211673e, portal: 192.168.50.100,3260] successful.
May 28 14:03:35.338730 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:35.342161 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.342615 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.362327 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:35.363549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:35.365483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== disconnect_volume: return (2046ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:35.365483 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:03:35.399408 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk 1073741824" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.399843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:35.400186 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.463055 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Starting finish_migration {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 14:03:35.464487 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:03:35.464621 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Creating image(s)
May 28 14:03:35.465809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.500330 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Attempting to attach volume 993e9269-3030-4b35-a005-a04e51b6695e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:03:35.502616 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:03:35.502616 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:03:35.502616 np0000001643 nova-compute[98269]:   <alias name="ua-993e9269-3030-4b35-a005-a04e51b6695e"/>
May 28 14:03:35.502616 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:03:35.502616 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:03:35.502616 np0000001643 nova-compute[98269]:   <serial>993e9269-3030-4b35-a005-a04e51b6695e</serial>
May 28 14:03:35.502616 np0000001643 nova-compute[98269]: </disk>
May 28 14:03:35.502616 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:03:35.503912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.504867 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:03:35.508613 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.546527 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Creating config drive at /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config
May 28 14:03:35.553066 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpktt03b_w {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.566611 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.567741 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:03:35.576359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:35.596562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.597895 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Cannot resize image /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:03:35.599123 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:03:35.599634 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Ensure instance console log exists: /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:03:35.600370 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:35.601265 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:35.601636 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:35.609015 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpktt03b_w" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.674542 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:35.674994 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Cannot resize image /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:03:35.746152 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:35.746539 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:35.783693 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c0d11fcd-f517-42fd-89a5-1773996942f0 req-e2ca409e-74c4-4adc-8f26-169d17f6f445 service nova] Releasing lock "refresh_cache-49f763dd-7f92-4295-87ec-b3d5bee75e1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:35.784271 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquired lock "refresh_cache-49f763dd-7f92-4295-87ec-b3d5bee75e1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:35.784504 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:35.922706 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37edc9fc-ef80-4b96-a84c-828aac4e53e5 req-4f805e5e-901c-4d68-be50-70746a7b3249 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:35.923123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-37edc9fc-ef80-4b96-a84c-828aac4e53e5 req-4f805e5e-901c-4d68-be50-70746a7b3249 service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:35.923664 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-37edc9fc-ef80-4b96-a84c-828aac4e53e5 req-4f805e5e-901c-4d68-be50-70746a7b3249 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:35.923810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-37edc9fc-ef80-4b96-a84c-828aac4e53e5 req-4f805e5e-901c-4d68-be50-70746a7b3249 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:35.923996 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37edc9fc-ef80-4b96-a84c-828aac4e53e5 req-4f805e5e-901c-4d68-be50-70746a7b3249 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:35.924227 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-37edc9fc-ef80-4b96-a84c-828aac4e53e5 req-4f805e5e-901c-4d68-be50-70746a7b3249 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state active and task_state resize_finish.
May 28 14:03:35.942664 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid aaeff833-80ef-4909-96de-5958543e37ba {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:36.075669 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:36.112412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:36.113984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:36.180470 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:03:36.180470 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Ensure instance console log exists: /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:03:36.180470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:36.180470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:36.180470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:36.183873 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Start _get_guest_xml network_info=[{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'ca90e423-4c6f-4a2d-b2f3-d617fbe3e7e1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '16cfe8d8-1812-46a2-b92a-bd34d2cb7289', 'attached_at': '2026-05-28T14:03:34.000000', 'detached_at': '', 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'serial': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:36.188801 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:36.191582 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-981658321', uuid='16cfe8d8-1812-46a2-b92a-bd34d2cb7289'), owner=OwnerMeta(userid='90f6ff80402b47b399ba052cccf0f141', username='tempest-ServerActionsTestOtherB-89556640-project-member', projectid='161254855aa54c71a7ac0a8a7076750c', projectname='tempest-ServerActionsTestOtherB-89556640'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977016.190961) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:36.193878 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:36.194349 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:36.195510 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:36.197291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:36.197501 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:36.198494 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:36.198494 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:36.198494 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:36.198494 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:36.198765 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:36.198823 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:36.199086 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:36.199270 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:36.199441 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:36.199596 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:36.199773 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:36.222102 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:36.238462 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:36.251389 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:36.273712 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bb513f22-6dfa-44f5-a253-6f9637bc2116 req-34dac080-d8b8-47c7-893d-bbd17a84c7f7 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:36.274393 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bb513f22-6dfa-44f5-a253-6f9637bc2116 req-34dac080-d8b8-47c7-893d-bbd17a84c7f7 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:36.274665 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bb513f22-6dfa-44f5-a253-6f9637bc2116 req-34dac080-d8b8-47c7-893d-bbd17a84c7f7 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:36.275069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bb513f22-6dfa-44f5-a253-6f9637bc2116 req-34dac080-d8b8-47c7-893d-bbd17a84c7f7 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:36.275069 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bb513f22-6dfa-44f5-a253-6f9637bc2116 req-34dac080-d8b8-47c7-893d-bbd17a84c7f7 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Processing event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:03:36.328726 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:36.330004 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:36.331861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:36.331861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:36.332730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:03:36.333297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:36.333517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:36.334131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:36.335151 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:03:36.348840 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:36.349359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:36.349670 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:36.350668 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:36.353211 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:36.353211 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:36.362635 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:36.362635 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:36.368416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:36.368416 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:36.380987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd] added
May 28 14:03:36.380987 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:36.380987 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:36.380987 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:36.380987 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:36.380987 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:36.380987 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:36.381245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:36.381376 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:36.381577 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:36.389937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd] added
May 28 14:03:36.389937 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:36.389937 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:36.389937 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:36.389937 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:36.389937 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:36.389937 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:36.390324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:36.390427 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:36.390720 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:36.412632 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:36.464427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:36.494097 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:36.501130 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:36.527836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:36.574946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json -f qcow2" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:36.575836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:36.680069 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:36.685499 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json -f qcow2" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:36.686656 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:36.691657 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:36.692113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:36.765870 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:03:36.766360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.168s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:36.766956 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:03:36.767531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 7.613s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:36.772586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:36.774304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 7.300s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:36.777512 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:36.778027 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Claim successful on node np0000001643
May 28 14:03:36.799777 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:36.800288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpntnv8b9a/e15658b5cb73461fb743ee5abe3e6773.delta 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:36.868982 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Deleted allocations for instance 986e86a9-d6cb-40b3-9c7b-263684816a96
May 28 14:03:36.872248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpntnv8b9a/e15658b5cb73461fb743ee5abe3e6773.delta 1073741824" returned: 0 in 0.072s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:36.875010 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 14:03:36.877862 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0007833600000139995 future=<Future at 0x71a75c4f7590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:36.879799 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:36.879987 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.844361842000126 future=<Future at 0x71a75c72c170 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:36.884906 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] Emitting event <LifecycleEvent: 1779977001.8768716, 0c097fdc-e6f1-462e-b9de-72a07928e53a => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:36.885114 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.839243451000129 future=<Future at 0x71a75c72c170 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:36.885314 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] VM Stopped (Lifecycle Event)
May 28 14:03:36.903511 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Updating instance_info_cache with network_info: [{"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:36.958438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-29b08341-3275-4619-bc5d-e532a1e02d7c tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.877s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:37.099613 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977017.0991025, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:37.100084 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:03:37.100311 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Started (Lifecycle Event)
May 28 14:03:37.102577 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:03:37.104537 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance spawned successfully.
May 28 14:03:37.104869 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:03:37.178606 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:37.178835 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:37.178835 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:37.179022 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No VIF found with MAC fa:16:3e:1a:79:0d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:37.184114 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 14:03:37.185681 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 14:03:37.230685 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:03:37.230993 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpntnv8b9a/e15658b5cb73461fb743ee5abe3e6773.delta /opt/stack/data/nova/instances/snapshots/tmpntnv8b9a/e15658b5cb73461fb743ee5abe3e6773 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:37.328688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpntnv8b9a/e15658b5cb73461fb743ee5abe3e6773.delta /opt/stack/data/nova/instances/snapshots/tmpntnv8b9a/e15658b5cb73461fb743ee5abe3e6773" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:37.329311 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Snapshot extracted, beginning image upload
May 28 14:03:37.383319 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:37.391212 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2d341d7f-cfc4-494c-8945-13b3240951fe tempest-VolumesAssistedSnapshotsTest-1574201677 tempest-VolumesAssistedSnapshotsTest-1574201677-project-member] [instance: 0c097fdc-e6f1-462e-b9de-72a07928e53a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:37.391212 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:37.402075 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:37.402075 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:37.409799 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:37.409799 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.412971 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Releasing lock "refresh_cache-49f763dd-7f92-4295-87ec-b3d5bee75e1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:37.412971 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Instance network_info: |[{"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:03:37.416818 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Start _get_guest_xml network_info=[{"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:37.419745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.422355 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:37.424233 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1262143297', uuid='49f763dd-7f92-4295-87ec-b3d5bee75e1e'), owner=OwnerMeta(userid='d53f3f915c2d4a1fbe831e9c2c3ed43a', username='tempest-VolumesAdminNegativeTest-1757520100-project-member', projectid='0362446d0eb54dcfbf5fde3177bcdd09', projectname='tempest-VolumesAdminNegativeTest-1757520100'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977017.423747) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:37.425401 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:37.425851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:37.429488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:37.429734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:37.430909 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:37.431318 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:37.432236 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:37.432386 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:37.432562 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:37.432653 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:37.432763 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:37.432926 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:37.433112 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:37.433171 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:37.433315 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:37.433641 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:37.445205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.445205 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.445205 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.445205 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.445205 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:37.445424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.445424 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.445424 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.445424 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.445424 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:37.446356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.450218 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1262143297',display_name='tempest-VolumesAdminNegativeTest-server-1262143297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesadminnegativetest-server-1262143297',id=16,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0362446d0eb54dcfbf5fde3177bcdd09',ramdisk_id='',reservation_id='r-b2uxb6as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1757520100',owner_user_name='tempest-VolumesAdminNegativeTest-1757520100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:34Z,user_data=None,user_id='d53f3f915c2d4a1fbe831e9c2c3ed43a',uuid=49f763dd-7f92-4295-87ec-b3d5bee75e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:03:37.450387 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Converting VIF {"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:37.451043 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=05dae846-999f-4371-bad1-7abd3de08673,network=Network(60d6e2a4-a49c-45fb-b464-3fbd2a4028fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05dae846-99') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:37.451776 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lazy-loading 'pci_devices' on Instance uuid 49f763dd-7f92-4295-87ec-b3d5bee75e1e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:37.463472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.463472 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.463472 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.463472 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.463472 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:37.463669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.463669 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.463669 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.463669 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.463669 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:37.487978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260]
May 28 14:03:37.487978 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260] successful.
May 28 14:03:37.487978 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.499325 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.505650 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260]
May 28 14:03:37.505650 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260] successful.
May 28 14:03:37.505650 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.516048 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:37.516048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] HCTL ('9', '-', '-', 0) found on session 25 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:37.516679 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:37.523253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:37.534579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:37.534856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:37.535133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:37.535409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:37.535491 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:37.539841 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Terminating instance
May 28 14:03:37.542241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.542241 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.542241 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.542241 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.542241 np0000001643 nova-compute[98269]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.542241 np0000001643 nova-compute[98269]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.542241 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:37.544806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching for a device in session 25 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:37.545380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.545380 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:37.545380 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.545380 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:37.545380 np0000001643 nova-compute[98269]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.545380 np0000001643 nova-compute[98269]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:37.545380 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:37.548575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:37.548575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:37.548575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:37.548979 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] HCTL ('10', '-', '-', 0) found on session 26 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:37.549057 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:37.566773 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching for a device in session 26 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:37.566773 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:37.604102 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:37.609392 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:37.614017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:37.614017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:37.614017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:37.614017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:37.614278 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:37.617482 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:37.885605 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:03:37.896369 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dba069b2-1701-4763-bb19-4864568d85a8 tempest-TaggedBootDevicesTest_v242-769083887 tempest-TaggedBootDevicesTest_v242-769083887-project-member] Lock "986e86a9-d6cb-40b3-9c7b-263684816a96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.850s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:37.947062 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:03:37.947319 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:03:37.956358 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] End _get_guest_xml xml=<domain type="qemu">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <uuid>49f763dd-7f92-4295-87ec-b3d5bee75e1e</uuid>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <name>instance-00000010</name>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1262143297</nova:name>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:37</nova:creationTime>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:user uuid="d53f3f915c2d4a1fbe831e9c2c3ed43a">tempest-VolumesAdminNegativeTest-1757520100-project-member</nova:user>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:project uuid="0362446d0eb54dcfbf5fde3177bcdd09">tempest-VolumesAdminNegativeTest-1757520100</nova:project>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         <nova:port uuid="05dae846-999f-4371-bad1-7abd3de08673">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <system>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <entry name="serial">49f763dd-7f92-4295-87ec-b3d5bee75e1e</entry>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <entry name="uuid">49f763dd-7f92-4295-87ec-b3d5bee75e1e</entry>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </system>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <os>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   </os>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <features>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   </features>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   <devices>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk.config"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:e2:4e:76"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <target dev="tap05dae846-99"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </interface>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/console.log" append="off"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </serial>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <video>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </video>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </rng>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:   </devices>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]: </domain>
May 28 14:03:37.956358 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:03:37.960149 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Preparing to wait for external event network-vif-plugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:03:37.960149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:37.960149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:37.960149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:37.960149 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1262143297',display_name='tempest-VolumesAdminNegativeTest-server-1262143297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesadminnegativetest-server-1262143297',id=16,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0362446d0eb54dcfbf5fde3177bcdd09',ramdisk_id='',reservation_id='r-b2uxb6as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1757520100',owner_user_name='tempest-VolumesAdminNegativeTest-1757520100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:34Z,user_data=None,user_id='d53f3f915c2d4a1fbe831e9c2c3ed43a',uuid=49f763dd-7f92-4295-87ec-b3d5bee75e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:03:37.960149 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Converting VIF {"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:37.961948 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=05dae846-999f-4371-bad1-7abd3de08673,network=Network(60d6e2a4-a49c-45fb-b464-3fbd2a4028fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05dae846-99') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:37.962352 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=05dae846-999f-4371-bad1-7abd3de08673,network=Network(60d6e2a4-a49c-45fb-b464-3fbd2a4028fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05dae846-99') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:03:37.966917 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:37.967527 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:37.967908 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:03:37.969276 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:37.969548 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79182e57-17da-527f-af24-2fc87d113af3', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:37.972681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:37.972681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:37.973608 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:37.977024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:37.977024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05dae846-99, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:37.977605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05dae846-99, col_values=(('qos', UUID('40e1504f-f90d-4eac-860a-2aa492bcaa44')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:37.977913 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05dae846-99, col_values=(('external_ids', {'iface-id': '05dae846-999f-4371-bad1-7abd3de08673', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:4e:76', 'vm-uuid': '49f763dd-7f92-4295-87ec-b3d5bee75e1e'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:37.991537 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:37.992441 np0000001643 nova-compute[98269]: INFO os_vif [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=05dae846-999f-4371-bad1-7abd3de08673,network=Network(60d6e2a4-a49c-45fb-b464-3fbd2a4028fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05dae846-99')
May 28 14:03:38.024995 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:03:38.049228 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:03:38.084638 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.114718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.116060 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:03:38.119418 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977018.1189137, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:38.119589 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Paused (Lifecycle Event)
May 28 14:03:38.122931 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Took 7.84 seconds to spawn the instance on the hypervisor.
May 28 14:03:38.123378 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:38.123775 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.130394 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:03:38.158001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.160986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.355292 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:03:38.394790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:38.395032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:38.395265 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:38.395392 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:38.395659 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:38.395794 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state active and task_state None.
May 28 14:03:38.396636 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:38.396814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:38.398580 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:38.398797 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:38.399006 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] No waiting events found dispatching network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:38.399185 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f331f24b-aa47-460d-9011-bac2d28ccabf req-82f007de-0d1e-4cfc-9033-91739e9b2bbf service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:38.416629 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.434047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.453323 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Instance destroyed successfully.
May 28 14:03:38.453987 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'resources' on Instance uuid aaeff833-80ef-4909-96de-5958543e37ba {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:38.565093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.624409 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:38.628667 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977018.6280372, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:38.629298 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Resumed (Lifecycle Event)
May 28 14:03:38.647839 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Took 13.81 seconds to build instance.
May 28 14:03:38.766161 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f95c919a-c17b-457d-b6e9-07011c85069c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.557s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:38.960223 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1298993869',display_name='tempest-AttachVolumeNegativeTest-server-1298993869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-1298993869',id=2,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBj9VBjg4iTeEdQ5MADnTXtOYjY/NJnh65qfQpfCYOFibSVcbk2JD8z3EQBeybM9X8EEIN8I/Jye5zk4OhPhgIyUhabDOcVaPQcnmQf4Ryph97yOcVc0RU2oZjly31LsA==',key_name='tempest-keypair-13948228',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:29Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-p926h9k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=aaeff833-80ef-4909-96de-5958543e37ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:38.960819 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "0384c22d-d24f-466b-b3b2-61e8dc476888", "address": "fa:16:3e:60:f8:70", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0384c22d-d2", "ovs_interfaceid": "0384c22d-d24f-466b-b3b2-61e8dc476888", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:38.961124 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=0384c22d-d24f-466b-b3b2-61e8dc476888,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0384c22d-d2') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:38.961288 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=0384c22d-d24f-466b-b3b2-61e8dc476888,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0384c22d-d2') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:38.963010 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.964511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0384c22d-d2, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:38.965580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.966544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:38.976665 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.977615 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.977784 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=667a0108-0a30-4ccc-a0a2-28b181d1cee6) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:38.982098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:38.985304 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:38.987998 np0000001643 nova-compute[98269]: INFO os_vif [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=0384c22d-d24f-466b-b3b2-61e8dc476888,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0384c22d-d2')
May 28 14:03:38.988306 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Deleting instance files /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba_del
May 28 14:03:38.989111 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Deletion of /opt/stack/data/nova/instances/aaeff833-80ef-4909-96de-5958543e37ba_del complete
May 28 14:03:39.062470 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:39.062470 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:39.132884 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:39.134228 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:39.151689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-abd8c3ae-85e7-4639-93b6-3a0686f517a4 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.326s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:39.249249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.287912 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Rescuing
May 28 14:03:39.288184 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:39.288306 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:39.288484 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:39.376220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Found WWN 3300000005c17c7b0 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:03:39.376467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:39.376688 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000005c17c7b0', 'path': '/dev/dm-1', 'multipath_id': '3300000005c17c7b0'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:39.376896 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005c17c7b0', 'path': '/dev/dm-1', 'multipath_id': '3300000005c17c7b0'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:03:39.503141 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 14:03:39.503878 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:03:39.504871 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:03:39.504871 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: aaeff833-80ef-4909-96de-5958543e37ba] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:03:39.505066 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:39.513606 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:39.513606 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:39.513827 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] No VIF found with MAC fa:16:3e:e2:4e:76, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:39.514475 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Using config drive
May 28 14:03:39.564472 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:39.638414 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999662917000023 future=<Future at 0x71a75c217c50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:39.669007 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:39.791431 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:39.893099 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:21Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:03:39.893099 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:39.893510 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:39.895208 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] End _get_guest_xml xml=<domain type="qemu">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <uuid>16cfe8d8-1812-46a2-b92a-bd34d2cb7289</uuid>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <name>instance-0000000a</name>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <memory>262144</memory>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsTestOtherB-server-981658321</nova:name>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:36</nova:creationTime>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.micro" id="84">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:memory>256</nova:memory>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:user uuid="90f6ff80402b47b399ba052cccf0f141">tempest-ServerActionsTestOtherB-89556640-project-member</nova:user>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:project uuid="161254855aa54c71a7ac0a8a7076750c">tempest-ServerActionsTestOtherB-89556640</nova:project>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         <nova:port uuid="c438645f-c3e6-4778-91e5-ca2e1d7bbdd0">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <system>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <entry name="serial">16cfe8d8-1812-46a2-b92a-bd34d2cb7289</entry>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <entry name="uuid">16cfe8d8-1812-46a2-b92a-bd34d2cb7289</entry>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </system>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <os>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   </os>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <features>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   </features>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   <devices>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <alias name="ua-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-1"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <serial>9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd</serial>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ab:39:d2"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <target dev="tapc438645f-c3"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </interface>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/console.log" append="off"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </serial>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <video>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </video>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </rng>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:   </devices>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]: </domain>
May 28 14:03:39.895208 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:03:39.900423 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:21Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:03:39.900423 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-923690610-network", "vif_mac": "fa:16:3e:ab:39:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:39.900423 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:39.900423 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:03:39.900423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.900423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:39.900423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:03:39.901238 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.901410 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bb2f8b6-1dbd-521e-96cd-d1ab1fd08eb7', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:39.902205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.902867 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:39.908303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.912038 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.912265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc438645f-c3, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:39.912555 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc438645f-c3, col_values=(('qos', UUID('494b5d8d-0739-4c22-9b0c-c54deeab9f93')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:39.913040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc438645f-c3, col_values=(('external_ids', {'iface-id': 'c438645f-c3e6-4778-91e5-ca2e1d7bbdd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:39:d2', 'vm-uuid': '16cfe8d8-1812-46a2-b92a-bd34d2cb7289'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:39.914035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.916201 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:39.938228 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:39.939246 np0000001643 nova-compute[98269]: INFO os_vif [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3')
May 28 14:03:40.024723 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:40.076421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.302s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:40.078106 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:03:40.083460 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 10.523s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:40.096272 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:40.096272 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Claim successful on node np0000001643
May 28 14:03:40.264278 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-changed-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:40.264278 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Refreshing instance network info cache due to event network-changed-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:40.264278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] Acquiring lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:40.264278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] Acquired lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:40.264278 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Refreshing network info cache for port bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:40.366655 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Creating config drive at /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk.config
May 28 14:03:40.371355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_4dofmz_ {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:40.445491 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_4dofmz_" returned: 0 in 0.074s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:40.539978 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:40.540351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] Acquiring lock "aaeff833-80ef-4909-96de-5958543e37ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:40.540952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:40.541185 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] Lock "aaeff833-80ef-4909-96de-5958543e37ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:40.542101 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] No waiting events found dispatching network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:40.542101 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-unplugged-0384c22d-d24f-466b-b3b2-61e8dc476888 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:40.542101 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Received event network-vif-deleted-0384c22d-d24f-466b-b3b2-61e8dc476888 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:40.542101 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Neutron deleted interface 0384c22d-d24f-466b-b3b2-61e8dc476888; detaching it from the instance and deleting it from the info cache
May 28 14:03:40.546062 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5dc74365-33da-40b3-a553-3089078f3797 req-1f417e70-e8cf-4b71-af4f-9bca4a96c5a2 service nova] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Detach interface failed, port_id=0384c22d-d24f-466b-b3b2-61e8dc476888, reason: Instance aaeff833-80ef-4909-96de-5958543e37ba could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:03:40.591536 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:03:40.591780 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:03:40.592019 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:40.592285 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:40.596661 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Snapshot image upload complete
May 28 14:03:40.598539 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-aab59f5d-7ea9-47a9-92e0-f9e71b8ac553 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Took 5.80 seconds to snapshot the instance on the hypervisor.
May 28 14:03:40.676367 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:40.690069 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '331414b567e44229ba16f8d95b6133ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc79c5d191d54ea188016726111808fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:03:40.768047 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:40.861806 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:40.914346 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:40.984154 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:41.028496 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:41.105622 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:03:41.149485 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:41.260826 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:41.333624 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-40178a59-0135-48cb-925a-ad1155bcfdad req-88e5b50b-467f-4f83-b82a-a2d276f6fa16 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-vif-plugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:41.333624 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40178a59-0135-48cb-925a-ad1155bcfdad req-88e5b50b-467f-4f83-b82a-a2d276f6fa16 service nova] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:41.336367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40178a59-0135-48cb-925a-ad1155bcfdad req-88e5b50b-467f-4f83-b82a-a2d276f6fa16 service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:41.336880 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40178a59-0135-48cb-925a-ad1155bcfdad req-88e5b50b-467f-4f83-b82a-a2d276f6fa16 service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:41.337067 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-40178a59-0135-48cb-925a-ad1155bcfdad req-88e5b50b-467f-4f83-b82a-a2d276f6fa16 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Processing event network-vif-plugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:03:41.365204 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Took 1.86 seconds to deallocate network for instance.
May 28 14:03:41.418487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:41.432562 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:41.438822 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:41.478770 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:41.489967 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:41.490408 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:41.490695 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:41.491944 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] No VIF found with MAC fa:16:3e:ab:39:d2, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:41.494232 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Using config drive
May 28 14:03:41.499059 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:41.586628 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updated VIF entry in instance network info cache for port bd542e8b-1f1b-4e59-8c1b-fe44bfd93140. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:03:41.587579 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updating instance_info_cache with network_info: [{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:41.611054 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:03:41.690070 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Successfully created port: 216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:03:41.875470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:42.070176 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:42.096633 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f97acfd2-e6ce-40d9-b186-a2e9a76e7e21 req-4f806aef-55f3-4c6c-8386-b63f44e012cb service nova] Releasing lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:42.111270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:42.163048 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:42.163200 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:42.222781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:42.284989 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977022.2844229, 49f763dd-7f92-4295-87ec-b3d5bee75e1e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:42.286431 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] VM Started (Lifecycle Event)
May 28 14:03:42.286431 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:03:42.292145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:03:42.294575 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Instance spawned successfully.
May 28 14:03:42.296174 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:03:42.481241 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f7bdbeb-2236-4d43-b324-a98b5a2feb4c req-c128db91-7df2-4533-862f-3c8fbca80403 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:42.481241 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f7bdbeb-2236-4d43-b324-a98b5a2feb4c req-c128db91-7df2-4533-862f-3c8fbca80403 service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:42.481867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f7bdbeb-2236-4d43-b324-a98b5a2feb4c req-c128db91-7df2-4533-862f-3c8fbca80403 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:42.481867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f7bdbeb-2236-4d43-b324-a98b5a2feb4c req-c128db91-7df2-4533-862f-3c8fbca80403 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:42.481867 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f7bdbeb-2236-4d43-b324-a98b5a2feb4c req-c128db91-7df2-4533-862f-3c8fbca80403 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:42.481867 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-3f7bdbeb-2236-4d43-b324-a98b5a2feb4c req-c128db91-7df2-4533-862f-3c8fbca80403 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state active and task_state resize_finish.
May 28 14:03:42.513040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:42.517393 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:42.524124 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:42.552285 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:42.590888 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Successfully updated port: 216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:03:42.650256 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:03:42.650714 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:03:42.650959 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Creating image(s)
May 28 14:03:42.651918 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "/opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:42.655355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "/opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:42.661769 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "/opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:42.663761 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:42.668809 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:42.683837 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:42.692284 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-changed-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:42.697585 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:42.721530 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Refreshing instance network info cache due to event network-changed-216c46d3-e616-44df-a61a-5882b0ce26ec. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:42.731498 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] Acquiring lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:42.734310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] Acquired lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:42.736070 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Refreshing network info cache for port 216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:42.742678 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.016861475999803588 future=<Future at 0x71a75c72c170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:42.742678 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:42.742678 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=11.896452511000007 future=<Future at 0x71a75c217c50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:42.742678 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=11.896317632000091 future=<Future at 0x71a75c217c50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:42.746154 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Emitting event <LifecycleEvent: 1779977007.724252, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:42.746954 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Stopped (Lifecycle Event)
May 28 14:03:42.796064 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:42.808070 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:42.813503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:42.813503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:42.813503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:42.813503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:42.813503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:42.813503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:42.827249 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.130s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:42.828682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:42.829228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:42.829969 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:42.840387 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:42.840387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:42.941653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:42.943149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:43.001474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk 1073741824" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:43.003337 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:43.003746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:43.097701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:43.104382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:43.105167 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:03:43.105563 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:43.182364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.099s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:43.182917 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:03:43.190617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.315s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:43.208299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:43.222544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:43.222544 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Cannot resize image /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:03:43.222544 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:03:43.222544 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Ensure instance console log exists: /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:03:43.224698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:43.224698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:43.224698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:43.227208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:43.244648 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:43.258381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e7a3c37d-6378-4a0b-8195-8e896c20fa0f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:43.322577 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:03:43.324198 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977023.3227487, 49f763dd-7f92-4295-87ec-b3d5bee75e1e => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:43.324198 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] VM Paused (Lifecycle Event)
May 28 14:03:43.329884 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Took 8.20 seconds to spawn the instance on the hypervisor.
May 28 14:03:43.330526 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:43.339767 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:03:43.346824 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance running successfully.
May 28 14:03:43.349682 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Failed to set time: agent not configured {{(pid=98269) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 14:03:43.349824 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34cb9b6d-5009-401b-8404-4e58777ea6d5 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] finish_migration finished successfully. {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 14:03:43.450889 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:43.457934 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-871fa49b-3827-4935-8ace-9c62d349ccb6 req-27718c38-7f42-4983-9dda-e20e1b899404 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-vif-plugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:43.458309 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-871fa49b-3827-4935-8ace-9c62d349ccb6 req-27718c38-7f42-4983-9dda-e20e1b899404 service nova] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:43.459536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-871fa49b-3827-4935-8ace-9c62d349ccb6 req-27718c38-7f42-4983-9dda-e20e1b899404 service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:43.459736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-871fa49b-3827-4935-8ace-9c62d349ccb6 req-27718c38-7f42-4983-9dda-e20e1b899404 service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:43.459915 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-871fa49b-3827-4935-8ace-9c62d349ccb6 req-27718c38-7f42-4983-9dda-e20e1b899404 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] No waiting events found dispatching network-vif-plugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:43.460191 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-871fa49b-3827-4935-8ace-9c62d349ccb6 req-27718c38-7f42-4983-9dda-e20e1b899404 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received unexpected event network-vif-plugged-05dae846-999f-4371-bad1-7abd3de08673 for instance with vm_state building and task_state spawning.
May 28 14:03:43.495181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:43.507717 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:43.608635 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance destroyed successfully.
May 28 14:03:43.608635 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'numa_topology' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:43.704314 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:03:43.704314 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:03:43.704726 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:43.704726 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:43.738424 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:43.826769 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '331414b567e44229ba16f8d95b6133ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc79c5d191d54ea188016726111808fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:03:43.831648 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:43.835152 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977023.8342993, 49f763dd-7f92-4295-87ec-b3d5bee75e1e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:43.836910 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] VM Resumed (Lifecycle Event)
May 28 14:03:43.849369 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Took 18.19 seconds to build instance.
May 28 14:03:43.895265 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:43.895805 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:44.113648 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Attempting rescue
May 28 14:03:44.114246 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 14:03:44.119176 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:03:44.119372 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Creating image(s)
May 28 14:03:44.120094 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:44.122207 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:44.122207 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:44.122207 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:44.203884 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:03:44.251395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2427cb14-83f9-4da9-b714-ef5e250bcde8 req-a3e8d4cb-ecbe-4d01-bbcb-9f209e2bb4ce service nova] Releasing lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:44.251816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:44.254200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquired lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:44.254402 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:44.300045 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:44.300045 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:44.341403 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:44.348434 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:44.351066 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.730s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:44.399080 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:03:44.587210 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Successfully created port: 069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:03:44.610240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:44.610426 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:44.610611 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:44.611164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:44.611761 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:44.611883 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state resized and task_state None.
May 28 14:03:44.611978 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:44.612156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:44.612354 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:44.612419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:44.612610 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:44.612610 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state active and task_state rescuing.
May 28 14:03:44.612797 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:44.612889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:44.613089 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:44.613234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:44.613378 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:44.613541 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f47978b5-c207-413b-b385-7ea55b95bc4d req-dd90b5fc-559b-488e-902f-e82b71028fbd service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state active and task_state rescuing.
May 28 14:03:44.623904 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:44.624367 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:44.627910 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:44.629516 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:44.629981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:44.630101 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:44.632390 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:44.632884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:44.710875 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:03:44.727467 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:44.728300 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.rescue {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:44.788355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.rescue" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:44.789160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:44.789623 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'migration_context' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:44.804188 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:44.854508 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977024.8540874, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:44.854769 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Resumed (Lifecycle Event)
May 28 14:03:44.877694 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:44.919248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:44.990829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:45.114118 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:45.293070 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:45.293486 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:03:45.294261 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Start _get_guest_xml network_info=[{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:1a:79:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ad923155-4eca-4cf1-b871-662172c18500', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:45.295276 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'resources' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:45.299960 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Successfully updated port: 069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:03:45.315785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.125s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:45.319313 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.328s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:45.330097 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:45.330307 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Claim successful on node np0000001643
May 28 14:03:45.344790 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Updating instance_info_cache with network_info: [{"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:45.358314 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:45.360814 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:45.402725 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-changed-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:45.403288 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Refreshing instance network info cache due to event network-changed-069820b4-ab96-49ca-aa7b-fdf17b731e95. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:45.403903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] Acquiring lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:45.404011 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] Acquired lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:45.404213 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Refreshing network info cache for port 069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:45.421508 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Deleted allocations for instance aaeff833-80ef-4909-96de-5958543e37ba
May 28 14:03:45.432894 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:45.578640 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:45.578791 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:45.578966 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:45.659612 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Port c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 binding to destination host np0000001643 is already ACTIVE {{(pid=98269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 14:03:45.659793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:45.659880 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquired lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:45.659991 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:45.726569 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:03:45.727728 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:03:45.727995 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Creating image(s)
May 28 14:03:45.728677 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:45.728870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "/opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:45.729399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "/opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:45.729880 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:45.732915 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:45.733959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:45.803391 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:45.804674 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:45.807626 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:45.809801 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1960360925', uuid='4dc73d91-4d87-4283-9a77-607c0e512265'), owner=OwnerMeta(userid='3deb2050ffd5441bb38c08eb82707d7d', username='tempest-ServerRescueNegativeTestJSON-1154493123-project-member', projectid='9bfe2941b78c4f2e9f16f60e05ec5dcc', projectname='tempest-ServerRescueNegativeTestJSON-1154493123'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:1a:79:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977025.8091493) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:45.810945 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:45.811436 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:45.812310 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:45.812578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:45.813991 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:45.814465 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:45.814679 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:45.814814 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:45.815113 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:45.815236 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:45.815393 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:45.815624 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:45.815791 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:45.815947 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:45.816108 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:45.816271 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:45.816498 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:45.819389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:45.819898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:45.821079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:45.821592 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:45.826296 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:03:45.826887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:45.852217 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Releasing lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:45.853200 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Instance network_info: |[{"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:03:45.856771 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Start _get_guest_xml network_info=[{"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:45.861547 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:45.863386 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-952631114-1', uuid='854e01ef-64f4-464f-8a46-ef352e4ccf2a'), owner=OwnerMeta(userid='331414b567e44229ba16f8d95b6133ed', username='tempest-TestMultiAttachVolumeSwap-1324034633-project-member', projectid='bc79c5d191d54ea188016726111808fd', projectname='tempest-TestMultiAttachVolumeSwap-1324034633'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977025.8627803) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:45.865332 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 14:03:45.865332 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977025.8649569, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:45.865503 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Started (Lifecycle Event)
May 28 14:03:45.868534 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:45.869288 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:45.872647 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:45.873089 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:45.873089 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:45.873089 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:45.873089 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:45.873212 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:45.886540 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-952631114-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testmultiattachvolumeswap-server-952631114-1',id=17,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymOBRdK4BTpFgE86zLGQ/ieEXGqO4hU/tjuUDx5k3Ub5SCTnNZeFqJRhsAdh6olRD8+ep0TkCvA93/y/m0ISZOrKT2ZNkp5UiBCf++59eYCxpLfaERm0W9KLDWT/8UNg==',key_name='tempest-keypair-2006327443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc79c5d191d54ea188016726111808fd',ramdisk_id='',reservation_id='r-r51iwbsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1324034633',owner_user_name='tempest-TestMultiAttachVolumeSwap-1324034633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331414b567e44229ba16f8d95b6133ed',uuid=854e01ef-64f4-464f-8a46-ef352e4ccf2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:03:45.886781 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converting VIF {"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:45.887393 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=216c46d3-e616-44df-a61a-5882b0ce26ec,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216c46d3-e6') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:45.888415 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'pci_devices' on Instance uuid 854e01ef-64f4-464f-8a46-ef352e4ccf2a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:45.908310 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:45.931376 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:45.931376 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:45.986195 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk 1073741824" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:45.986675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:45.987328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:46.007663 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:46.075981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:46.076500 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:03:46.076739 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:46.162997 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:46.165338 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:46.165941 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Cannot resize image /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:03:46.166929 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:03:46.168578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Ensure instance console log exists: /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:03:46.168578 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:46.168578 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:46.168578 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:46.221215 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:46.319810 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:46.343191 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1960360925',display_name='tempest-ServerRescueNegativeTestJSON-server-1960360925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-1960360925',id=13,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPY7gcyM15HNMgUUrWL0PnUGvfKERrlJnRdaJjn6fmYO1DMIBfebiD81LEUfKQS34wQzehV/k1KDg8WmREMFPeUgC7522BiSxNEo2YvLvOoa2G23jVYDsxb/94YmFCZRw==',key_name='tempest-keypair-462257235',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:50Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-3jxixxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=4dc73d91-4d87-4283-9a77-607c0e512265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:1a:79:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:03:46.343772 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "vif_mac": "fa:16:3e:1a:79:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:46.344563 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:46.345817 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:46.371744 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:46.374506 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:46.392140 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] End _get_guest_xml xml=<domain type="qemu">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <uuid>854e01ef-64f4-464f-8a46-ef352e4ccf2a</uuid>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <name>instance-00000011</name>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-952631114-1</nova:name>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:45</nova:creationTime>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:user uuid="331414b567e44229ba16f8d95b6133ed">tempest-TestMultiAttachVolumeSwap-1324034633-project-member</nova:user>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:project uuid="bc79c5d191d54ea188016726111808fd">tempest-TestMultiAttachVolumeSwap-1324034633</nova:project>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         <nova:port uuid="216c46d3-e616-44df-a61a-5882b0ce26ec">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <system>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <entry name="serial">854e01ef-64f4-464f-8a46-ef352e4ccf2a</entry>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <entry name="uuid">854e01ef-64f4-464f-8a46-ef352e4ccf2a</entry>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </system>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <os>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   </os>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <features>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   </features>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   <devices>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk.config"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:b2:5c:60"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <target dev="tap216c46d3-e6"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </interface>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/console.log" append="off"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </serial>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <video>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </video>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </rng>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:   </devices>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]: </domain>
May 28 14:03:46.392140 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:03:46.394846 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Preparing to wait for external event network-vif-plugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:03:46.394846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:46.394846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:46.394846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:46.394846 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-952631114-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testmultiattachvolumeswap-server-952631114-1',id=17,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymOBRdK4BTpFgE86zLGQ/ieEXGqO4hU/tjuUDx5k3Ub5SCTnNZeFqJRhsAdh6olRD8+ep0TkCvA93/y/m0ISZOrKT2ZNkp5UiBCf++59eYCxpLfaERm0W9KLDWT/8UNg==',key_name='tempest-keypair-2006327443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc79c5d191d54ea188016726111808fd',ramdisk_id='',reservation_id='r-r51iwbsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1324034633',owner_user_name='tempest-TestMultiAttachVolumeSwap-1324034633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331414b567e44229ba16f8d95b6133ed',uuid=854e01ef-64f4-464f-8a46-ef352e4ccf2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:03:46.394846 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converting VIF {"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:46.398110 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=216c46d3-e616-44df-a61a-5882b0ce26ec,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216c46d3-e6') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:46.398110 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=216c46d3-e616-44df-a61a-5882b0ce26ec,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216c46d3-e6') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:03:46.398936 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.399338 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:46.399675 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:03:46.402020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.402231 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dfb2ccf-3d0f-5225-8814-e1fc80a5244a', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:46.405815 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.411092 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:46.415033 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.428971 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.429492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap216c46d3-e6, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:46.430306 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap216c46d3-e6, col_values=(('qos', UUID('ca7a6f18-a692-4784-a8c8-c5ecfe57e752')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:46.430600 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap216c46d3-e6, col_values=(('external_ids', {'iface-id': '216c46d3-e616-44df-a61a-5882b0ce26ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:5c:60', 'vm-uuid': '854e01ef-64f4-464f-8a46-ef352e4ccf2a'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:46.434384 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.442239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:46.443134 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5fa5240-eb2f-4925-955d-e50d0580dba0 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "aaeff833-80ef-4909-96de-5958543e37ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.908s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:46.445569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.448477 np0000001643 nova-compute[98269]: INFO os_vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=216c46d3-e616-44df-a61a-5882b0ce26ec,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216c46d3-e6')
May 28 14:03:46.604254 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:46.727483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1266bdb9-a8da-4d6c-b936-360e4247265c req-cae661e9-3668-4bac-bb62-669649221a0c service nova] Releasing lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:46.730163 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquired lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:46.730163 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:46.817710 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:46.847879 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:46.849163 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] End _get_guest_xml xml=<domain type="qemu">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <uuid>4dc73d91-4d87-4283-9a77-607c0e512265</uuid>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <name>instance-0000000d</name>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1960360925</nova:name>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:45</nova:creationTime>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:user uuid="3deb2050ffd5441bb38c08eb82707d7d">tempest-ServerRescueNegativeTestJSON-1154493123-project-member</nova:user>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:project uuid="9bfe2941b78c4f2e9f16f60e05ec5dcc">tempest-ServerRescueNegativeTestJSON-1154493123</nova:project>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         <nova:port uuid="441edb5a-a183-4686-ad86-714a3ab59d5f">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <system>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <entry name="serial">4dc73d91-4d87-4283-9a77-607c0e512265</entry>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <entry name="uuid">4dc73d91-4d87-4283-9a77-607c0e512265</entry>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </system>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <os>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   </os>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <features>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   </features>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   <devices>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.rescue"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config.rescue"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:1a:79:0d"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <target dev="tap441edb5a-a1"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </interface>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/console.log" append="off"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </serial>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <video>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </video>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </rng>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:   </devices>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]: </domain>
May 28 14:03:46.849163 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:03:46.859473 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance destroyed successfully.
May 28 14:03:46.877796 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 14:03:46.879831 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999720644000035 future=<Future at 0x71a75c2c5f40 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:47.089703 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:47.165680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:47.165680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:47.165680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:47.165680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:47.165680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:47.169931 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Terminating instance
May 28 14:03:47.338037 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:47.338755 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:47.350632 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:47.577590 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:47.594073 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Releasing lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:47.675085 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:03:47.720128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:47.720627 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:47.747460 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:47.752318 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:47.795874 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updating instance_info_cache with network_info: [{"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:47.797547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:47.841280 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:47.982180 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:47.982180 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:47.982180 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No VIF found with MAC fa:16:3e:b2:5c:60, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:47.984416 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Using config drive
May 28 14:03:48.040439 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999681912999904 future=<Future at 0x71a75c29ee40 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:48.041846 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Instance destroyed successfully.
May 28 14:03:48.043945 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lazy-loading 'resources' on Instance uuid 49f763dd-7f92-4295-87ec-b3d5bee75e1e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:48.097149 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Creating tmpfile /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/tmpecu088zx to verify with other compute node that the instance is on the same shared storage. {{(pid=98269) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 14:03:48.097372 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:03:48.199979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-18124638-f9c5-438c-a202-0b1d41e8b45b req-7a8f285b-fec5-49e5-9080-025e1b4fa5a2 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-vif-unplugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:48.201370 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-18124638-f9c5-438c-a202-0b1d41e8b45b req-7a8f285b-fec5-49e5-9080-025e1b4fa5a2 service nova] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:48.201681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-18124638-f9c5-438c-a202-0b1d41e8b45b req-7a8f285b-fec5-49e5-9080-025e1b4fa5a2 service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:48.201843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-18124638-f9c5-438c-a202-0b1d41e8b45b req-7a8f285b-fec5-49e5-9080-025e1b4fa5a2 service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:48.202076 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-18124638-f9c5-438c-a202-0b1d41e8b45b req-7a8f285b-fec5-49e5-9080-025e1b4fa5a2 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] No waiting events found dispatching network-vif-unplugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:48.202251 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-18124638-f9c5-438c-a202-0b1d41e8b45b req-7a8f285b-fec5-49e5-9080-025e1b4fa5a2 service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-vif-unplugged-05dae846-999f-4371-bad1-7abd3de08673 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:48.299866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Releasing lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:48.300228 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Instance network_info: |[{"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:03:48.304171 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Start _get_guest_xml network_info=[{"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:48.310049 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:48.311789 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-952631114-2', uuid='7c6f49c3-6903-4440-987d-dc99e23240bf'), owner=OwnerMeta(userid='331414b567e44229ba16f8d95b6133ed', username='tempest-TestMultiAttachVolumeSwap-1324034633-project-member', projectid='bc79c5d191d54ea188016726111808fd', projectname='tempest-TestMultiAttachVolumeSwap-1324034633'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977028.3112214) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:48.314480 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:48.314905 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:48.316749 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:48.316974 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:48.317922 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:48.318306 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:48.318460 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:48.318565 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:48.318687 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:48.318777 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:48.318863 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:48.319025 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:48.319125 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:48.319369 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:48.319441 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:48.321134 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:48.334707 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-952631114-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testmultiattachvolumeswap-server-952631114-2',id=18,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymOBRdK4BTpFgE86zLGQ/ieEXGqO4hU/tjuUDx5k3Ub5SCTnNZeFqJRhsAdh6olRD8+ep0TkCvA93/y/m0ISZOrKT2ZNkp5UiBCf++59eYCxpLfaERm0W9KLDWT/8UNg==',key_name='tempest-keypair-2006327443',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc79c5d191d54ea188016726111808fd',ramdisk_id='',reservation_id='r-r51iwbsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1324034633',owner_user_name='tempest-TestMultiAttachVolumeSwap-1324034633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331414b567e44229ba16f8d95b6133ed',uuid=7c6f49c3-6903-4440-987d-dc99e23240bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:03:48.334901 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converting VIF {"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:48.335374 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:e2,bridge_name='br-int',has_traffic_filtering=True,id=069820b4-ab96-49ca-aa7b-fdf17b731e95,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069820b4-ab') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:48.336522 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c6f49c3-6903-4440-987d-dc99e23240bf {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:48.350791 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:48.351058 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:03:48.378248 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:48.378248 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:48.378425 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:48.378425 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] No VIF found with MAC fa:16:3e:1a:79:0d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:48.378981 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Using config drive
May 28 14:03:48.492037 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:48.547776 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1262143297',display_name='tempest-VolumesAdminNegativeTest-server-1262143297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesadminnegativetest-server-1262143297',id=16,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:43Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0362446d0eb54dcfbf5fde3177bcdd09',ramdisk_id='',reservation_id='r-b2uxb6as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1757520100',owner_user_name='tempest-VolumesAdminNegativeTest-1757520100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:43Z,user_data=None,user_id='d53f3f915c2d4a1fbe831e9c2c3ed43a',uuid=49f763dd-7f92-4295-87ec-b3d5bee75e1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:48.548153 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Converting VIF {"id": "05dae846-999f-4371-bad1-7abd3de08673", "address": "fa:16:3e:e2:4e:76", "network": {"id": "60d6e2a4-a49c-45fb-b464-3fbd2a4028fb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-729032239-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0362446d0eb54dcfbf5fde3177bcdd09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05dae846-99", "ovs_interfaceid": "05dae846-999f-4371-bad1-7abd3de08673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:48.548945 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=05dae846-999f-4371-bad1-7abd3de08673,network=Network(60d6e2a4-a49c-45fb-b464-3fbd2a4028fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05dae846-99') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:48.549481 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=05dae846-999f-4371-bad1-7abd3de08673,network=Network(60d6e2a4-a49c-45fb-b464-3fbd2a4028fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05dae846-99') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:48.551729 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.552233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05dae846-99, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:48.553206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.554302 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:48.568728 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.571083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.571083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40e1504f-f90d-4eac-860a-2aa492bcaa44) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:48.573601 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.574425 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:48.591473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.595431 np0000001643 nova-compute[98269]: INFO os_vif [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=05dae846-999f-4371-bad1-7abd3de08673,network=Network(60d6e2a4-a49c-45fb-b464-3fbd2a4028fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05dae846-99')
May 28 14:03:48.595989 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Deleting instance files /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e_del
May 28 14:03:48.596848 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Deletion of /opt/stack/data/nova/instances/49f763dd-7f92-4295-87ec-b3d5bee75e1e_del complete
May 28 14:03:48.665469 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.671475 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.696683 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Creating config drive at /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk.config
May 28 14:03:48.699644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.700953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.704392 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0hze7v24 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:48.743936 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.751338 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0hze7v24" returned: 0 in 0.047s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:48.842084 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] End _get_guest_xml xml=<domain type="qemu">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <uuid>7c6f49c3-6903-4440-987d-dc99e23240bf</uuid>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <name>instance-00000012</name>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-952631114-2</nova:name>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:48</nova:creationTime>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:user uuid="331414b567e44229ba16f8d95b6133ed">tempest-TestMultiAttachVolumeSwap-1324034633-project-member</nova:user>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:project uuid="bc79c5d191d54ea188016726111808fd">tempest-TestMultiAttachVolumeSwap-1324034633</nova:project>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         <nova:port uuid="069820b4-ab96-49ca-aa7b-fdf17b731e95">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <system>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <entry name="serial">7c6f49c3-6903-4440-987d-dc99e23240bf</entry>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <entry name="uuid">7c6f49c3-6903-4440-987d-dc99e23240bf</entry>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </system>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <os>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   </os>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <features>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   </features>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   <devices>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk.config"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </disk>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:42:9e:e2"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <target dev="tap069820b4-ab"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </interface>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/console.log" append="off"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </serial>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <video>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </video>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </rng>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:   </devices>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]: </domain>
May 28 14:03:48.842084 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:03:48.844788 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Preparing to wait for external event network-vif-plugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:03:48.844788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:48.844788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:48.844788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:48.844788 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-952631114-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testmultiattachvolumeswap-server-952631114-2',id=18,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymOBRdK4BTpFgE86zLGQ/ieEXGqO4hU/tjuUDx5k3Ub5SCTnNZeFqJRhsAdh6olRD8+ep0TkCvA93/y/m0ISZOrKT2ZNkp5UiBCf++59eYCxpLfaERm0W9KLDWT/8UNg==',key_name='tempest-keypair-2006327443',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc79c5d191d54ea188016726111808fd',ramdisk_id='',reservation_id='r-r51iwbsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1324034633',owner_user_name='tempest-TestMultiAttachVolumeSwap-1324034633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331414b567e44229ba16f8d95b6133ed',uuid=7c6f49c3-6903-4440-987d-dc99e23240bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:03:48.844788 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converting VIF {"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:48.845663 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:e2,bridge_name='br-int',has_traffic_filtering=True,id=069820b4-ab96-49ca-aa7b-fdf17b731e95,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069820b4-ab') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:48.845770 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:e2,bridge_name='br-int',has_traffic_filtering=True,id=069820b4-ab96-49ca-aa7b-fdf17b731e95,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069820b4-ab') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:03:48.846320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.846796 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:48.847171 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:03:48.848797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.849204 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65db6bb6-e156-55e0-9dc1-571aef0d6925', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:48.851799 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.852121 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:48.860910 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:03:48.861149 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:03:48.861664 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:48.862147 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:48.872713 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.876683 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.877598 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap069820b4-ab, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:48.877598 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap069820b4-ab, col_values=(('qos', UUID('c8812233-bb0f-4701-8cde-815472199f8f')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:48.877855 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap069820b4-ab, col_values=(('external_ids', {'iface-id': '069820b4-ab96-49ca-aa7b-fdf17b731e95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:9e:e2', 'vm-uuid': '7c6f49c3-6903-4440-987d-dc99e23240bf'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:48.880541 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.882822 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:48.884598 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:48.909835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:48.915199 np0000001643 nova-compute[98269]: INFO os_vif [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:e2,bridge_name='br-int',has_traffic_filtering=True,id=069820b4-ab96-49ca-aa7b-fdf17b731e95,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069820b4-ab')
May 28 14:03:48.926037 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79bb3cf8-dcce-4cb1-8de1-5479088d2a68 req-c1233c7e-bc3d-4449-a78e-8523a44c8a77 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:48.926487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79bb3cf8-dcce-4cb1-8de1-5479088d2a68 req-c1233c7e-bc3d-4449-a78e-8523a44c8a77 service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:48.926674 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79bb3cf8-dcce-4cb1-8de1-5479088d2a68 req-c1233c7e-bc3d-4449-a78e-8523a44c8a77 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:48.926821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79bb3cf8-dcce-4cb1-8de1-5479088d2a68 req-c1233c7e-bc3d-4449-a78e-8523a44c8a77 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:48.926924 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79bb3cf8-dcce-4cb1-8de1-5479088d2a68 req-c1233c7e-bc3d-4449-a78e-8523a44c8a77 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:48.927073 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-79bb3cf8-dcce-4cb1-8de1-5479088d2a68 req-c1233c7e-bc3d-4449-a78e-8523a44c8a77 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state resized and task_state resize_reverting.
May 28 14:03:48.980636 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86dc22a5d6a7478dab81969f17d3daab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74df57519ea42009fcebcff7cfdf94e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:03:49.113506 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 14:03:49.116739 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:03:49.116739 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:03:49.116739 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:03:49.116739 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:49.253592 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.373804 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:03:49.396919 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:49.397238 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'keypairs' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:49.449685 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999633643999914 future=<Future at 0x71a75c2570b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:49.452368 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance destroyed successfully.
May 28 14:03:49.452904 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lazy-loading 'resources' on Instance uuid 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:49.463970 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.492630 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:49.613688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.639299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.657185 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.691434 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Successfully created port: f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:03:49.883001 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:03:49.902092 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:49.909413 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:49.915216 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.935831 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.944719 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.959098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:43Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:03:49.959719 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:03:49.960318 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:03:49.960615 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:03:49.961733 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.964473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc438645f-c3, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:49.966215 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:49.978079 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.997355 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:49.999927 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:50.000387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=494b5d8d-0739-4c22-9b0c-c54deeab9f93) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:03:50.003813 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:50.004743 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:03:50.014224 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-195fcb9e-8f84-4836-85cf-f4eebb41bfe9 req-d371d44c-fef1-44d1-a679-7ec867a98428 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-vif-plugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:50.014517 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-195fcb9e-8f84-4836-85cf-f4eebb41bfe9 req-d371d44c-fef1-44d1-a679-7ec867a98428 service nova] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:50.014723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-195fcb9e-8f84-4836-85cf-f4eebb41bfe9 req-d371d44c-fef1-44d1-a679-7ec867a98428 service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:50.014901 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-195fcb9e-8f84-4836-85cf-f4eebb41bfe9 req-d371d44c-fef1-44d1-a679-7ec867a98428 service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:50.015191 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-195fcb9e-8f84-4836-85cf-f4eebb41bfe9 req-d371d44c-fef1-44d1-a679-7ec867a98428 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Processing event network-vif-plugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:03:50.017748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:50.021345 np0000001643 nova-compute[98269]: INFO os_vif [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3')
May 28 14:03:50.025369 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:03:50.026202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:50.026436 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:50.026943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:50.027373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:03:50.027634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:03:50.069114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:50.069114 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:50.069114 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:50.069114 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:50.069114 np0000001643 nova-compute[98269]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:50.069114 np0000001643 nova-compute[98269]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:50.069114 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:50.069509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:50.069509 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:50.069509 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:50.069509 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:50.069509 np0000001643 nova-compute[98269]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:50.069509 np0000001643 nova-compute[98269]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:03:50.069509 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:50.069509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '26')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:03:50.069796 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '25')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:50.070647 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '26')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:03:50.071539 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781bd6c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:03:50.071912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:03:50.072547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flush multipath device 3300000005c17c7b0 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:03:50.108616 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:50.136894 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Creating config drive at /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config.rescue
May 28 14:03:50.142644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5sozjbr7 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:50.162898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:03:50.208272 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5sozjbr7" returned: 0 in 0.065s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:50.225150 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:03:50.227102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:03:50.227481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:03:50.243653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:03:50.244078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:03:50.264735 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:50.311850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260]
May 28 14:03:50.311850 np0000001643 nova-compute[98269]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260] successful.
May 28 14:03:50.311850 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:50.317703 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6a96f4e9-180f-4b3c-8251-beadb3c9ffe2 req-63507773-521a-48d3-a017-e12b328a3b7b service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-vif-unplugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:50.318202 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6a96f4e9-180f-4b3c-8251-beadb3c9ffe2 req-63507773-521a-48d3-a017-e12b328a3b7b service nova] Acquiring lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:50.318431 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6a96f4e9-180f-4b3c-8251-beadb3c9ffe2 req-63507773-521a-48d3-a017-e12b328a3b7b service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:50.318656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6a96f4e9-180f-4b3c-8251-beadb3c9ffe2 req-63507773-521a-48d3-a017-e12b328a3b7b service nova] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:50.318828 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6a96f4e9-180f-4b3c-8251-beadb3c9ffe2 req-63507773-521a-48d3-a017-e12b328a3b7b service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] No waiting events found dispatching network-vif-unplugged-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:50.320551 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6a96f4e9-180f-4b3c-8251-beadb3c9ffe2 req-63507773-521a-48d3-a017-e12b328a3b7b service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-vif-unplugged-05dae846-999f-4371-bad1-7abd3de08673 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:03:50.342349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:50.357538 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:50.388911 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:50.394852 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Booting with volume-backed-image ad923155-4eca-4cf1-b871-662172c18500 at /dev/vda
May 28 14:03:50.397661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260]
May 28 14:03:50.397661 np0000001643 nova-compute[98269]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260] successful.
May 28 14:03:50.397661 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:50.421038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:50.421368 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:50.421591 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== disconnect_volume: return (394ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:50.421753 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:03:50.449321 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:50.449391 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:03:50.449595 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No VIF found with MAC fa:16:3e:42:9e:e2, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:03:50.450990 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Using config drive
May 28 14:03:50.546984 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977030.5464282, 854e01ef-64f4-464f-8a46-ef352e4ccf2a => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:50.548617 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] VM Started (Lifecycle Event)
May 28 14:03:50.550685 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:03:50.558098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:03:50.567583 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Instance spawned successfully.
May 28 14:03:50.568703 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:03:50.757795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:50.759328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:50.769769 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Successfully updated port: f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:03:50.832757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:50.874093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:50.903145 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Took 1.79 seconds to deallocate network for instance.
May 28 14:03:50.962224 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:50.985039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:51.049754 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f67282d-b308-4832-931b-5203fc4a3086 req-2896e7a8-e567-4d8c-a2dd-41464261490a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:51.052550 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f67282d-b308-4832-931b-5203fc4a3086 req-2896e7a8-e567-4d8c-a2dd-41464261490a service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:51.053610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f67282d-b308-4832-931b-5203fc4a3086 req-2896e7a8-e567-4d8c-a2dd-41464261490a service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:51.053723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f67282d-b308-4832-931b-5203fc4a3086 req-2896e7a8-e567-4d8c-a2dd-41464261490a service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:51.054168 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f67282d-b308-4832-931b-5203fc4a3086 req-2896e7a8-e567-4d8c-a2dd-41464261490a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:51.054643 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-5f67282d-b308-4832-931b-5203fc4a3086 req-2896e7a8-e567-4d8c-a2dd-41464261490a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state resized and task_state resize_reverting.
May 28 14:03:51.056086 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f67282d-b308-4832-931b-5203fc4a3086 req-2896e7a8-e567-4d8c-a2dd-41464261490a service nova] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Received event network-vif-deleted-05dae846-999f-4371-bad1-7abd3de08673 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:51.056487 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:51.061828 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:51.078517 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:51.085132 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:51.085794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:51.088798 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:51.089903 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:51.090552 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:51.091913 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:51.091913 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:51.261220 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:03:51.281433 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Creating config drive at /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk.config
May 28 14:03:51.284140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:51.284272 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:51.284725 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:51.294881 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg8s2n78g {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:51.362468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg8s2n78g" returned: 0 in 0.067s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:03:51.414889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:51.415197 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:51.565867 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:03:51.566697 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977031.5660927, 854e01ef-64f4-464f-8a46-ef352e4ccf2a => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:51.566697 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] VM Paused (Lifecycle Event)
May 28 14:03:51.599566 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Took 8.95 seconds to spawn the instance on the hypervisor.
May 28 14:03:51.599706 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:51.723486 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:51.872099 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:51.920290 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:03:51.920932 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:51.954845 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:52.075876 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:52.082652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:52.089292 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977032.0877602, 854e01ef-64f4-464f-8a46-ef352e4ccf2a => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:52.089292 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] VM Resumed (Lifecycle Event)
May 28 14:03:52.126656 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Took 22.70 seconds to build instance.
May 28 14:03:52.145539 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9dfe39bf-101a-482c-8edb-945614f68c04 req-413bd20b-2884-43e1-a5c4-88009ebd544f service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-vif-plugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:52.145780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9dfe39bf-101a-482c-8edb-945614f68c04 req-413bd20b-2884-43e1-a5c4-88009ebd544f service nova] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:52.145963 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9dfe39bf-101a-482c-8edb-945614f68c04 req-413bd20b-2884-43e1-a5c4-88009ebd544f service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:52.146282 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9dfe39bf-101a-482c-8edb-945614f68c04 req-413bd20b-2884-43e1-a5c4-88009ebd544f service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:52.146282 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9dfe39bf-101a-482c-8edb-945614f68c04 req-413bd20b-2884-43e1-a5c4-88009ebd544f service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] No waiting events found dispatching network-vif-plugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:52.146416 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9dfe39bf-101a-482c-8edb-945614f68c04 req-413bd20b-2884-43e1-a5c4-88009ebd544f service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received unexpected event network-vif-plugged-216c46d3-e616-44df-a61a-5882b0ce26ec for instance with vm_state active and task_state None.
May 28 14:03:52.176428 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e3f42194-a8fe-491f-b7ec-ca20cde132bc tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:52.189159 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:52.196751 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:52.218480 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:52.500878 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-changed-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:52.501339 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Refreshing instance network info cache due to event network-changed-f1509118-408c-4513-b986-9fb08db5d507. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:52.501339 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] Acquiring lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:52.549758 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Updating instance_info_cache with network_info: [{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:52.565395 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:52.565733 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:52.594716 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:52.600179 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:52.627434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.209s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:53.056037 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:53.056360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance network_info: |[{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:03:53.057809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] Acquired lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:53.057959 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Refreshing network info cache for port f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:53.071495 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:53.106863 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 4dc73d91-4d87-4283-9a77-607c0e512265 due to new event <LifecycleEvent: 1779977033.1065261, 4dc73d91-4d87-4283-9a77-607c0e512265 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:03:53.107070 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977033.1065261, 4dc73d91-4d87-4283-9a77-607c0e512265 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:53.108597 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Resumed (Lifecycle Event)
May 28 14:03:53.165165 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:53.165530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:53.166074 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:53.166256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:53.166470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:53.167978 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:53.167978 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:53.167978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:53.167978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:53.167978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:53.167978 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:53.167978 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-c475b044-3f31-44d7-8d44-56b9bd4a6044 req-320c9846-b511-47c6-ba05-564acb27cf67 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:53.565103 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:53.580520 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.165s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:53.584902 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 1.861s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:53.612642 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:53.616120 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:53.621752 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Unrescuing
May 28 14:03:53.622002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:53.622129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquired lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:53.622270 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:53.694693 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Deleted allocations for instance 49f763dd-7f92-4295-87ec-b3d5bee75e1e
May 28 14:03:54.039561 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:54.087295 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lazy-loading 'migration_context' on Instance uuid 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:54.119210 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 14:03:54.119489 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977034.1192725, 4dc73d91-4d87-4283-9a77-607c0e512265 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:54.119807 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Started (Lifecycle Event)
May 28 14:03:54.125660 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:54.242700 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Updated VIF entry in instance network info cache for port f1509118-408c-4513-b986-9fb08db5d507. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:03:54.242700 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Updating instance_info_cache with network_info: [{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:54.255875 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:54.262217 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-vif-plugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:54.263016 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:54.263269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:54.264240 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:54.264240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Processing event network-vif-plugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:03:54.264240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-vif-plugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:54.264240 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:54.264240 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:54.264240 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:54.264240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] No waiting events found dispatching network-vif-plugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:54.264968 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8d449461-a309-4dae-8f3e-de14fcd88f8f req-644b1084-3b7c-4909-9b81-fda924af9b53 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received unexpected event network-vif-plugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 for instance with vm_state building and task_state spawning.
May 28 14:03:54.264968 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:03:54.269087 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:03:54.273138 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Instance spawned successfully.
May 28 14:03:54.274095 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:03:54.559126 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:54.577620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:03:54.590835 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Object Instance<16cfe8d8-1812-46a2-b92a-bd34d2cb7289> lazy-loaded attributes: resources,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:54.612203 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:03:54.643012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:54.643012 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0039041329998781293 future=<Future at 0x71a75c217c50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:54.643012 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:54.643012 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.237003468000012 future=<Future at 0x71a75c2c5f40 state=cancelled>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:54.643012 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.236784885000134 future=<Future at 0x71a75c2c5f40 state=cancelled>) was cancelled while queued, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:54.643012 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:54.643723 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.396056348999991 future=<Future at 0x71a75c29ee40 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:54.643956 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.39589642299984 future=<Future at 0x71a75c29ee40 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:54.653801 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779977019.6379397, aaeff833-80ef-4909-96de-5958543e37ba => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:54.653801 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: aaeff833-80ef-4909-96de-5958543e37ba] VM Stopped (Lifecycle Event)
May 28 14:03:54.659980 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:54.670399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:03:54.670399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:03:54.670399 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:54.685402 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:03:54.688319 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:fe0a:ab40', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:feb2:5c60', 'fe80::240f:c4ff:fe18:31a9', 'fe80::fc16:3eff:fe1a:790d', 'fe80::fc16:3eff:fe42:9ee2'] 
May 28 14:03:54.689261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:03:54.689261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:03:54.689440 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:03:54.689692 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Updating existing volume attachment record: 44942289-2a39-4f75-bd3b-8611e0e41414 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:03:54.721830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-099665f5-53ef-4083-bba9-a06b6159230e tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Lock "49f763dd-7f92-4295-87ec-b3d5bee75e1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.556s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:54.745558 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-75a78a97-14ee-4cdd-b1cf-11bba7125500 req-a7bf2a43-7e6f-4c0e-afba-4d494ed0fdb7 service nova] Releasing lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:54.790578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:54.790578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:54.790578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:54.790578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:54.791784 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:54.791848 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:03:55.013431 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:55.043271 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:03:55.178343 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: aaeff833-80ef-4909-96de-5958543e37ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:55.180883 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 14:03:55.181248 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977035.1810293, 7c6f49c3-6903-4440-987d-dc99e23240bf => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:55.181399 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] VM Started (Lifecycle Event)
May 28 14:03:55.302759 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Took 9.57 seconds to spawn the instance on the hypervisor.
May 28 14:03:55.302759 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:55.546584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Releasing lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:03:55.547305 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'flavor' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:55.596833 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:55.598641 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:55.685201 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:55.689709 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:55.817438 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Took 26.30 seconds to build instance.
May 28 14:03:56.083122 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.091652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.105720 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:56.116568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.191074 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977036.1907027, 7c6f49c3-6903-4440-987d-dc99e23240bf => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:56.191871 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] VM Paused (Lifecycle Event)
May 28 14:03:56.316043 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.320102 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.841s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:56.323168 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.385956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.395814 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.421959 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-18c2db4f-5af8-4489-8de2-c6a041601b4d req-4debf536-55f4-4fb9-9a1e-52bb255e070c service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:56.423682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-18c2db4f-5af8-4489-8de2-c6a041601b4d req-4debf536-55f4-4fb9-9a1e-52bb255e070c service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:56.423682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-18c2db4f-5af8-4489-8de2-c6a041601b4d req-4debf536-55f4-4fb9-9a1e-52bb255e070c service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:56.423682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-18c2db4f-5af8-4489-8de2-c6a041601b4d req-4debf536-55f4-4fb9-9a1e-52bb255e070c service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:56.423682 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-18c2db4f-5af8-4489-8de2-c6a041601b4d req-4debf536-55f4-4fb9-9a1e-52bb255e070c service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:56.423682 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-18c2db4f-5af8-4489-8de2-c6a041601b4d req-4debf536-55f4-4fb9-9a1e-52bb255e070c service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:56.428735 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance destroyed successfully.
May 28 14:03:56.429205 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'numa_topology' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:03:56.595662 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:56.699271 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:56.705396 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977036.7041175, 7c6f49c3-6903-4440-987d-dc99e23240bf => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:56.705396 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] VM Resumed (Lifecycle Event)
May 28 14:03:56.880942 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:03:56.882232 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:03:56.882401 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Creating image(s)
May 28 14:03:56.882889 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:03:56.883041 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Ensure instance console log exists: /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:03:56.883308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:56.883459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:56.883728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:56.887246 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Start _get_guest_xml network_info=[{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '44942289-2a39-4f75-bd3b-8611e0e41414', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '36328085-63b7-433c-8518-1786ee151fc0', 'attached_at': '', 'detached_at': '', 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'serial': '59c7740a-9911-4e00-902d-88a6a07dd87f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:03:56.891620 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:03:56.892005 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1192619876', uuid='36328085-63b7-433c-8518-1786ee151fc0'), owner=OwnerMeta(userid='86dc22a5d6a7478dab81969f17d3daab', username='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member', projectid='b74df57519ea42009fcebcff7cfdf94e', projectname='tempest-ServerBootFromVolumeStableRescueTest-241739491'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977036.8915145) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:03:56.894852 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:03:56.895460 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:03:56.900755 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:03:56.902364 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:03:56.902364 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:03:56.903208 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:03:56.903208 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:03:56.903208 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:03:56.903530 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:03:56.903530 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:03:56.903988 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:03:56.903988 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:03:56.903988 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:03:56.904194 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:03:56.904397 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:03:56.904592 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:03:56.927849 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:03:56.928697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:03:56.929008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:56.929268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:56.929599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:03:56.936143 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Object Instance<4dc73d91-4d87-4283-9a77-607c0e512265> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:03:56.946045 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:56.946963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:03:56.947832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:56.948477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:03:56.949164 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:56.949387 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:56.964208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:56.964208 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:56.972422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:03:56.972422 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f] added
May 28 14:03:56.981191 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:56.981191 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:56.981191 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:56.991469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f] added
May 28 14:03:56.991469 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:03:56.991469 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:56.991469 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:56.991469 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:03:56.991469 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:03:56.991469 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:56.991793 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:03:56.991935 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0435(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:03:56.992033 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:03:57.125217 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.541s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:57.126363 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.254s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:57.126363 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:03:57.148679 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:03:57.149065 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Claim successful on node np0000001643
May 28 14:03:57.208856 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:57.218491 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:57.505751 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:57.541434 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:57.657906 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:57.725325 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998972342000116 future=<Future at 0x71a75c202c00 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:03:57.766419 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:57.820011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:57.826040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:57.982903 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:03:57.993903 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:58.002859 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:58.002859 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:03:58.011300 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:03:58.011300 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.023188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.033145 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.044739 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.044739 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.044739 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.044739 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.044739 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:58.045204 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.045204 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.045204 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.045204 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.045204 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:58.056667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.056667 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.056667 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.056667 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.056667 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:58.057683 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.057683 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.057683 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.057683 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.057683 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:58.106653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.40.100,3260]
May 28 14:03:58.106653 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.40.100,3260] successful.
May 28 14:03:58.106653 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.114346 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.50.100,3260]
May 28 14:03:58.114346 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.50.100,3260] successful.
May 28 14:03:58.114346 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.122783 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.131621 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.159044 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:58.159044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('9', '-', '-', 0) found on session 27 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.175802 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.175802 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:03:58.176390 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:03:58.176390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:03:58.181083 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('10', '-', '-', 0) found on session 28 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:03:58.181083 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:03:58.186902 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-changed-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:58.189896 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Refreshing instance network info cache due to event network-changed-069820b4-ab96-49ca-aa7b-fdf17b731e95. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:03:58.189896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] Acquiring lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:58.189896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] Acquired lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:58.201118 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Refreshing network info cache for port 069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:03:58.228608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 27 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:58.228608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:58.228608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 28 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:03:58.228608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:03:58.608921 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ea17597d-8291-4937-852e-e39338de1ed3 req-4b281eaf-d412-41b8-9cbd-9cbc6d4b9a48 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:03:58.609986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ea17597d-8291-4937-852e-e39338de1ed3 req-4b281eaf-d412-41b8-9cbd-9cbc6d4b9a48 service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:03:58.609986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ea17597d-8291-4937-852e-e39338de1ed3 req-4b281eaf-d412-41b8-9cbd-9cbc6d4b9a48 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:03:58.610519 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ea17597d-8291-4937-852e-e39338de1ed3 req-4b281eaf-d412-41b8-9cbd-9cbc6d4b9a48 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:03:58.610807 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ea17597d-8291-4937-852e-e39338de1ed3 req-4b281eaf-d412-41b8-9cbd-9cbc6d4b9a48 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:03:58.612337 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ea17597d-8291-4937-852e-e39338de1ed3 req-4b281eaf-d412-41b8-9cbd-9cbc6d4b9a48 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state rescued and task_state unrescuing.
May 28 14:03:58.708603 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:58.792942 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Swapping old allocation on dict_keys(['f568fd9c-b967-45a3-9c51-ad00d748c4b7']) held by migration bc298aab-78c2-450d-aa27-d846f35c2c0b for instance
May 28 14:03:58.946173 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 4dc73d91-4d87-4283-9a77-607c0e512265 due to new event <LifecycleEvent: 1779977038.9438958, 4dc73d91-4d87-4283-9a77-607c0e512265 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:03:58.946173 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977038.9438958, 4dc73d91-4d87-4283-9a77-607c0e512265 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:58.946173 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Resumed (Lifecycle Event)
May 28 14:03:58.953488 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Overwriting current allocation {'allocations': {'f568fd9c-b967-45a3-9c51-ad00d748c4b7': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 24}}, 'project_id': '161254855aa54c71a7ac0a8a7076750c', 'user_id': '90f6ff80402b47b399ba052cccf0f141', 'consumer_generation': 1} on consumer 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 14:03:58.961530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:03:58.963716 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-041ff730-84b5-413d-927a-de52192876ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:59.196520 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:03:59.260853 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:03:59.462754 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:03:59.466551 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:03:59.484158 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:03:59.484158 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:03:59.591992 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:03:59.592189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquired lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:03:59.592434 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:03:59.977175 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977039.9767833, 4dc73d91-4d87-4283-9a77-607c0e512265 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:03:59.977645 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Started (Lifecycle Event)
May 28 14:03:59.989030 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:03:59.995887 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798932 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:00.003043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.073s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:00.004288 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== connect_volume: return (3075ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798932', 'path': '/dev/dm-1', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798932'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:00.004879 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798932', 'path': '/dev/dm-1', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798932'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:00.016165 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:00.095077 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:00.153917 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:00.484249 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:00.487002 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:00.509104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.382s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:00.509104 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:04:00.520761 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1192619876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1192619876',id=19,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-yw10ob6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:50Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=36328085-63b7-433c-8518-1786ee151fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:00.522187 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:00.523893 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:00.533747 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'pci_devices' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:00.765243 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-60754841-477e-4298-8ee4-af2579fe24dd req-7a5f0ce9-b129-4e9c-9b4c-a87efd4ef21e service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:00.766169 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60754841-477e-4298-8ee4-af2579fe24dd req-7a5f0ce9-b129-4e9c-9b4c-a87efd4ef21e service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:00.766485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60754841-477e-4298-8ee4-af2579fe24dd req-7a5f0ce9-b129-4e9c-9b4c-a87efd4ef21e service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:00.766869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60754841-477e-4298-8ee4-af2579fe24dd req-7a5f0ce9-b129-4e9c-9b4c-a87efd4ef21e service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:00.767054 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-60754841-477e-4298-8ee4-af2579fe24dd req-7a5f0ce9-b129-4e9c-9b4c-a87efd4ef21e service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:00.767229 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-60754841-477e-4298-8ee4-af2579fe24dd req-7a5f0ce9-b129-4e9c-9b4c-a87efd4ef21e service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state active and task_state None.
May 28 14:04:00.889337 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.020566 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:04:01.022001 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:04:01.022001 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:01.022001 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:01.040173 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <uuid>36328085-63b7-433c-8518-1786ee151fc0</uuid>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <name>instance-00000013</name>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1192619876</nova:name>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:03:56</nova:creationTime>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:user uuid="86dc22a5d6a7478dab81969f17d3daab">tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member</nova:user>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:project uuid="b74df57519ea42009fcebcff7cfdf94e">tempest-ServerBootFromVolumeStableRescueTest-241739491</nova:project>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         <nova:port uuid="f1509118-408c-4513-b986-9fb08db5d507">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <entry name="serial">36328085-63b7-433c-8518-1786ee151fc0</entry>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <entry name="uuid">36328085-63b7-433c-8518-1786ee151fc0</entry>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <alias name="ua-59c7740a-9911-4e00-902d-88a6a07dd87f"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-1"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <serial>59c7740a-9911-4e00-902d-88a6a07dd87f</serial>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:91:57:da"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <target dev="tapf1509118-40"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/console.log" append="off"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:01.040173 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:01.040173 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Preparing to wait for external event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:04:01.040173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1192619876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1192619876',id=19,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-yw10ob6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:03:50Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=36328085-63b7-433c-8518-1786ee151fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:01.046753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:04:01.050210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.050779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69e94d13-bc46-5aa4-babc-aa4e98f1150f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:01.053180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.053180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:01.060644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.064197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.065794 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1509118-40, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:01.065794 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1509118-40, col_values=(('qos', UUID('41693bdd-29b2-4f67-8570-aadeb3424662')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:01.065794 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1509118-40, col_values=(('external_ids', {'iface-id': 'f1509118-408c-4513-b986-9fb08db5d507', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:57:da', 'vm-uuid': '36328085-63b7-433c-8518-1786ee151fc0'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:01.073512 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.073512 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:01.076621 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.078817 np0000001643 nova-compute[98269]: INFO os_vif [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40')
May 28 14:04:01.223547 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updated VIF entry in instance network info cache for port 069820b4-ab96-49ca-aa7b-fdf17b731e95. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:01.223547 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updating instance_info_cache with network_info: [{"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:01.287728 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d135543093d4ca0849ab043df8e19ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a792bdb63c954739ad33cb2fedeedee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:04:01.523985 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:04:01.710983 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:01.730827 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dadc4c8-de7a-4ad8-957e-c9b330c94766 req-af65dc59-6971-43e4-8e98-49c00be15a83 service nova] Releasing lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:01.736314 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:01.736579 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing instance network info cache due to event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:01.738373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] Acquiring lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:01.738373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] Acquired lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:01.738568 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing network info cache for port 441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:01.816366 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:01.918471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:02.028142 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:04:02.185244 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Successfully created port: 399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:04:02.242283 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:02.421848 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Releasing lock "refresh_cache-16cfe8d8-1812-46a2-b92a-bd34d2cb7289" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:02.422297 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:02.442800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:04:02.478852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:02.542134 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:04:02.543022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:04:02.555672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:04:02.558709 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:fe0a:ab40', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:feb2:5c60', 'fe80::240f:c4ff:fe18:31a9', 'fe80::fc16:3eff:fe42:9ee2', 'fe80::fc16:3eff:fe1a:790d'] 
May 28 14:04:02.558709 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:04:02.558709 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:04:02.559564 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:02.609137 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:02.609405 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:02.609653 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No VIF found with MAC fa:16:3e:91:57:da, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:02.610571 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Using config drive
May 28 14:04:02.892997 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ac21bfca-fb5c-4ed4-a3c0-68c76b0d432a req-38461184-4f1b-4546-9b66-d2bc84b45f7b service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:02.893270 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac21bfca-fb5c-4ed4-a3c0-68c76b0d432a req-38461184-4f1b-4546-9b66-d2bc84b45f7b service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:02.893983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac21bfca-fb5c-4ed4-a3c0-68c76b0d432a req-38461184-4f1b-4546-9b66-d2bc84b45f7b service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:02.893983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac21bfca-fb5c-4ed4-a3c0-68c76b0d432a req-38461184-4f1b-4546-9b66-d2bc84b45f7b service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:02.893983 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ac21bfca-fb5c-4ed4-a3c0-68c76b0d432a req-38461184-4f1b-4546-9b66-d2bc84b45f7b service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:02.894377 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ac21bfca-fb5c-4ed4-a3c0-68c76b0d432a req-38461184-4f1b-4546-9b66-d2bc84b45f7b service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received unexpected event network-vif-plugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with vm_state active and task_state None.
May 28 14:04:02.991080 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Successfully updated port: 399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:04:03.040197 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005099340000924713 future=<Future at 0x71a75c29ee40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:03.040759 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:03.040759 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.4089034739999988 future=<Future at 0x71a75c2570b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:03.040759 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.4088252189999366 future=<Future at 0x71a75c2570b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:03.043475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:04:03.046248 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] Emitting event <LifecycleEvent: 1779977028.039583, 49f763dd-7f92-4295-87ec-b3d5bee75e1e => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:03.046366 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] VM Stopped (Lifecycle Event)
May 28 14:04:03.050518 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:04:03.050518 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Creating image(s)
May 28 14:04:03.050518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:03.050518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:03.050518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:03.050518 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:03.055066 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:03.057493 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:03.131761 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:03.159962 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:03.161213 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:03.161877 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:03.163388 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:03.168469 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:03.169344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:03.279474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:03.280370 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:03.339192 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk 1073741824" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:03.340819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:03.340819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:03.367441 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:03.420118 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Creating config drive at /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config
May 28 14:04:03.425361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3xuqemsj {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:03.447189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:03.448059 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:04:03.448491 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:03.492589 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3xuqemsj" returned: 0 in 0.066s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:03.495442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:03.495442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquired lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:03.495442 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:04:03.557294 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 49f763dd-7f92-4295-87ec-b3d5bee75e1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:03.561208 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:03.561309 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Cannot resize image /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:04:03.561568 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:04:03.561957 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Ensure instance console log exists: /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:04:03.562041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:03.563970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:03.563970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:03.599178 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updated VIF entry in instance network info cache for port 441edb5a-a183-4686-ad86-714a3ab59d5f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:03.600460 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:03.710244 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Starting finish_revert_migration {{(pid=98269) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 14:04:03.725656 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Start _get_guest_xml network_info=[{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'cdaf28a9-728c-402a-addc-0f7fc0fa7591', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '16cfe8d8-1812-46a2-b92a-bd34d2cb7289', 'attached_at': '2026-05-28T14:04:03.000000', 'detached_at': '', 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'serial': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:04:03.728998 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:03.730442 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-981658321', uuid='16cfe8d8-1812-46a2-b92a-bd34d2cb7289'), owner=OwnerMeta(userid='90f6ff80402b47b399ba052cccf0f141', username='tempest-ServerActionsTestOtherB-89556640-project-member', projectid='161254855aa54c71a7ac0a8a7076750c', projectname='tempest-ServerActionsTestOtherB-89556640'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977043.7299962) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:04:03.732460 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:04:03.732861 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:04:03.734369 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:04:03.734617 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:04:03.735719 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:04:03.736048 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:04:03.736238 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:04:03.737033 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:04:03.737033 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:04:03.738189 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:04:03.738401 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:04:03.738689 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:04:03.738859 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:04:03.739042 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:04:03.739175 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:04:03.739350 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:04:03.739615 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:03.834863 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:03.835188 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing instance network info cache due to event network-changed-441edb5a-a183-4686-ad86-714a3ab59d5f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:03.838704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] Acquiring lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:03.988366 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:04.016903 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:04.103138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2c6dd2be-f4f3-4b57-919c-5bdbb71b5067 req-2f689450-6510-4f87-a02f-16d517b93370 service nova] Releasing lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:04.104950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] Acquired lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:04.105159 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Refreshing network info cache for port 441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:04.111181 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:04:04.129522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:04.205859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:04.206626 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:04.263869 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:04.270534 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:04.381905 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:04.381905 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:04.381905 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:04.383482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:04.383482 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:04.383482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:04.383897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:04.384218 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:04.384548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:04.406038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:04.412475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:04.412475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:04.412475 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:04.412915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:04.413186 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:04.441497 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:04.441497 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:04.450649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:04.450649 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:04.450649 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004590779999489314 future=<Future at 0x71a75c2570b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:04.453950 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] Emitting event <LifecycleEvent: 1779977029.4492083, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:04.454181 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:04.454328 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.269912454000178 future=<Future at 0x71a75c202c00 state=cancelled>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:04.463015 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Stopped (Lifecycle Event)
May 28 14:04:04.467548 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:04.469848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd] added
May 28 14:04:04.469848 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:04.469848 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:04.469848 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:04.469848 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:04.469848 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:04.469848 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:04.470363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:04.470425 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0594(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:04.470838 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:04.472770 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.251523256000155 future=<Future at 0x71a75c202c00 state=cancelled>) was cancelled while queued, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:04.478824 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd] added
May 28 14:04:04.481470 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:04.481470 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0675(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:04.481470 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:04.615899 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:04.662928 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Updating instance_info_cache with network_info: [{"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:04.978033 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:04.999607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:04.999912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:05.097067 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:05.113527 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:05.147714 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977045.1473713, 36328085-63b7-433c-8518-1786ee151fc0 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:05.147886 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Started (Lifecycle Event)
May 28 14:04:05.165231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Releasing lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:05.165563 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Instance network_info: |[{"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:04:05.168111 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Start _get_guest_xml network_info=[{"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:04:05.177123 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:05.177123 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-273714186', uuid='bb01a4a8-04ac-459a-8994-4f6da360c381'), owner=OwnerMeta(userid='2d135543093d4ca0849ab043df8e19ca', username='tempest-AttachVolumeNegativeTest-703881462-project-member', projectid='a792bdb63c954739ad33cb2fedeedee4', projectname='tempest-AttachVolumeNegativeTest-703881462'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977045.1763654) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:04:05.178596 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:04:05.178596 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:04:05.182699 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:04:05.182947 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:04:05.184658 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:04:05.184915 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:04:05.185476 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:04:05.185476 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:04:05.185749 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:04:05.185749 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:04:05.185949 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:04:05.185995 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:04:05.186100 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:04:05.186260 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:04:05.186402 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:04:05.188562 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:04:05.211254 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273714186',display_name='tempest-AttachVolumeNegativeTest-server-273714186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-273714186',id=20,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjQXAZqnbqc11ZlId/bMF3BqtKngTJu9gV4RR9MI8IV3A8jPUc4U9rMVmPDrbgKLcQBvTBzPJi+rW7Ie68yuF1DXOQiWiNG3YRfOdcZ3j1s/a5nOwLccP9yxYkBBxcPtg==',key_name='tempest-keypair-1896788631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-90zrt082',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=bb01a4a8-04ac-459a-8994-4f6da360c381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:05.212302 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:05.212418 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:30:44,bridge_name='br-int',has_traffic_filtering=True,id=399f6d10-d05d-458c-b840-0a3f8d294ea3,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f6d10-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:05.213317 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'pci_devices' on Instance uuid bb01a4a8-04ac-459a-8994-4f6da360c381 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:05.249594 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updated VIF entry in instance network info cache for port 441edb5a-a183-4686-ad86-714a3ab59d5f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:05.249594 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [{"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:05.471318 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:05.481848 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:05.494624 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:05.494624 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.502516 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:05.507837 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:05.507837 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.513369 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.526936 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.534416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.534416 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.534416 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.534416 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.534416 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.534416 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.534416 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:05.534791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.534791 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.534791 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.534791 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.534791 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.534791 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.534791 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:05.545798 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.545798 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.545798 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.545798 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.545798 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.545798 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.545798 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:05.546100 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.546100 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.546100 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.546100 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.546100 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.546100 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.546100 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:05.578161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260]
May 28 14:04:05.578161 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260] successful.
May 28 14:04:05.578161 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.586952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260]
May 28 14:04:05.586952 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260] successful.
May 28 14:04:05.586952 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.596103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.602332 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.615426 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:05.615929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:05.615929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:05.617232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] HCTL ('11', '-', '-', 0) found on session 29 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:05.617483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.628037 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:05.628345 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:05.628641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:05.628722 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:05.629673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] HCTL ('12', '-', '-', 0) found on session 30 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:05.629815 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:05.642913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching for a device in session 29 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:05.642913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:05.656065 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:05.656065 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977045.6549609, 36328085-63b7-433c-8518-1786ee151fc0 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:05.656065 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Paused (Lifecycle Event)
May 28 14:04:05.660770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Searching for a device in session 30 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:05.660770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:05.716536 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <uuid>bb01a4a8-04ac-459a-8994-4f6da360c381</uuid>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <name>instance-00000014</name>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-273714186</nova:name>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:04:05</nova:creationTime>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:user uuid="2d135543093d4ca0849ab043df8e19ca">tempest-AttachVolumeNegativeTest-703881462-project-member</nova:user>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:project uuid="a792bdb63c954739ad33cb2fedeedee4">tempest-AttachVolumeNegativeTest-703881462</nova:project>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         <nova:port uuid="399f6d10-d05d-458c-b840-0a3f8d294ea3">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <entry name="serial">bb01a4a8-04ac-459a-8994-4f6da360c381</entry>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <entry name="uuid">bb01a4a8-04ac-459a-8994-4f6da360c381</entry>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk.config"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:16:30:44"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <target dev="tap399f6d10-d0"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/console.log" append="off"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:05.716536 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Preparing to wait for external event network-vif-plugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273714186',display_name='tempest-AttachVolumeNegativeTest-server-273714186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-273714186',id=20,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjQXAZqnbqc11ZlId/bMF3BqtKngTJu9gV4RR9MI8IV3A8jPUc4U9rMVmPDrbgKLcQBvTBzPJi+rW7Ie68yuF1DXOQiWiNG3YRfOdcZ3j1s/a5nOwLccP9yxYkBBxcPtg==',key_name='tempest-keypair-1896788631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-90zrt082',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=bb01a4a8-04ac-459a-8994-4f6da360c381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:30:44,bridge_name='br-int',has_traffic_filtering=True,id=399f6d10-d05d-458c-b840-0a3f8d294ea3,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f6d10-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:05.719437 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:30:44,bridge_name='br-int',has_traffic_filtering=True,id=399f6d10-d05d-458c-b840-0a3f8d294ea3,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f6d10-d0') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:04:05.721387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:05.721387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:05.721387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:04:05.723697 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:05.723697 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18f75a5c-ec62-58ea-9934-483434c54341', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:05.729035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:05.729035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:05.734279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:05.734699 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap399f6d10-d0, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:05.735215 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap399f6d10-d0, col_values=(('qos', UUID('8104e638-6abe-4330-bb3f-19f73c109f2e')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:05.735949 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap399f6d10-d0, col_values=(('external_ids', {'iface-id': '399f6d10-d05d-458c-b840-0a3f8d294ea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:30:44', 'vm-uuid': 'bb01a4a8-04ac-459a-8994-4f6da360c381'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:05.736412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:05.737630 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:05.747508 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:05.748115 np0000001643 nova-compute[98269]: INFO os_vif [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:30:44,bridge_name='br-int',has_traffic_filtering=True,id=399f6d10-d05d-458c-b840-0a3f8d294ea3,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f6d10-d0')
May 28 14:04:05.750986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] Releasing lock "refresh_cache-4dc73d91-4d87-4283-9a77-607c0e512265" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:05.751562 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-changed-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:05.751562 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Refreshing instance network info cache due to event network-changed-399f6d10-d05d-458c-b840-0a3f8d294ea3. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:05.751562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] Acquiring lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:05.751702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] Acquired lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:05.753559 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Refreshing network info cache for port 399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:06.061156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:06.061156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:06.065858 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:04:06.065992 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Claim successful on node np0000001643
May 28 14:04:06.163802 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:06.167776 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:06.258272 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:06.276219 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0ce31723-62b3-44b6-8eac-2cd431412bd4 req-ab25c777-bd47-45b4-b4fe-66bbb60364b3 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:06.277596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0ce31723-62b3-44b6-8eac-2cd431412bd4 req-ab25c777-bd47-45b4-b4fe-66bbb60364b3 service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:06.278780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0ce31723-62b3-44b6-8eac-2cd431412bd4 req-ab25c777-bd47-45b4-b4fe-66bbb60364b3 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:06.279593 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0ce31723-62b3-44b6-8eac-2cd431412bd4 req-ab25c777-bd47-45b4-b4fe-66bbb60364b3 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:06.279593 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0ce31723-62b3-44b6-8eac-2cd431412bd4 req-ab25c777-bd47-45b4-b4fe-66bbb60364b3 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Processing event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:04:06.281573 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:04:06.284299 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:04:06.290147 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance spawned successfully.
May 28 14:04:06.290853 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:04:06.412078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:04:06.670468 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:04:06.670908 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977046.6705923, 36328085-63b7-433c-8518-1786ee151fc0 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:06.671137 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Resumed (Lifecycle Event)
May 28 14:04:06.724132 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:06.804265 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:06.804488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:06.806587 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:06.809769 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:06.810184 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:06.810794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:06.931786 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Updated VIF entry in instance network info cache for port 399f6d10-d05d-458c-b840-0a3f8d294ea3. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:06.932164 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Updating instance_info_cache with network_info: [{"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:07.175544 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:07.178029 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:07.274672 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:07.274672 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:07.274672 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No VIF found with MAC fa:16:3e:16:30:44, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:07.275269 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Using config drive
May 28 14:04:07.319134 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Took 10.44 seconds to spawn the instance on the hypervisor.
May 28 14:04:07.319507 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:07.433527 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Found WWN 3300000005c17c7b0 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:07.433847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:07.434142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '3300000005c17c7b0', 'path': '/dev/dm-4', 'multipath_id': '3300000005c17c7b0'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:07.434142 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005c17c7b0', 'path': '/dev/dm-4', 'multipath_id': '3300000005c17c7b0'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:07.435209 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b6b65ca-ce6b-45d5-8a36-1c379e8a60cd req-121b9ae4-2c88-4943-9cf3-17fd06c56227 service nova] Releasing lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:07.681170 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:04:07.783742 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:07.844240 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Took 22.93 seconds to build instance.
May 28 14:04:07.947312 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:43Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:07.947312 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:07.947312 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:07.947312 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <uuid>16cfe8d8-1812-46a2-b92a-bd34d2cb7289</uuid>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <name>instance-0000000a</name>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsTestOtherB-server-981658321</nova:name>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:04:03</nova:creationTime>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:user uuid="90f6ff80402b47b399ba052cccf0f141">tempest-ServerActionsTestOtherB-89556640-project-member</nova:user>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:project uuid="161254855aa54c71a7ac0a8a7076750c">tempest-ServerActionsTestOtherB-89556640</nova:project>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         <nova:port uuid="c438645f-c3e6-4778-91e5-ca2e1d7bbdd0">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <entry name="serial">16cfe8d8-1812-46a2-b92a-bd34d2cb7289</entry>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <entry name="uuid">16cfe8d8-1812-46a2-b92a-bd34d2cb7289</entry>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/disk.config"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <alias name="ua-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-4"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <serial>9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd</serial>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ab:39:d2"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <target dev="tapc438645f-c3"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289/console.log" append="off"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:07.947312 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Preparing to wait for external event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:43Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:07.952412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:04:07.954605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:07.956272 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bb2f8b6-1dbd-521e-96cd-d1ab1fd08eb7', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:07.961963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:07.963177 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:07.969851 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:07.975747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:07.975747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc438645f-c3, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:07.975986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc438645f-c3, col_values=(('qos', UUID('061c13b5-b2f4-48d4-8739-24a4b650b5a3')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:07.976207 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc438645f-c3, col_values=(('external_ids', {'iface-id': 'c438645f-c3e6-4778-91e5-ca2e1d7bbdd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:39:d2', 'vm-uuid': '16cfe8d8-1812-46a2-b92a-bd34d2cb7289'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:07.984611 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:08.011623 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:08.025538 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Creating config drive at /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk.config
May 28 14:04:08.027148 np0000001643 nova-compute[98269]: INFO os_vif [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3')
May 28 14:04:08.036407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu4zv44mn {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:08.110307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu4zv44mn" returned: 0 in 0.074s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:08.208013 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:08.208500 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:08.347993 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0e9bf702-0c2e-4111-ac57-d56c10f3ffa7 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.452s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:08.357495 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f402f1b-2b03-4d8e-bf6f-d6c1b28ee713 req-41db8d1d-5419-477c-b8fa-b2f8aa914867 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:08.359086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f402f1b-2b03-4d8e-bf6f-d6c1b28ee713 req-41db8d1d-5419-477c-b8fa-b2f8aa914867 service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:08.359622 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f402f1b-2b03-4d8e-bf6f-d6c1b28ee713 req-41db8d1d-5419-477c-b8fa-b2f8aa914867 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:08.359622 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f402f1b-2b03-4d8e-bf6f-d6c1b28ee713 req-41db8d1d-5419-477c-b8fa-b2f8aa914867 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:08.359622 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f402f1b-2b03-4d8e-bf6f-d6c1b28ee713 req-41db8d1d-5419-477c-b8fa-b2f8aa914867 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:08.359622 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2f402f1b-2b03-4d8e-bf6f-d6c1b28ee713 req-41db8d1d-5419-477c-b8fa-b2f8aa914867 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state active and task_state None.
May 28 14:04:08.712658 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:09.072003 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.117545 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.123498 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.231171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.170s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:09.231905 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:04:09.275729 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.412152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.434904 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.470062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.522979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8c9e4c43-350e-4092-9f46-bc8ccd139a17 req-ba3b8b26-a910-4264-aac3-b0dac53832e7 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:09.523240 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8c9e4c43-350e-4092-9f46-bc8ccd139a17 req-ba3b8b26-a910-4264-aac3-b0dac53832e7 service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:09.523461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8c9e4c43-350e-4092-9f46-bc8ccd139a17 req-ba3b8b26-a910-4264-aac3-b0dac53832e7 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:09.523676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8c9e4c43-350e-4092-9f46-bc8ccd139a17 req-ba3b8b26-a910-4264-aac3-b0dac53832e7 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:09.523880 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8c9e4c43-350e-4092-9f46-bc8ccd139a17 req-ba3b8b26-a910-4264-aac3-b0dac53832e7 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Processing event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:04:09.643471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.738320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.743904 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.754773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.756575 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:04:09.756853 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:04:09.757236 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:09.757613 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:09.777378 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.778008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:09.927176 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '357253ac91f34daeb60ae1dfd3e4a86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a74849f3fb24097a5a42457746f02d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:04:10.273048 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:04:10.409729 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Rescuing
May 28 14:04:10.409986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:10.410319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:10.410439 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:04:10.487374 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:10.494967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:10.532696 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:10.776126 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:04:10.915932 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:11.027767 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977051.0271783, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:11.028795 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Started (Lifecycle Event)
May 28 14:04:11.030912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:04:11.053484 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance running successfully.
May 28 14:04:11.053484 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] finish_revert_migration finished successfully. {{(pid=98269) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 14:04:11.090257 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Successfully created port: f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:04:11.536625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:11.542297 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:11.565465 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:11.623373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:11.624394 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:11.627599 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:11.628465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:11.628810 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:11.629105 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received unexpected event network-vif-plugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with vm_state resized and task_state resize_reverting.
May 28 14:04:11.630269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-vif-plugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:11.630269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:11.630269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:11.630269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:11.630269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Processing event network-vif-plugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:04:11.631052 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-vif-plugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:11.631661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:11.632004 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:11.632560 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:04:11.633105 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:11.633105 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] No waiting events found dispatching network-vif-plugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:11.633105 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-de75724f-ac52-4e91-afed-80147184807d req-541d9002-4ca7-4f29-b528-309b9b1b0d26 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received unexpected event network-vif-plugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 for instance with vm_state building and task_state spawning.
May 28 14:04:11.635798 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:04:11.647360 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Instance spawned successfully.
May 28 14:04:11.647360 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:04:11.789039 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:04:11.791121 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:04:11.791121 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Creating image(s)
May 28 14:04:11.791121 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "/opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:11.791121 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:11.794160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:11.794939 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:11.800981 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:11.802416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:11.967027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.164s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:11.967676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:11.968428 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:11.971044 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:11.975925 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:11.976928 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:12.033891 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Updating instance_info_cache with network_info: [{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:12.048228 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 14:04:12.050386 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977052.048653, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:12.050386 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Paused (Lifecycle Event)
May 28 14:04:12.112531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.135s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:12.112531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:12.161821 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:12.161976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:12.166440 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:12.166440 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:12.167386 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:12.167765 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:12.191669 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Successfully updated port: f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:04:12.195490 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-551b19ae-6d73-4817-a07c-6ed9f66ebc02 tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance to original state: 'active'
May 28 14:04:12.202162 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk 1073741824" returned: 0 in 0.082s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:12.203688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:12.204119 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:12.299339 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-changed-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:12.299563 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Refreshing instance network info cache due to event network-changed-f9e5c2e2-c369-4d24-9857-ff3df1320952. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:12.299860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] Acquiring lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:12.299997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] Acquired lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:12.300172 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Refreshing network info cache for port f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:12.333121 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.129s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:12.333651 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:04:12.334127 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:12.447026 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:12.448304 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Cannot resize image /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:04:12.450029 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:04:12.452925 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Ensure instance console log exists: /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:04:12.453989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:12.453989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:12.454156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:12.541783 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:12.554259 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:12.560348 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977052.559899, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:12.561362 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Resumed (Lifecycle Event)
May 28 14:04:12.683795 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Took 9.64 seconds to spawn the instance on the hypervisor.
May 28 14:04:12.683795 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:12.701566 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:12.806015 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:12.908105 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:04:12.989865 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:13.067637 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:13.077008 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:13.200526 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:13.209969 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Took 21.44 seconds to build instance.
May 28 14:04:13.585257 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977053.5848646, bb01a4a8-04ac-459a-8994-4f6da360c381 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:13.586372 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] VM Started (Lifecycle Event)
May 28 14:04:13.624515 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:13.714069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2a155239-8994-4e27-b51f-0ef1acc278a7 req-a1c37a31-5f00-4e1f-939e-0691524dc7e3 service nova] Releasing lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:13.714833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.956s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:13.716760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquired lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:13.716991 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:04:14.091053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:14.094328 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:14.206400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:14.206400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:14.206400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:14.206400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:14.206400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:14.213417 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Terminating instance
May 28 14:04:14.267546 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.277694 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.307300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.578624 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.587982 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.600850 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977054.5990381, bb01a4a8-04ac-459a-8994-4f6da360c381 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:14.600850 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] VM Paused (Lifecycle Event)
May 28 14:04:14.610530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.628886 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.672950 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance destroyed successfully.
May 28 14:04:14.673204 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'numa_topology' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:14.692371 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:04:14.723852 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:04:14.776819 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.781880 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0a119e9b-6bb7-4de9-b644-952a04bea7a2 req-b09675a8-9d44-408b-9c49-7c5bd8f7ddf8 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:14.782236 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0a119e9b-6bb7-4de9-b644-952a04bea7a2 req-b09675a8-9d44-408b-9c49-7c5bd8f7ddf8 service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:14.782420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0a119e9b-6bb7-4de9-b644-952a04bea7a2 req-b09675a8-9d44-408b-9c49-7c5bd8f7ddf8 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:14.784523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0a119e9b-6bb7-4de9-b644-952a04bea7a2 req-b09675a8-9d44-408b-9c49-7c5bd8f7ddf8 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:14.784523 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0a119e9b-6bb7-4de9-b644-952a04bea7a2 req-b09675a8-9d44-408b-9c49-7c5bd8f7ddf8 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:14.784523 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-0a119e9b-6bb7-4de9-b644-952a04bea7a2 req-b09675a8-9d44-408b-9c49-7c5bd8f7ddf8 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state active and task_state rescuing.
May 28 14:04:14.785215 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.812522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.816640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:14.857358 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:15.106924 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:15.120630 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977055.119624, bb01a4a8-04ac-459a-8994-4f6da360c381 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:15.120630 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] VM Resumed (Lifecycle Event)
May 28 14:04:15.150056 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Instance destroyed successfully.
May 28 14:04:15.152199 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lazy-loading 'resources' on Instance uuid 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:15.187724 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Attempting a stable device rescue
May 28 14:04:15.352813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 14:04:15.355970 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:15.362681 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:04:15.362831 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Creating image(s)
May 28 14:04:15.364509 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:15.364509 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:15.364509 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:15.364509 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'trusted_certs' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:15.586983 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Updating instance_info_cache with network_info: [{"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:15.622740 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:15.626210 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:15.648536 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-changed-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:15.648536 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Refreshing instance network info cache due to event network-changed-399f6d10-d05d-458c-b840-0a3f8d294ea3. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:15.648536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] Acquiring lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:15.650493 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] Acquired lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:15.651167 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Refreshing network info cache for port 399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:15.657305 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981658321',display_name='tempest-ServerActionsTestOtherB-server-981658321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestotherb-server-981658321',id=10,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9lm7sH3aIaFFaVJfuc+oZrRgtEP/10aAibZOKAvLCqcpVcivaQojmEbSNiNjXlINEk/6OoqgpWtZ252zyXoZrc5X+ZKlSLnjnccpZPx1VvNf0kvBLe/SmpaBGRTeN8g==',key_name='tempest-keypair-889559773',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:04:11Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='161254855aa54c71a7ac0a8a7076750c',ramdisk_id='',reservation_id='r-kymhzkdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-89556640',owner_user_name='tempest-ServerActionsTestOtherB-89556640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:04:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90f6ff80402b47b399ba052cccf0f141',uuid=16cfe8d8-1812-46a2-b92a-bd34d2cb7289,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:04:15.657305 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converting VIF {"id": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "address": "fa:16:3e:ab:39:d2", "network": {"id": "0e65e836-7ac8-4d13-b885-ea9d711c4f90", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-923690610-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161254855aa54c71a7ac0a8a7076750c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc438645f-c3", "ovs_interfaceid": "c438645f-c3e6-4778-91e5-ca2e1d7bbdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:15.659077 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:15.659077 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:04:15.661001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:15.661300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc438645f-c3, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:15.662590 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:15.664321 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:15.670644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:15.672345 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:15.672439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=061c13b5-b2f4-48d4-8739-24a4b650b5a3) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:15.673471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:15.673740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:15.680549 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:15.682948 np0000001643 nova-compute[98269]: INFO os_vif [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0,network=Network(0e65e836-7ac8-4d13-b885-ea9d711c4f90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc438645f-c3')
May 28 14:04:15.685319 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:04:15.685898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:15.686202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:15.686921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:15.687466 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:04:15.687753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:15.712649 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd (non-flash)
May 28 14:04:15.713197 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:15.713498 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '30')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:04:15.713498 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '29')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:15.714528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd', '30')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:15.716289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801cdd00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'): ({'sdg'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:04:15.716603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:04:15.716882 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Flush multipath device 3300000005c17c7b0 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:04:15.755531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:15.804765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:15.851509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:04:15.851773 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:04:15.853164 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:04:15.866397 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:15.866606 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "275fcea1acfbf2fbc787a50091e95041944603f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:15.866961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "275fcea1acfbf2fbc787a50091e95041944603f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:15.869928 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:04:15.870172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:04:15.885262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:15.925685 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260]
May 28 14:04:15.925685 np0000001643 nova-compute[98269]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.40.100,3260] successful.
May 28 14:04:15.925685 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:15.949253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:15.964314 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:16.007700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260]
May 28 14:04:16.007700 np0000001643 nova-compute[98269]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-9879ea2c-c6fb-4e8b-b0a5-99e048c7ebfd, portal: 192.168.50.100,3260] successful.
May 28 14:04:16.007700 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:16.031617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:16.032749 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:16.032749 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] <== disconnect_volume: return (346ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:16.032749 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:04:16.034920 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Deleting instance files /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_del
May 28 14:04:16.047321 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Deletion of /opt/stack/data/nova/instances/16cfe8d8-1812-46a2-b92a-bd34d2cb7289_del complete
May 28 14:04:16.089495 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Releasing lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:16.089958 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Instance network_info: |[{"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:04:16.092390 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Start _get_guest_xml network_info=[{"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:04:16.101179 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:16.103070 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1156511192', uuid='90b0ea10-2b38-4907-aa11-02454a817a01'), owner=OwnerMeta(userid='357253ac91f34daeb60ae1dfd3e4a86f', username='tempest-ServerActionsTestOtherA-354716614-project-member', projectid='6a74849f3fb24097a5a42457746f02d2', projectname='tempest-ServerActionsTestOtherA-354716614'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977056.1022322) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:04:16.106962 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:04:16.108161 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:04:16.108325 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:04:16.108478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:04:16.111396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:04:16.111817 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:04:16.111817 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:04:16.111889 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:04:16.112585 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:04:16.130360 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1156511192',display_name='tempest-ServerActionsTestOtherA-server-1156511192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-1156511192',id=21,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-oa885l96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=90b0ea10-2b38-4907-aa11-02454a817a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:16.131332 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:16.132038 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:ea,bridge_name='br-int',has_traffic_filtering=True,id=f9e5c2e2-c369-4d24-9857-ff3df1320952,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e5c2e2-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:16.135947 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'pci_devices' on Instance uuid 90b0ea10-2b38-4907-aa11-02454a817a01 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:16.141953 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99412834099985 future=<Future at 0x71a75c1359d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:16.143233 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.992862624999816 future=<Future at 0x71a75c1359d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:16.144281 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99920801799999 future=<Future at 0x71a75c137c20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:16.144705 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.991348991999985 future=<Future at 0x71a75c1359d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:16.157301 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:16.559487 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Took 1.83 seconds to destroy the instance on the hypervisor.
May 28 14:04:16.559487 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:04:16.559487 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:04:16.559772 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:04:16.559772 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:16.646905 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <uuid>90b0ea10-2b38-4907-aa11-02454a817a01</uuid>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <name>instance-00000015</name>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsTestOtherA-server-1156511192</nova:name>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:04:16</nova:creationTime>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:user uuid="357253ac91f34daeb60ae1dfd3e4a86f">tempest-ServerActionsTestOtherA-354716614-project-member</nova:user>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:project uuid="6a74849f3fb24097a5a42457746f02d2">tempest-ServerActionsTestOtherA-354716614</nova:project>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         <nova:port uuid="f9e5c2e2-c369-4d24-9857-ff3df1320952">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <entry name="serial">90b0ea10-2b38-4907-aa11-02454a817a01</entry>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <entry name="uuid">90b0ea10-2b38-4907-aa11-02454a817a01</entry>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk.config"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:44:40:ea"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <target dev="tapf9e5c2e2-c3"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/console.log" append="off"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:16.646905 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:16.653093 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Preparing to wait for external event network-vif-plugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:04:16.653093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:16.653093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:16.653093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:16.653093 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1156511192',display_name='tempest-ServerActionsTestOtherA-server-1156511192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-1156511192',id=21,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-oa885l96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=90b0ea10-2b38-4907-aa11-02454a817a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:04:16.653093 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:16.654338 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:ea,bridge_name='br-int',has_traffic_filtering=True,id=f9e5c2e2-c369-4d24-9857-ff3df1320952,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e5c2e2-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:16.654338 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:ea,bridge_name='br-int',has_traffic_filtering=True,id=f9e5c2e2-c369-4d24-9857-ff3df1320952,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e5c2e2-c3') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:04:16.654338 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:16.654338 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:16.655501 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:04:16.662544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:16.662544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63d537a3-fdab-5f79-aecd-2f0724d55fa9', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:16.662544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:16.662544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:16.672711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:16.676662 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:16.676662 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9e5c2e2-c3, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:16.676827 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9e5c2e2-c3, col_values=(('qos', UUID('285ea45e-56f3-4d50-8982-87226f9ffce3')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:16.676977 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9e5c2e2-c3, col_values=(('external_ids', {'iface-id': 'f9e5c2e2-c369-4d24-9857-ff3df1320952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:40:ea', 'vm-uuid': '90b0ea10-2b38-4907-aa11-02454a817a01'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:16.678823 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:16.682604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:16.697527 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:16.700183 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:16.702086 np0000001643 nova-compute[98269]: INFO os_vif [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:40:ea,bridge_name='br-int',has_traffic_filtering=True,id=f9e5c2e2-c369-4d24-9857-ff3df1320952,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e5c2e2-c3')
May 28 14:04:16.708137 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:16.712066 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:16.712490 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:16.818288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.part --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:16.818881 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] 5fe6cfe1-06c3-4d1c-b930-03897ad6b416 was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:04:16.820365 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:04:16.820365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.part /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:16.920331 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c497359c-29fd-4c6a-8df6-a1f079a6b453 req-37f0c33f-e437-4f4d-bb00-b365f0c815bb service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:16.922738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c497359c-29fd-4c6a-8df6-a1f079a6b453 req-37f0c33f-e437-4f4d-bb00-b365f0c815bb service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:16.923792 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c497359c-29fd-4c6a-8df6-a1f079a6b453 req-37f0c33f-e437-4f4d-bb00-b365f0c815bb service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:16.928975 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:16.930996 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c497359c-29fd-4c6a-8df6-a1f079a6b453 req-37f0c33f-e437-4f4d-bb00-b365f0c815bb service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:16.931425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.part /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.converted" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:16.932182 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c497359c-29fd-4c6a-8df6-a1f079a6b453 req-37f0c33f-e437-4f4d-bb00-b365f0c815bb service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:16.932651 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-c497359c-29fd-4c6a-8df6-a1f079a6b453 req-37f0c33f-e437-4f4d-bb00-b365f0c815bb service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state active and task_state rescuing.
May 28 14:04:16.942276 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:17.056561 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8.converted --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:17.063138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "275fcea1acfbf2fbc787a50091e95041944603f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.196s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:17.063848 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:17.070016 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:17.074475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "275fcea1acfbf2fbc787a50091e95041944603f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:17.074475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "275fcea1acfbf2fbc787a50091e95041944603f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:17.074475 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:17.075476 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:17.075815 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:17.190367 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:17.207466 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Updated VIF entry in instance network info cache for port 399f6d10-d05d-458c-b840-0a3f8d294ea3. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:17.208672 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Updating instance_info_cache with network_info: [{"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:17.213834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8 --force-share --output=json" returned: 0 in 0.138s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:17.215229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8,backing_fmt=raw /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.rescue {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:17.294569 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8,backing_fmt=raw /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.rescue" returned: 0 in 0.080s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:17.296712 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "275fcea1acfbf2fbc787a50091e95041944603f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:17.296712 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'migration_context' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:17.736244 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:17.741220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60732e2a-d44a-481f-b794-6a1d5d9952c2 req-5b06e4e8-20c5-468f-a6c4-4a2903bd3c40 service nova] Releasing lock "refresh_cache-bb01a4a8-04ac-459a-8994-4f6da360c381" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:17.741673 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:17.741898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:17.742987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:17.742987 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:17.743051 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:17.743237 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:17.743310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] Acquiring lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:17.743377 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:17.743511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:17.747914 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] No waiting events found dispatching network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:17.748098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-unplugged-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:17.748241 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Received event network-vif-deleted-c438645f-c3e6-4778-91e5-ca2e1d7bbdd0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:17.748398 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Neutron deleted interface c438645f-c3e6-4778-91e5-ca2e1d7bbdd0; detaching it from the instance and deleting it from the info cache
May 28 14:04:17.750461 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cba8644f-e09e-4148-acb2-0d225dccb0b5 req-3ad3e8fc-acf7-41c7-827d-a1b4ce65992a service nova] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Detach interface failed, port_id=c438645f-c3e6-4778-91e5-ca2e1d7bbdd0, reason: Instance 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:04:17.797754 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:17.799853 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:04:17.802162 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Start _get_guest_xml network_info=[{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:91:57:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5fe6cfe1-06c3-4d1c-b930-03897ad6b416', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '44942289-2a39-4f75-bd3b-8611e0e41414', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '36328085-63b7-433c-8518-1786ee151fc0', 'attached_at': '', 'detached_at': '', 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'serial': '59c7740a-9911-4e00-902d-88a6a07dd87f'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:04:17.802924 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'resources' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:18.083805 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:18.260185 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:18.260185 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:18.261492 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No VIF found with MAC fa:16:3e:44:40:ea, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:18.261492 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Using config drive
May 28 14:04:18.306287 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:18.308860 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:18.310827 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1192619876', uuid='36328085-63b7-433c-8518-1786ee151fc0'), owner=OwnerMeta(userid='86dc22a5d6a7478dab81969f17d3daab', username='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member', projectid='b74df57519ea42009fcebcff7cfdf94e', projectname='tempest-ServerBootFromVolumeStableRescueTest-241739491'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:91:57:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977058.3100383) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:04:18.312460 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:04:18.313068 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:04:18.314385 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:04:18.314846 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:04:18.315970 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:04:18.316460 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:04:18.316767 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:04:18.316931 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:04:18.317108 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:04:18.317235 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:04:18.317371 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:04:18.317916 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:04:18.318200 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:04:18.318368 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:04:18.318597 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:04:18.318825 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:04:18.319072 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:18.502427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:18.503875 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:18.586080 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Took 2.03 seconds to deallocate network for instance.
May 28 14:04:18.770344 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:18.824532 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:18.835077 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:18.948784 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:18.950473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:18.950473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:18.950473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:18.951774 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:18.953810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:18.954064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:18.954499 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:18.954857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:18.964471 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Creating config drive at /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk.config
May 28 14:04:18.969911 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbnz3lulp {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:18.987731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:18.989881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:18.990305 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:18.990747 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:18.992382 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:18.992382 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:19.007639 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:19.007639 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:19.012956 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:19.018149 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:19.018149 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:19.027768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:19.027768 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbnz3lulp" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:19.034252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.046642 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:19.046642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:19.047020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('10', '0', '0', 0) found on session 28 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:19.047201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:19.049296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.049296 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.049296 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.049296 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.049296 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.049296 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.049296 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:19.049905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.049905 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:19.049905 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.049905 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:19.049905 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.049905 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:19.049905 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:19.049905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:19.050089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:19.050536 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] HCTL ('9', '0', '0', 0) found on session 27 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:19.050712 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:19.061297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 28 and hctl ('10', '0', '0', 0) yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:19.061489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:19.062808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Searching for a device in session 27 and hctl ('9', '0', '0', 0) yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:19.062808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:19.159672 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Took 0.57 seconds to detach 1 volumes for instance.
May 28 14:04:19.314484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:19.522439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:19.557792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:19.631161 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:19.673922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:19.673922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:19.683742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.010s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:19.757794 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Deleted allocations for instance 16cfe8d8-1812-46a2-b92a-bd34d2cb7289
May 28 14:04:19.766731 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-949a0271-2d3b-469e-9199-f1effb3cc990 req-7a521c9c-57a0-4cec-a1ac-8b925186c14f service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-vif-plugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:19.767598 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-949a0271-2d3b-469e-9199-f1effb3cc990 req-7a521c9c-57a0-4cec-a1ac-8b925186c14f service nova] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:19.769044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-949a0271-2d3b-469e-9199-f1effb3cc990 req-7a521c9c-57a0-4cec-a1ac-8b925186c14f service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:19.769044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-949a0271-2d3b-469e-9199-f1effb3cc990 req-7a521c9c-57a0-4cec-a1ac-8b925186c14f service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:19.769044 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-949a0271-2d3b-469e-9199-f1effb3cc990 req-7a521c9c-57a0-4cec-a1ac-8b925186c14f service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Processing event network-vif-plugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:04:19.986070 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:19.996351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:04:19.996351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:19.997917 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:20.022525 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:20.028662 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:20.036957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.533s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:20.677974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:04:20.678551 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977060.6781332, 90b0ea10-2b38-4907-aa11-02454a817a01 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:20.678784 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] VM Started (Lifecycle Event)
May 28 14:04:20.681629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:04:20.685146 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Instance spawned successfully.
May 28 14:04:20.685146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:04:20.773461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2db561c0-dfad-45fe-97c5-e3f3df6aa5cc tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Lock "16cfe8d8-1812-46a2-b92a-bd34d2cb7289" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.568s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:21.011163 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798932 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:21.011667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.057s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:21.011784 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== connect_volume: return (2058ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798932', 'path': '/dev/dm-1', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798932'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:21.011947 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798932', 'path': '/dev/dm-1', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798932'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:21.127603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:21.127603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:21.127603 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Attaching volume 6b283459-8bc2-41e6-a88a-c2719309f7eb to /dev/vdb
May 28 14:04:21.181355 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:21.183541 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:21.187234 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:21.193735 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:21.193925 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:21.194424 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:21.194994 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:21.195400 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:21.195794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:21.204233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:04:21.238543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:21.285080 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:04:21.285506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:04:21.297075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:04:21.298577 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:fe0a:ab40', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:feb2:5c60', 'fe80::240f:c4ff:fe18:31a9', 'fe80::fc16:3eff:fe42:9ee2', 'fe80::fc16:3eff:fe1a:790d', 'fe80::fc16:3eff:fe16:3044', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0'] 
May 28 14:04:21.298755 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:04:21.298819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:04:21.298999 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:21.299865 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updating existing volume attachment record: 60f5fadf-f8c5-49f9-a8e2-f75b1846264f {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:04:21.520187 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1192619876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1192619876',id=19,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:04:07Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-yw10ob6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:07Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=36328085-63b7-433c-8518-1786ee151fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:91:57:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:21.520489 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "vif_mac": "fa:16:3e:91:57:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:21.523775 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:21.526331 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'pci_devices' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:21.680186 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:21.689708 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:04:21.690037 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977061.6898506, 90b0ea10-2b38-4907-aa11-02454a817a01 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:21.690152 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] VM Paused (Lifecycle Event)
May 28 14:04:21.704423 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Took 9.92 seconds to spawn the instance on the hypervisor.
May 28 14:04:21.704812 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:21.824691 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d64a5424-eb2a-4d75-9454-16a698760a6a req-460e9bfc-3262-40b6-a940-b313c315fe05 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-vif-plugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:21.824908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d64a5424-eb2a-4d75-9454-16a698760a6a req-460e9bfc-3262-40b6-a940-b313c315fe05 service nova] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:21.825139 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d64a5424-eb2a-4d75-9454-16a698760a6a req-460e9bfc-3262-40b6-a940-b313c315fe05 service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:21.825239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d64a5424-eb2a-4d75-9454-16a698760a6a req-460e9bfc-3262-40b6-a940-b313c315fe05 service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:21.825401 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d64a5424-eb2a-4d75-9454-16a698760a6a req-460e9bfc-3262-40b6-a940-b313c315fe05 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] No waiting events found dispatching network-vif-plugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:21.825573 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-d64a5424-eb2a-4d75-9454-16a698760a6a req-460e9bfc-3262-40b6-a940-b313c315fe05 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received unexpected event network-vif-plugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 for instance with vm_state active and task_state None.
May 28 14:04:21.869354 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:21.869795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:21.869966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:22.029997 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:22.032877 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <uuid>36328085-63b7-433c-8518-1786ee151fc0</uuid>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <name>instance-00000013</name>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1192619876</nova:name>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:04:18</nova:creationTime>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:user uuid="86dc22a5d6a7478dab81969f17d3daab">tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member</nova:user>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:project uuid="b74df57519ea42009fcebcff7cfdf94e">tempest-ServerBootFromVolumeStableRescueTest-241739491</nova:project>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         <nova:port uuid="f1509118-408c-4513-b986-9fb08db5d507">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <entry name="serial">36328085-63b7-433c-8518-1786ee151fc0</entry>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <entry name="uuid">36328085-63b7-433c-8518-1786ee151fc0</entry>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <alias name="ua-59c7740a-9911-4e00-902d-88a6a07dd87f"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-1"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <serial>59c7740a-9911-4e00-902d-88a6a07dd87f</serial>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.rescue"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <boot order="1"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:91:57:da"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <target dev="tapf1509118-40"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/console.log" append="off"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:22.032877 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:22.042276 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance destroyed successfully.
May 28 14:04:22.193296 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:22.195764 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977062.1954985, 90b0ea10-2b38-4907-aa11-02454a817a01 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:22.195900 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] VM Resumed (Lifecycle Event)
May 28 14:04:22.216848 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Took 16.21 seconds to build instance.
May 28 14:04:22.700126 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:22.704939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:22.718384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.718s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:23.563830 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:23.563830 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:23.563830 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:23.563830 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] No VIF found with MAC fa:16:3e:91:57:da, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:23.563830 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Using config drive
May 28 14:04:23.822514 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-changed-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:23.823492 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Refreshing instance network info cache due to event network-changed-f9e5c2e2-c369-4d24-9857-ff3df1320952. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:23.823492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] Acquiring lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:23.823492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] Acquired lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:23.823492 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Refreshing network info cache for port f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:24.068341 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'ec2_ids' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:24.129162 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.258s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:24.129162 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:24.153811 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:24.155041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:24.155041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:24.155188 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:24.155599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:24.155823 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:24.173943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:24.173943 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:24.180750 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:24.180750 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:24.186509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb] added
May 28 14:04:24.186509 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:24.186509 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:24.186509 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:24.186509 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:24.186509 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:24.186509 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:24.186832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:24.187368 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:24.187607 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:24.193177 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb] added
May 28 14:04:24.193177 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:24.193177 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:24.193177 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:24.193177 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:24.193177 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:24.193177 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:24.193177 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:24.193177 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:24.193662 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:24.326619 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:24.329623 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:24.572814 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:24.573347 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'keypairs' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:24.716240 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:24.922664 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Updated VIF entry in instance network info cache for port f9e5c2e2-c369-4d24-9857-ff3df1320952. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:24.923012 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Updating instance_info_cache with network_info: [{"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:25.075830 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:25.078436 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:25.141827 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:25.188605 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:25.193953 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:25.207768 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:25.207768 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:25.212112 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:25.212112 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.228874 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.238866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.245579 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Creating config drive at /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config.rescue
May 28 14:04:25.249517 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy691jzas {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.263952 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.265837 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.269911 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:25.312570 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy691jzas" returned: 0 in 0.063s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:25.313726 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260]
May 28 14:04:25.313726 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260] successful.
May 28 14:04:25.313726 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.322039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260]
May 28 14:04:25.322039 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260] successful.
May 28 14:04:25.322039 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.328842 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.337479 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.349504 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.349803 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:25.350355 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:25.350599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:25.352130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('13', '-', '-', 0) found on session 33 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:25.352296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.363661 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:25.364017 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:25.364302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:25.364379 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:25.365931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('14', '-', '-', 0) found on session 34 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:25.366088 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:25.380881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 33 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:25.380881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:25.388205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 34 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:25.388205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:25.426960 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-656cda44-d510-4711-ab7c-b2bb30f696fe req-e843dc7c-8741-4a24-b012-2087ae051e12 service nova] Releasing lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:25.875297 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:25.911787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:26.042330 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:26.108517 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:26.113590 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:26.155046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8069cf8c-0698-484e-8cfa-718b92e8cb41 req-4ab7aff6-12fc-4e69-b05f-5d2281e328fe service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:26.155268 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8069cf8c-0698-484e-8cfa-718b92e8cb41 req-4ab7aff6-12fc-4e69-b05f-5d2281e328fe service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:26.157667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8069cf8c-0698-484e-8cfa-718b92e8cb41 req-4ab7aff6-12fc-4e69-b05f-5d2281e328fe service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:26.157667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8069cf8c-0698-484e-8cfa-718b92e8cb41 req-4ab7aff6-12fc-4e69-b05f-5d2281e328fe service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:26.158231 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8069cf8c-0698-484e-8cfa-718b92e8cb41 req-4ab7aff6-12fc-4e69-b05f-5d2281e328fe service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:26.158231 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8069cf8c-0698-484e-8cfa-718b92e8cb41 req-4ab7aff6-12fc-4e69-b05f-5d2281e328fe service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state active and task_state rescuing.
May 28 14:04:26.159504 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:04:26.682354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:27.115101 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 36328085-63b7-433c-8518-1786ee151fc0 due to new event <LifecycleEvent: 1779977067.1146584, 36328085-63b7-433c-8518-1786ee151fc0 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:04:27.115589 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977067.1146584, 36328085-63b7-433c-8518-1786ee151fc0 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:27.115589 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Resumed (Lifecycle Event)
May 28 14:04:27.124050 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19eb3413-79ee-4633-81f3-03664ce7f9cc tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:27.186031 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found WWN 330000000edd7040f for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:27.186503 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.058s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:27.186975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== connect_volume: return (5317ms) {'type': 'block', 'scsi_wwn': '330000000edd7040f', 'path': '/dev/dm-5', 'multipath_id': '330000000edd7040f'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:27.187030 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000edd7040f', 'path': '/dev/dm-5', 'multipath_id': '330000000edd7040f'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:27.189735 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:27.623357 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:27.625393 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:27.698807 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Attempting to attach volume 6b283459-8bc2-41e6-a88a-c2719309f7eb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:04:27.701134 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:04:27.701134 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:27.701134 np0000001643 nova-compute[98269]:   <alias name="ua-6b283459-8bc2-41e6-a88a-c2719309f7eb"/>
May 28 14:04:27.701134 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:04:27.701134 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:04:27.701134 np0000001643 nova-compute[98269]:   <serial>6b283459-8bc2-41e6-a88a-c2719309f7eb</serial>
May 28 14:04:27.701134 np0000001643 nova-compute[98269]: </disk>
May 28 14:04:27.701134 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:04:28.129168 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977068.1288748, 36328085-63b7-433c-8518-1786ee151fc0 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:28.131483 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Started (Lifecycle Event)
May 28 14:04:28.266163 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6efed213-f68d-4604-b16d-f172941969fd req-98488acc-908b-48f8-be73-59c37299ca85 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:28.268980 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6efed213-f68d-4604-b16d-f172941969fd req-98488acc-908b-48f8-be73-59c37299ca85 service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:28.270297 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6efed213-f68d-4604-b16d-f172941969fd req-98488acc-908b-48f8-be73-59c37299ca85 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:28.270680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6efed213-f68d-4604-b16d-f172941969fd req-98488acc-908b-48f8-be73-59c37299ca85 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:28.270950 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6efed213-f68d-4604-b16d-f172941969fd req-98488acc-908b-48f8-be73-59c37299ca85 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:28.271160 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6efed213-f68d-4604-b16d-f172941969fd req-98488acc-908b-48f8-be73-59c37299ca85 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state rescued and task_state unrescuing.
May 28 14:04:28.635286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:28.636847 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:28.730648 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Unrescuing
May 28 14:04:28.730926 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:28.731063 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquired lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:28.731220 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:04:29.140291 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 14:04:29.234705 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:29.333243 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:29.425664 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:29.425974 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:29.426082 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:29.426781 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No VIF found with MAC fa:16:3e:16:45:16, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:29.600861 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:29.802311 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Updating instance_info_cache with network_info: [{"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:30.305395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Releasing lock "refresh_cache-36328085-63b7-433c-8518-1786ee151fc0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:30.306124 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'flavor' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:30.691999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:30.692493 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:30.763428 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.764577 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.765463 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.765463 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.765463 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.768758 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.770105 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.770373 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.770590 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:04:30.770823 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:04:30.856203 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:30.878768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:30.925659 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:30.944386 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:31.010157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e07bf3d1-0b45-4b59-aafe-692271d0f038 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.884s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:31.136660 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004956750001383625 future=<Future at 0x71a75c1359d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.136757 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.136952 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.0065689160001056734 future=<Future at 0x71a75c137c20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.136952 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.0064584419999391685 future=<Future at 0x71a75c137c20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.145893 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0024506409999958123 future=<Future at 0x71a75c137c20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.146032 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.150316 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Emitting event <LifecycleEvent: 1779977056.1433444, 16cfe8d8-1812-46a2-b92a-bd34d2cb7289 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:31.150548 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] VM Stopped (Lifecycle Event)
May 28 14:04:31.156536 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:31.163796 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:31.196467 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:04:31.220753 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998266850999926 future=<Future at 0x71a75c16f380 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.220753 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997617221999917 future=<Future at 0x71a75c16f380 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.222858 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.995178950999843 future=<Future at 0x71a75c16f380 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:31.223794 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance destroyed successfully.
May 28 14:04:31.226992 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'numa_topology' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:31.256320 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:31.257792 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:31.258022 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:31.266934 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98269) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 14:04:31.267416 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:31.279680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:31.281181 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:31.281181 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:31.281181 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:04:31.296336 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-35f87548-f730-4f61-b9cb-94cc0fd147f4 req-14bacfe6-6984-45e2-95be-4c8493f41bcd service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:31.296559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-35f87548-f730-4f61-b9cb-94cc0fd147f4 req-14bacfe6-6984-45e2-95be-4c8493f41bcd service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:31.296715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-35f87548-f730-4f61-b9cb-94cc0fd147f4 req-14bacfe6-6984-45e2-95be-4c8493f41bcd service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:31.301488 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-35f87548-f730-4f61-b9cb-94cc0fd147f4 req-14bacfe6-6984-45e2-95be-4c8493f41bcd service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:31.301488 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-35f87548-f730-4f61-b9cb-94cc0fd147f4 req-14bacfe6-6984-45e2-95be-4c8493f41bcd service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:31.301777 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-35f87548-f730-4f61-b9cb-94cc0fd147f4 req-14bacfe6-6984-45e2-95be-4c8493f41bcd service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state rescued and task_state unrescuing.
May 28 14:04:31.654096 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e5179843-34fb-405e-a969-bd4e7fdbfebe tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 16cfe8d8-1812-46a2-b92a-bd34d2cb7289] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:31.684083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:31.732264 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Object Instance<36328085-63b7-433c-8518-1786ee151fc0> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:31.782192 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:31.782522 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:31.797430 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:04:31.798561 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Claim successful on node np0000001643
May 28 14:04:32.299952 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.349189 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.361136 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:32.396993 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.489286 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.523407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:32.524229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:32.594199 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.603124 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.630905 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.662290 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.667086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:32.670167 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.673634 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:32.706814 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:32.719431 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998966833000168 future=<Future at 0x71a75c2674a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:32.742093 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance destroyed successfully.
May 28 14:04:32.743697 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:32.837605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:32.838617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:32.882497 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-15fd6f10-d11a-4b03-b5de-5e6a9ddc3dfb req-5adcfec1-263c-445e-b624-69041bf30b72 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:32.883504 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-15fd6f10-d11a-4b03-b5de-5e6a9ddc3dfb req-5adcfec1-263c-445e-b624-69041bf30b72 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:32.884482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-15fd6f10-d11a-4b03-b5de-5e6a9ddc3dfb req-5adcfec1-263c-445e-b624-69041bf30b72 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:32.884770 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-15fd6f10-d11a-4b03-b5de-5e6a9ddc3dfb req-5adcfec1-263c-445e-b624-69041bf30b72 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:32.885482 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-15fd6f10-d11a-4b03-b5de-5e6a9ddc3dfb req-5adcfec1-263c-445e-b624-69041bf30b72 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:32.885712 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-15fd6f10-d11a-4b03-b5de-5e6a9ddc3dfb req-5adcfec1-263c-445e-b624-69041bf30b72 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state active and task_state powering-off.
May 28 14:04:32.979389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:32.988144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.115808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.117380 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.234212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.235299 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:04:33.246684 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.264592 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:33.273756 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:33.382372 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.384184 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.440478 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:33.440746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:33.441114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:33.441114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:33.441294 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:33.441348 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-unplugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state rescued and task_state unrescuing.
May 28 14:04:33.441543 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:33.443190 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:33.444473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:33.444473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:33.444473 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:33.444473 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state rescued and task_state unrescuing.
May 28 14:04:33.444817 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:33.445076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:33.445076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:33.445415 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:33.445686 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] No waiting events found dispatching network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:33.446220 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f20ca03c-e68b-4c41-848e-557cda05c0bd req-2d47cc7b-afa5-464f-925b-d74212fbb941 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received unexpected event network-vif-plugged-f1509118-408c-4513-b986-9fb08db5d507 for instance with vm_state rescued and task_state unrescuing.
May 28 14:04:33.507581 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.513747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.613676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.614331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.684950 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 36328085-63b7-433c-8518-1786ee151fc0 due to new event <LifecycleEvent: 1779977073.6842434, 36328085-63b7-433c-8518-1786ee151fc0 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:04:33.685534 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977073.6842434, 36328085-63b7-433c-8518-1786ee151fc0 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:33.685534 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Resumed (Lifecycle Event)
May 28 14:04:33.689552 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-201e8d40-550f-467e-b510-acc6a7936004 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:33.737847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.746216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:04:33.748833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.800552 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a5ceb21b-5621-487d-b753-6127cbdbcabf tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.544s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:33.847847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.848286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:33.967921 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:33.974892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.022206 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:34.022458 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:34.059776 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:34.090531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json" returned: 0 in 0.115s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.090531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.189638 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:34.193231 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:34.201970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk.rescue --force-share --output=json" returned: 0 in 0.112s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.203200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.318527 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.320157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.347596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:34.446423 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.450804 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.534294 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:34.563637 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.566111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.682336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.686540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.706899 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977074.7055938, 36328085-63b7-433c-8518-1786ee151fc0 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:34.707209 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Started (Lifecycle Event)
May 28 14:04:34.793252 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.795087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.873038 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:34.897251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:34.898369 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:04:34.906239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:34.922907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:34.923365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:34.925525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "36328085-63b7-433c-8518-1786ee151fc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:34.925898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:34.926778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:34.943434 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Terminating instance
May 28 14:04:34.999121 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-460dbabf-02ed-4df5-8174-c33b082466d3 req-75ae8ce2-0d79-4573-953f-303da051d793 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:35.001086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-460dbabf-02ed-4df5-8174-c33b082466d3 req-75ae8ce2-0d79-4573-953f-303da051d793 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:35.001086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-460dbabf-02ed-4df5-8174-c33b082466d3 req-75ae8ce2-0d79-4573-953f-303da051d793 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:35.001086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-460dbabf-02ed-4df5-8174-c33b082466d3 req-75ae8ce2-0d79-4573-953f-303da051d793 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:35.001086 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-460dbabf-02ed-4df5-8174-c33b082466d3 req-75ae8ce2-0d79-4573-953f-303da051d793 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:35.001086 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-460dbabf-02ed-4df5-8174-c33b082466d3 req-75ae8ce2-0d79-4573-953f-303da051d793 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state stopped and task_state powering-on.
May 28 14:04:35.014951 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:35.015617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:35.051812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.269s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:35.052486 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:04:35.126630 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:35.133343 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:04:35.135073 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:35.136545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:35.187881 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:35.188879 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=11045MB free_disk=74.26289749145508GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:04:35.189209 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:35.190023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:35.217646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:35.221816 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:35.381024 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:35.381189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquired lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:35.381420 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:04:35.381499 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'info_cache' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:35.449728 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:04:35.475696 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:35.479603 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:35.504281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:35.564612 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:04:35.564612 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:04:35.564612 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:35.565078 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:35.692440 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81cf50caaafd43ffae63aff9c9258528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4618bb9b554fb8af8f26aae95c016a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:04:35.693965 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:35.706816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:35.726089 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 36328085-63b7-433c-8518-1786ee151fc0] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 14:04:35.803671 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99957682000013 future=<Future at 0x71a75c18dbb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:35.805810 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Instance destroyed successfully.
May 28 14:04:35.806528 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'resources' on Instance uuid 36328085-63b7-433c-8518-1786ee151fc0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:35.884331 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:36.073292 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:04:36.242137 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Successfully created port: 2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:04:36.256407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:36.259283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:36.282368 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 150a83f0-0070-4df3-ab14-6aa1c028be82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.282525 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance fb9d4d3f-f068-49a2-ba11-114989ee8d9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.282655 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 65c247b5-acbc-474a-bb88-a2edf9ac2d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.282787 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 033c2245-10fc-4568-a15f-3b39ee5258ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.282946 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 4dc73d91-4d87-4283-9a77-607c0e512265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.283030 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 8937adb3-1191-477e-a01d-76d29db6b224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.283150 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.283287 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.283408 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 7c6f49c3-6903-4440-987d-dc99e23240bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.284044 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 36328085-63b7-433c-8518-1786ee151fc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.284178 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance bb01a4a8-04ac-459a-8994-4f6da360c381 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.284328 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 90b0ea10-2b38-4907-aa11-02454a817a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.284468 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 27823c45-9fce-41b2-923b-a5a907ef029c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:04:36.284700 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:04:36.285047 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=3008MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:04:35 up 31 min,  2 users,  load average: 10.23, 6.07, 2.85\n', 'num_instances': '13', 'num_vm_active': '10', 'num_task_None': '10', 'num_os_type_None': '13', 'num_proj_b74df57519ea42009fcebcff7cfdf94e': '4', 'io_workload': '1', 'num_proj_9bfe2941b78c4f2e9f16f60e05ec5dcc': '3', 'num_vm_rescued': '1', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_proj_706c08c92c6844b3ab7b4019269eabad': '1', 'num_proj_bc79c5d191d54ea188016726111808fd': '2', 'num_task_deleting': '1', 'num_proj_a792bdb63c954739ad33cb2fedeedee4': '1', 'num_proj_6a74849f3fb24097a5a42457746f02d2': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_proj_ac4618bb9b554fb8af8f26aae95c016a': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:04:36.312466 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1192619876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1192619876',id=19,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:04:27Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-yw10ob6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:04:34Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=36328085-63b7-433c-8518-1786ee151fc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:04:36.312874 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "f1509118-408c-4513-b986-9fb08db5d507", "address": "fa:16:3e:91:57:da", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1509118-40", "ovs_interfaceid": "f1509118-408c-4513-b986-9fb08db5d507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:36.313762 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:36.314070 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:04:36.316570 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:36.316570 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1509118-40, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:36.317104 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:36.318262 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:36.325584 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:36.327032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:36.327305 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41693bdd-29b2-4f67-8570-aadeb3424662) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:36.328674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:36.330000 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:36.335106 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:36.337720 np0000001643 nova-compute[98269]: INFO os_vif [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:da,bridge_name='br-int',has_traffic_filtering=True,id=f1509118-408c-4513-b986-9fb08db5d507,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1509118-40')
May 28 14:04:36.339266 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:04:36.339609 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:36.339777 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:36.340390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:36.340713 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59c7740a-9911-4e00-902d-88a6a07dd87f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:04:36.340828 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:36.374620 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '34')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:04:36.374620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', '27')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:36.376654 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f', '28')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:36.376654 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801cdd00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'): ({'sdd'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:04:36.376654 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Removing multipathed devices sdd, sde {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:04:36.376834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flush multipath device 330000000c94d49a5 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:04:36.387889 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:36.424883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:36.477051 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:36.537855 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:04:36.537855 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:04:36.539420 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:04:36.551641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:04:36.555043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:04:36.566797 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:36.577891 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:04:36.602276 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.40.100,3260]
May 28 14:04:36.602276 np0000001643 nova-compute[98269]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.40.100,3260] successful.
May 28 14:04:36.602276 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:36.621818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:36.640690 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:36.684726 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.50.100,3260]
May 28 14:04:36.684726 np0000001643 nova-compute[98269]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-59c7740a-9911-4e00-902d-88a6a07dd87f, portal: 192.168.50.100,3260] successful.
May 28 14:04:36.684726 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:36.703844 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:36.704340 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:36.704340 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== disconnect_volume: return (364ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:36.704521 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:04:36.705048 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Deleting instance files /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0_del
May 28 14:04:36.705691 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Deletion of /opt/stack/data/nova/instances/36328085-63b7-433c-8518-1786ee151fc0_del complete
May 28 14:04:36.766558 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'flavor' on Instance uuid 7c6f49c3-6903-4440-987d-dc99e23240bf {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:36.842618 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:36.924202 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Successfully updated port: 2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:04:37.057560 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updating instance_info_cache with network_info: [{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:37.083611 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Booting with volume 7ab3ae63-2f4c-42b6-8889-670d79255c71 at /dev/vda
May 28 14:04:37.128010 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:37.145303 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:04:37.163842 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:37.164045 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:37.166685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:37.213544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:04:37.213800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:04:37.215941 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Took 1.77 seconds to destroy the instance on the hypervisor.
May 28 14:04:37.219884 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:04:37.220136 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:04:37.220219 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:04:37.220663 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:37.225616 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:04:37.226864 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:fe0a:ab40', 'fe80::fc16:3eff:feb2:5c60', 'fe80::240f:c4ff:fe18:31a9', 'fe80::fc16:3eff:fe42:9ee2', 'fe80::fc16:3eff:fe1a:790d', 'fe80::fc16:3eff:fe16:3044', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0'] 
May 28 14:04:37.227001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:04:37.227201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:04:37.227521 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:37.227618 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Updating existing volume attachment record: 0240d4fe-487f-4ee4-abe3-6e498ad753bd {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:04:37.312667 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:37.349562 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-changed-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:37.349819 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Refreshing instance network info cache due to event network-changed-069820b4-ab96-49ca-aa7b-fdf17b731e95. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:37.350040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Acquiring lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:37.350132 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Acquired lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:37.350306 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Refreshing network info cache for port 069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:37.429244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-27823c45-9fce-41b2-923b-a5a907ef029c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:37.429462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-27823c45-9fce-41b2-923b-a5a907ef029c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:37.429663 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:04:37.560334 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Releasing lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:37.813351 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:37.835388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.574s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:37.840087 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f41f0031-cb5e-4df1-a8b4-6c0739c50d3e req-05961d6e-8da5-49bb-a3a3-d7cec4ac9199 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Received event network-vif-deleted-f1509118-408c-4513-b986-9fb08db5d507 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:37.841357 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-f41f0031-cb5e-4df1-a8b4-6c0739c50d3e req-05961d6e-8da5-49bb-a3a3-d7cec4ac9199 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Neutron deleted interface f1509118-408c-4513-b986-9fb08db5d507; detaching it from the instance and deleting it from the info cache
May 28 14:04:37.842411 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f41f0031-cb5e-4df1-a8b4-6c0739c50d3e req-05961d6e-8da5-49bb-a3a3-d7cec4ac9199 service nova] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Detach interface failed, port_id=f1509118-408c-4513-b986-9fb08db5d507, reason: Instance 36328085-63b7-433c-8518-1786ee151fc0 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:04:37.856156 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:37.936656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:37.936854 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:38.008278 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:04:38.124634 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:38.227682 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:38.235280 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:38.342905 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:04:38.343087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.154s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:38.344202 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:04:38.427723 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Updating instance_info_cache with network_info: [{"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:38.438872 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:04:38.489397 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updated VIF entry in instance network info cache for port 069820b4-ab96-49ca-aa7b-fdf17b731e95. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:38.489704 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updating instance_info_cache with network_info: [{"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:38.576637 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance destroyed successfully.
May 28 14:04:38.576955 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:38.626462 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Took 1.41 seconds to deallocate network for instance.
May 28 14:04:38.673969 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:38.674255 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:38.852059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:38.852512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:38.852512 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Attaching volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74 to /dev/vdb
May 28 14:04:38.896830 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:38.907385 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:04:38.928358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:38.942309 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-27823c45-9fce-41b2-923b-a5a907ef029c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:38.943371 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Instance network_info: |[{"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:04:38.963307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:04:38.963588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:04:38.972307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:04:38.973692 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:fe0a:ab40', 'fe80::fc16:3eff:feb2:5c60', 'fe80::240f:c4ff:fe18:31a9', 'fe80::fc16:3eff:fe42:9ee2', 'fe80::fc16:3eff:fe1a:790d', 'fe80::fc16:3eff:fe16:3044', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0'] 
May 28 14:04:38.973861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:04:38.974259 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:04:38.974557 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:38.974769 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updating existing volume attachment record: 10dd7744-83b5-420d-aae2-068a06b5fa33 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:04:38.992266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Releasing lock "refresh_cache-7c6f49c3-6903-4440-987d-dc99e23240bf" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:38.993494 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-changed-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:38.993494 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Refreshing instance network info cache due to event network-changed-216c46d3-e616-44df-a61a-5882b0ce26ec. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:38.993494 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Acquiring lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:38.993494 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Acquired lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:38.993494 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Refreshing network info cache for port 216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:38.996780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:38.997047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:39.001903 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:04:39.002033 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Claim successful on node np0000001643
May 28 14:04:39.079821 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:39.079821 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'resources' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:39.175139 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:04:39.178248 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Detaching volume 993e9269-3030-4b35-a005-a04e51b6695e
May 28 14:04:39.178644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Deleting volume: 59c7740a-9911-4e00-902d-88a6a07dd87f {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:04:39.239093 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Attempting to driver detach volume 993e9269-3030-4b35-a005-a04e51b6695e from mountpoint /dev/vdb
May 28 14:04:39.248991 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Found disk vdb by alias ua-993e9269-3030-4b35-a005-a04e51b6695e {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:04:39.253190 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Found disk vdb by alias ua-993e9269-3030-4b35-a005-a04e51b6695e {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:04:39.253835 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Attempting to detach device vdb from instance 4dc73d91-4d87-4283-9a77-607c0e512265 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:04:39.253835 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:04:39.253835 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:39.253835 np0000001643 nova-compute[98269]:   <alias name="ua-993e9269-3030-4b35-a005-a04e51b6695e"/>
May 28 14:04:39.253835 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:04:39.253835 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:04:39.253835 np0000001643 nova-compute[98269]:   <serial>993e9269-3030-4b35-a005-a04e51b6695e</serial>
May 28 14:04:39.253835 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:04:39.253835 np0000001643 nova-compute[98269]: </disk>
May 28 14:04:39.253835 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:04:39.259614 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully detached device vdb from instance 4dc73d91-4d87-4283-9a77-607c0e512265 from the persistent domain config.
May 28 14:04:39.260423 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] (1/8): Attempting to detach device vdb with device alias ua-993e9269-3030-4b35-a005-a04e51b6695e from instance 4dc73d91-4d87-4283-9a77-607c0e512265 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:04:39.260423 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:04:39.260423 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:39.260423 np0000001643 nova-compute[98269]:   <alias name="ua-993e9269-3030-4b35-a005-a04e51b6695e"/>
May 28 14:04:39.260423 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:04:39.260423 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:04:39.260423 np0000001643 nova-compute[98269]:   <serial>993e9269-3030-4b35-a005-a04e51b6695e</serial>
May 28 14:04:39.260423 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:04:39.260423 np0000001643 nova-compute[98269]: </disk>
May 28 14:04:39.260423 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:04:39.352271 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:39.420532 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:04:39.421878 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:04:39.422121 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Creating image(s)
May 28 14:04:39.422461 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:04:39.422637 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Ensure instance console log exists: /opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:04:39.422891 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:39.423075 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:39.423256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:39.423804 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Start _get_guest_xml network_info=[{"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '0240d4fe-487f-4ee4-abe3-6e498ad753bd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27823c45-9fce-41b2-923b-a5a907ef029c', 'attached_at': '', 'detached_at': '', 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'serial': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'multiattach': True}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:04:39.426321 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:39.427317 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-55580316', uuid='27823c45-9fce-41b2-923b-a5a907ef029c'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977079.426994) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:04:39.428524 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:04:39.428850 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:04:39.429743 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:04:39.429934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:04:39.430871 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:04:39.431181 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:04:39.431335 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:04:39.431478 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:04:39.431643 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:04:39.431765 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:04:39.431911 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:04:39.432100 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:04:39.432262 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:04:39.432417 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:04:39.432597 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:04:39.432768 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:04:39.442933 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:39.443217 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:39.443367 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:39.443767 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:39.443956 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:39.456788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:39.457399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:39.457970 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:39.458209 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:39.458646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:39.458837 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:39.472111 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:39.472111 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:39.477382 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:39.477382 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:39.485400 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71] added
May 28 14:04:39.485400 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:39.485400 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:39.485400 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:39.485400 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:39.485400 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:39.485400 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:39.485765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:39.485765 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:39.485951 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:39.488781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71] added
May 28 14:04:39.488781 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:39.488781 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:39.488781 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:39.488781 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:39.488781 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:39.488781 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:39.489018 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:39.489124 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:39.489308 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:39.501481 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:39.530473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:39.530833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:39.530948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:39.581387 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:39.586479 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:04:39.586479 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:39.586479 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:39.586479 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:04:39.586479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:39.586479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd542e8b-1f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:39.586479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:39.587485 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:39.594663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:39.594663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:39.594663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d62cc8ac-138a-4ecd-b2b8-9d2fb08400e0) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:39.594663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:39.594663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:39.594663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:39.598087 np0000001643 nova-compute[98269]: INFO os_vif [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f')
May 28 14:04:39.600559 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:04:39.600827 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:39.600937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:39.738364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:39.762150 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2fc7dfb0-40cf-4dfc-8767-b56f07684777 req-052f3f52-0cc7-4e42-b28d-b6acfe220529 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:39.762352 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2fc7dfb0-40cf-4dfc-8767-b56f07684777 req-052f3f52-0cc7-4e42-b28d-b6acfe220529 service nova] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:39.762523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2fc7dfb0-40cf-4dfc-8767-b56f07684777 req-052f3f52-0cc7-4e42-b28d-b6acfe220529 service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:39.762628 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2fc7dfb0-40cf-4dfc-8767-b56f07684777 req-052f3f52-0cc7-4e42-b28d-b6acfe220529 service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:39.762741 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2fc7dfb0-40cf-4dfc-8767-b56f07684777 req-052f3f52-0cc7-4e42-b28d-b6acfe220529 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] No waiting events found dispatching network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:39.762854 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2fc7dfb0-40cf-4dfc-8767-b56f07684777 req-052f3f52-0cc7-4e42-b28d-b6acfe220529 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received unexpected event network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb for instance with vm_state building and task_state spawning.
May 28 14:04:39.798509 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977079.798031, 4dc73d91-4d87-4283-9a77-607c0e512265 => ua-993e9269-3030-4b35-a005-a04e51b6695e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:04:39.802652 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-993e9269-3030-4b35-a005-a04e51b6695e for instance 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:04:39.805340 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully detached device vdb from instance 4dc73d91-4d87-4283-9a77-607c0e512265 from the live domain config.
May 28 14:04:39.806422 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:04:39.806731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '993e9269-3030-4b35-a005-a04e51b6695e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:39.806866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:39.878384 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:40.052910 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Updated VIF entry in instance network info cache for port 216c46d3-e616-44df-a61a-5882b0ce26ec. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:40.052910 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Updating instance_info_cache with network_info: [{"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:40.486899 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:40.490564 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:40.501323 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:40.501323 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:40.507973 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:40.507973 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.514571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.521341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.532991 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.532991 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.532991 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.532991 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.532991 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.532991 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.532991 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:40.533270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.533270 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.533270 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.533270 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.533270 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.533270 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.533270 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.538668 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:40.557964 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Releasing lock "refresh_cache-854e01ef-64f4-464f-8a46-ef352e4ccf2a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:40.558193 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-changed-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:40.558342 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Refreshing instance network info cache due to event network-changed-2511a4a6-e6ab-4e66-b913-c5837539cdfb. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:40.558546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Acquiring lock "refresh_cache-27823c45-9fce-41b2-923b-a5a907ef029c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:40.558767 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Acquired lock "refresh_cache-27823c45-9fce-41b2-923b-a5a907ef029c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:40.558973 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Refreshing network info cache for port 2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:40.571070 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.40.100,3260]
May 28 14:04:40.571070 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.40.100,3260] successful.
May 28 14:04:40.571070 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.581541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.50.100,3260]
May 28 14:04:40.581541 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.50.100,3260] successful.
May 28 14:04:40.581541 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.583351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.597962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.604186 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.604687 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:40.604999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:40.604999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:40.606172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('9', '-', '-', 0) found on session 35 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:40.606393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:40.619007 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('10', '-', '-', 0) found on session 36 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:40.619007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:40.628443 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 35 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:40.628895 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:40.639307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 36 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:40.639965 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:40.796082 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:40.796465 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:41.062356 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:41.300309 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:41.398231 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:41.459523 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:04:41.533033 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Updated VIF entry in instance network info cache for port 2511a4a6-e6ab-4e66-b913-c5837539cdfb. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:41.533338 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Updating instance_info_cache with network_info: [{"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:41.808286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.811s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:41.808773 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.070s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:41.808957 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:04:42.035511 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:04:42.035897 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fdbbc01b-eb6c-421c-8db8-6827554cd232 req-142b3f3f-cf00-4347-8ddb-95e849106182 service nova] Releasing lock "refresh_cache-27823c45-9fce-41b2-923b-a5a907ef029c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:42.317879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:04:42.318228 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:04:42.318479 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:42.318767 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:42.408319 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01855887e3a0438bbe84fb9664132ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e8657cdaa8482182b12ae39785f074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:04:42.480002 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 330000000ddd07c73 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:42.480355 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:42.480730 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000ddd07c73', 'path': '/dev/dm-1', 'multipath_id': '330000000ddd07c73'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:42.480856 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ddd07c73', 'path': '/dev/dm-1', 'multipath_id': '330000000ddd07c73'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:42.481382 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.950s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:42.481686 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:42.495444 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:42.496005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:42.496465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:42.497057 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:42.497571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:42.497738 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:42.510311 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:42.510311 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:42.515602 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:42.515602 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:42.525430 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74] added
May 28 14:04:42.525430 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:42.525430 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:42.525430 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:42.525430 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:42.525430 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:42.525430 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:42.525430 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:42.525790 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:42.525887 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74] added
May 28 14:04:42.534583 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:42.534583 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:42.534583 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:42.628296 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:42.628637 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:42.822608 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:04:42.970098 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Successfully created port: cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:04:42.990713 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-55580316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumemultiattachtest-server-55580316',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-raywm34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:37Z,user_data=None,user_id='81cf50caaafd43ffae63aff9c9258528',uuid=27823c45-9fce-41b2-923b-a5a907ef029c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:42.990993 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:42.991664 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:55:45,bridge_name='br-int',has_traffic_filtering=True,id=2511a4a6-e6ab-4e66-b913-c5837539cdfb,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511a4a6-e6') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:42.992376 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'pci_devices' on Instance uuid 27823c45-9fce-41b2-923b-a5a907ef029c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:43.132324 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:43.226741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.327680 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:04:43.495752 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <uuid>27823c45-9fce-41b2-923b-a5a907ef029c</uuid>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <name>instance-00000016</name>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-55580316</nova:name>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:04:39</nova:creationTime>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         <nova:port uuid="2511a4a6-e6ab-4e66-b913-c5837539cdfb">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <entry name="serial">27823c45-9fce-41b2-923b-a5a907ef029c</entry>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <entry name="uuid">27823c45-9fce-41b2-923b-a5a907ef029c</entry>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c/disk.config"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <alias name="ua-7ab3ae63-2f4c-42b6-8889-670d79255c71"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-1"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <serial>7ab3ae63-2f4c-42b6-8889-670d79255c71</serial>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <shareable/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:14:55:45"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <target dev="tap2511a4a6-e6"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c/console.log" append="off"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:43.495752 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:43.498837 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Preparing to wait for external event network-vif-plugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:04:43.498837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:43.498837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:43.498837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:43.498837 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-55580316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumemultiattachtest-server-55580316',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-raywm34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:37Z,user_data=None,user_id='81cf50caaafd43ffae63aff9c9258528',uuid=27823c45-9fce-41b2-923b-a5a907ef029c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:04:43.498837 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:43.499339 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:55:45,bridge_name='br-int',has_traffic_filtering=True,id=2511a4a6-e6ab-4e66-b913-c5837539cdfb,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511a4a6-e6') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:43.499579 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:55:45,bridge_name='br-int',has_traffic_filtering=True,id=2511a4a6-e6ab-4e66-b913-c5837539cdfb,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511a4a6-e6') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:04:43.499984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.500312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:43.500605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:04:43.501520 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.501738 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '645de620-cc38-50ff-9488-2a6bfe6d0bc4', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:43.502575 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.503388 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:43.504578 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.507343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.507586 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2511a4a6-e6, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:43.507940 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2511a4a6-e6, col_values=(('qos', UUID('420e44a4-428a-451d-854e-5eb1baa0b56c')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:43.508165 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2511a4a6-e6, col_values=(('external_ids', {'iface-id': '2511a4a6-e6ab-4e66-b913-c5837539cdfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:55:45', 'vm-uuid': '27823c45-9fce-41b2-923b-a5a907ef029c'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:43.509276 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.510760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:43.518967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:43.519950 np0000001643 nova-compute[98269]: INFO os_vif [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:55:45,bridge_name='br-int',has_traffic_filtering=True,id=2511a4a6-e6ab-4e66-b913-c5837539cdfb,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511a4a6-e6')
May 28 14:04:43.526285 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:43.532753 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:43.541752 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:43.541752 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:43.548829 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:43.548829 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.558665 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.563739 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.580627 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.581139 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.581995 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.582510 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:43.601795 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Successfully updated port: cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:04:43.627539 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.40.100,3260]
May 28 14:04:43.627539 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.40.100,3260] successful.
May 28 14:04:43.627539 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.635440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.50.100,3260]
May 28 14:04:43.635440 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.50.100,3260] successful.
May 28 14:04:43.635440 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.639869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.831s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:43.641788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.649313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:43.665152 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:43.665152 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing instance network info cache due to event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:43.665152 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] Acquiring lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:43.665685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] Acquired lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:43.666283 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing network info cache for port cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.668787 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.669274 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:43.670035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.671676 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:43.672023 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:43.672628 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:43.673020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:43.673173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:43.676429 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] HCTL ('12', '-', '-', 0) found on session 38 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:43.676769 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] HCTL ('11', '-', '-', 0) found on session 37 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:43.676952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:43.677335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:43.706701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching for a device in session 38 and hctl ['12', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:43.706701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:43.706701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching for a device in session 37 and hctl ['11', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:43.706701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:43.715689 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Deleted allocations for instance 36328085-63b7-433c-8518-1786ee151fc0
May 28 14:04:44.103948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:44.172949 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:44.239960 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:04:44.339671 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:04:44.342607 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:04:44.342607 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Creating image(s)
May 28 14:04:44.342607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:44.342607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:44.343036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:44.343622 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:44.347826 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:44.349369 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:44.367553 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:44.445958 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:44.450741 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:44.454000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:44.454904 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:44.455504 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:44.460686 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:44.461176 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:44.498341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:04:44.570707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:44.573143 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:44.623254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk 1073741824" returned: 0 in 0.050s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:44.623852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:44.624263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:44.715988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:44.716506 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:04:44.716815 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:44.735760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ba077ee-0f7d-4358-8422-db4d4ec51aaf tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "36328085-63b7-433c-8518-1786ee151fc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.812s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:44.804017 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:44.805268 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Cannot resize image /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:04:44.805619 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:04:44.805803 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Ensure instance console log exists: /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:04:44.806116 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:44.806322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:44.806485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:44.955749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-017da519-d127-4bb4-a683-8c2e34dd3f39 req-38353b40-bcb0-40bb-8c2f-4812f3406578 service nova] Releasing lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:44.956410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquired lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:44.956835 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:04:45.038504 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:45.038686 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:45.038835 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:14:55:45, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:45.039615 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Using config drive
May 28 14:04:45.304796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:45.304950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:45.305069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:45.305139 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:45.305289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:45.307258 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Terminating instance
May 28 14:04:45.521927 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Found WWN 3300000000a27e1e3 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:45.522525 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:45.524778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] <== connect_volume: return (5991ms) {'type': 'block', 'scsi_wwn': '3300000000a27e1e3', 'path': '/dev/dm-4', 'multipath_id': '3300000000a27e1e3'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:45.524778 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a27e1e3', 'path': '/dev/dm-4', 'multipath_id': '3300000000a27e1e3'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:45.524778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.923s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:45.524778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:04:45.524778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:04:45.528576 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'flavor' on Instance uuid 7c6f49c3-6903-4440-987d-dc99e23240bf {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:45.548874 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:45.554096 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.558125 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.558497 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:45.558765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '38')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:04:45.558765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '34')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:45.560401 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '33')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:45.561967 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781a4360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'): ({'sdh'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:04:45.562283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:04:45.562642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flush multipath device 330000000edd7040f {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:04:45.597255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:45.655216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:45.713206 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:04:45.713470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:04:45.715165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:04:45.724640 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Creating config drive at /opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c/disk.config
May 28 14:04:45.728413 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:04:45.728765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:04:45.732466 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpygt8n8a9 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:45.746861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:45.777621 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:45.782166 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260]
May 28 14:04:45.782166 np0000001643 nova-compute[98269]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260] successful.
May 28 14:04:45.782166 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:45.797415 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpygt8n8a9" returned: 0 in 0.067s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:45.804399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:45.810631 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:04:45.817056 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:45.844696 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:45.849151 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:45.856166 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260]
May 28 14:04:45.856166 np0000001643 nova-compute[98269]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260] successful.
May 28 14:04:45.856166 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:45.871474 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:45.878701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:45.879177 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:45.879373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== disconnect_volume: return (6278ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:45.880812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:04:45.880812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.073s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:45.880812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '993e9269-3030-4b35-a005-a04e51b6695e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:04:45.880812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:04:45.893010 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Start _get_guest_xml network_info=[{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '60f5fadf-f8c5-49f9-a8e2-f75b1846264f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc', 'attached_at': '', 'detached_at': '', 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'serial': '6b283459-8bc2-41e6-a88a-c2719309f7eb'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:04:45.895803 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:45.897349 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1095431235', uuid='0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc'), owner=OwnerMeta(userid='d2ab771f08c245c7a7dffca595835dba', username='tempest-AttachVolumeTestJSON-1658324310-project-member', projectid='706c08c92c6844b3ab7b4019269eabad', projectname='tempest-AttachVolumeTestJSON-1658324310'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977085.896911) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:04:45.898568 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:04:45.898992 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:04:45.900146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:04:45.900363 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:04:45.901651 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:04:45.903370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:04:45.903930 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:04:45.903930 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:45.924302 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '38')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:04:45.924302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '24')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:45.924886 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e', '23')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:45.928186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c2cb740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:04:45.928800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:04:45.930551 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Flush multipath device 330000000f847571a {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:04:45.970879 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:46.025063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:46.033836 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Attempting to attach volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:04:46.038261 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:46.041942 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:04:46.041942 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:46.041942 np0000001643 nova-compute[98269]:   <alias name="ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74"/>
May 28 14:04:46.041942 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:04:46.041942 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:04:46.041942 np0000001643 nova-compute[98269]:   <serial>2860cac6-20a8-4ee7-8a18-4a6531db6b74</serial>
May 28 14:04:46.041942 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:04:46.041942 np0000001643 nova-compute[98269]: </disk>
May 28 14:04:46.041942 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:04:46.055681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.067255 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.073797 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-defc24ff-99b2-4544-892d-dd4797f7825e req-6dd9688c-f346-4d75-8595-8e15bf5d4ad3 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:46.074111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-defc24ff-99b2-4544-892d-dd4797f7825e req-6dd9688c-f346-4d75-8595-8e15bf5d4ad3 service nova] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:46.074339 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-defc24ff-99b2-4544-892d-dd4797f7825e req-6dd9688c-f346-4d75-8595-8e15bf5d4ad3 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:46.074975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-defc24ff-99b2-4544-892d-dd4797f7825e req-6dd9688c-f346-4d75-8595-8e15bf5d4ad3 service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:46.075251 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-defc24ff-99b2-4544-892d-dd4797f7825e req-6dd9688c-f346-4d75-8595-8e15bf5d4ad3 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] No waiting events found dispatching network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:46.075348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-defc24ff-99b2-4544-892d-dd4797f7825e req-6dd9688c-f346-4d75-8595-8e15bf5d4ad3 service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:46.076732 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:04:46.076927 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:04:46.078863 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:04:46.094539 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:04:46.095171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:04:46.108665 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.137880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.40.100,3260]
May 28 14:04:46.137880 np0000001643 nova-compute[98269]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.40.100,3260] successful.
May 28 14:04:46.137880 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.158471 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.171283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.218550 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004995350000172039 future=<Future at 0x71a75c16f380 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:46.218669 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:46.218809 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.499103161999983 future=<Future at 0x71a75c2674a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:46.218986 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.498921707000136 future=<Future at 0x71a75c2674a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:46.219472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.50.100,3260]
May 28 14:04:46.219472 np0000001643 nova-compute[98269]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-993e9269-3030-4b35-a005-a04e51b6695e, portal: 192.168.50.100,3260] successful.
May 28 14:04:46.219472 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.238714 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.238978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:46.239248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] <== disconnect_volume: return (6432ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:46.239366 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:04:46.409854 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:46.421002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:46.457131 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99869301700005 future=<Future at 0x71a75c216240 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:46.461656 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Instance destroyed successfully.
May 28 14:04:46.462477 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'resources' on Instance uuid 8937adb3-1191-477e-a01d-76d29db6b224 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:46.534737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:46.535302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:46.535636 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:46.536752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:46.537208 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:46.537713 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:46.537891 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:46.538325 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:46.538719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:46.544899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Releasing lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:46.545462 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance network_info: |[{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:04:46.547653 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Start _get_guest_xml network_info=[{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:04:46.549783 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:04:46.551115 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-294841717', uuid='8584659f-147f-4b78-ad59-e0eebdb9aaf3'), owner=OwnerMeta(userid='01855887e3a0438bbe84fb9664132ad1', username='tempest-ServerStableDeviceRescueTest-456151526-project-member', projectid='38e8657cdaa8482182b12ae39785f074', projectname='tempest-ServerStableDeviceRescueTest-456151526'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977086.5507228) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:04:46.552214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:46.553094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:46.553647 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:46.553851 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:46.554596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:46.554875 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:46.555422 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:04:46.556239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:04:46.558882 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:04:46.559258 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:04:46.560429 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:04:46.560804 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:04:46.560957 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:04:46.561130 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:04:46.561316 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:04:46.561487 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:04:46.561579 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:04:46.561764 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:04:46.561891 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:04:46.562136 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:04:46.562269 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:04:46.562404 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:04:46.571947 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:46.571947 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.573095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:46.573095 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.576735 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-294841717',display_name='tempest-ServerStableDeviceRescueTest-server-294841717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverstabledevicerescuetest-server-294841717',id=23,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0NOTH30hDWSiHEniaN0RC5oWheCyp/m3BonLN/TN1md0y7tPyNxh4sAnGG+z2B7LwUqdQHyPvX8A7mOyGnWq+aFvvM6+hI6nlYEMk1CjTlbq7QgfcIKB9Pbgk76U14Fw==',key_name='tempest-keypair-1832891856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38e8657cdaa8482182b12ae39785f074',ramdisk_id='',reservation_id='r-d4uk1qsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-456151526',owner_user_name='tempest-ServerStableDeviceRescueTest-456151526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01855887e3a0438bbe84fb9664132ad1',uuid=8584659f-147f-4b78-ad59-e0eebdb9aaf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:46.576951 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converting VIF {"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:46.577676 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:46.578363 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'pci_devices' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:46.585255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb] added
May 28 14:04:46.585255 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:46.585255 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:46.585255 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:46.585255 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:46.585255 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:46.585255 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.585758 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:46.586028 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:46.586182 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:46.595572 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.599126 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb] added
May 28 14:04:46.599126 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:46.599126 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:46.599126 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:46.599126 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:46.599126 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:46.599126 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:46.600538 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:46.600538 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0446(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:46.604459 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:46.629312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.633249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.731567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.813877 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'flavor' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:46.969835 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1190212760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1190212760',id=14,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:30Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-y0zp9ixx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:41Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=8937adb3-1191-477e-a01d-76d29db6b224,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:04:46.969835 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "address": "fa:16:3e:0a:ab:40", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6433bbd-63", "ovs_interfaceid": "d6433bbd-634c-4b65-a0a6-256154bfb0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:46.970879 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ab:40,bridge_name='br-int',has_traffic_filtering=True,id=d6433bbd-634c-4b65-a0a6-256154bfb0cd,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6433bbd-63') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:46.970879 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ab:40,bridge_name='br-int',has_traffic_filtering=True,id=d6433bbd-634c-4b65-a0a6-256154bfb0cd,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6433bbd-63') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:04:46.972675 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.974197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6433bbd-63, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:46.978396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.978785 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:46.980203 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.980960 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b3e1ff9-f4d2-480b-a7f8-d418c4521212) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:46.981171 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.981576 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:46.982385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:46.987275 np0000001643 nova-compute[98269]: INFO os_vif [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ab:40,bridge_name='br-int',has_traffic_filtering=True,id=d6433bbd-634c-4b65-a0a6-256154bfb0cd,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6433bbd-63')
May 28 14:04:46.987275 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Deleting instance files /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224_del
May 28 14:04:46.988426 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Deletion of /opt/stack/data/nova/instances/8937adb3-1191-477e-a01d-76d29db6b224_del complete
May 28 14:04:47.034196 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.038178 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.045939 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.049889 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.069335 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.082804 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <uuid>8584659f-147f-4b78-ad59-e0eebdb9aaf3</uuid>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <name>instance-00000017</name>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-294841717</nova:name>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:04:46</nova:creationTime>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:user uuid="01855887e3a0438bbe84fb9664132ad1">tempest-ServerStableDeviceRescueTest-456151526-project-member</nova:user>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:project uuid="38e8657cdaa8482182b12ae39785f074">tempest-ServerStableDeviceRescueTest-456151526</nova:project>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         <nova:port uuid="cb4e4b15-723c-469c-b5f8-53863c6ac3d6">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <entry name="serial">8584659f-147f-4b78-ad59-e0eebdb9aaf3</entry>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <entry name="uuid">8584659f-147f-4b78-ad59-e0eebdb9aaf3</entry>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:5f:89:50"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <target dev="tapcb4e4b15-72"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/console.log" append="off"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:47.082804 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:47.084974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Preparing to wait for external event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:04:47.084974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:47.084974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:47.084974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:47.084974 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-294841717',display_name='tempest-ServerStableDeviceRescueTest-server-294841717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverstabledevicerescuetest-server-294841717',id=23,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0NOTH30hDWSiHEniaN0RC5oWheCyp/m3BonLN/TN1md0y7tPyNxh4sAnGG+z2B7LwUqdQHyPvX8A7mOyGnWq+aFvvM6+hI6nlYEMk1CjTlbq7QgfcIKB9Pbgk76U14Fw==',key_name='tempest-keypair-1832891856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38e8657cdaa8482182b12ae39785f074',ramdisk_id='',reservation_id='r-d4uk1qsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-456151526',owner_user_name='tempest-ServerStableDeviceRescueTest-456151526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01855887e3a0438bbe84fb9664132ad1',uuid=8584659f-147f-4b78-ad59-e0eebdb9aaf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:04:47.084974 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converting VIF {"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:47.085416 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:47.085416 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:04:47.086836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.086836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:47.086836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:04:47.088207 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.088207 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '617d41ff-b394-5017-b846-eedba03786e7', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:47.089741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.089741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:47.090258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.096111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.096111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb4e4b15-72, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:47.096111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb4e4b15-72, col_values=(('qos', UUID('1f90fe57-feb0-4d25-b2ab-dc59e2065b0f')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:47.096111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb4e4b15-72, col_values=(('external_ids', {'iface-id': 'cb4e4b15-723c-469c-b5f8-53863c6ac3d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:89:50', 'vm-uuid': '8584659f-147f-4b78-ad59-e0eebdb9aaf3'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:47.096693 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.098918 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:47.103083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:47.104199 np0000001643 nova-compute[98269]: INFO os_vif [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72')
May 28 14:04:47.503631 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Took 1.69 seconds to destroy the instance on the hypervisor.
May 28 14:04:47.504811 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:04:47.505155 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:04:47.505289 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:04:47.505620 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:47.540355 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977087.5399683, 27823c45-9fce-41b2-923b-a5a907ef029c => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:47.540937 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] VM Started (Lifecycle Event)
May 28 14:04:47.585862 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:47.587389 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:47.601232 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:47.601232 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.603781 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:47.613603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:47.616697 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:47.616697 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.630035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.631225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.631225 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.631225 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.631225 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.631225 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.631225 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.631225 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:47.631428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.631428 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.631428 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.631428 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.631428 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.631428 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.631428 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:47.646383 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.646383 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.646383 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.646383 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.646383 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.646383 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.646383 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:47.646708 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.646708 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.646708 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.646708 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.646708 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.646708 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.646708 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:47.675166 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260]
May 28 14:04:47.675166 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260] successful.
May 28 14:04:47.675166 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.686399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.700068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260]
May 28 14:04:47.700068 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260] successful.
May 28 14:04:47.700068 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.706374 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('7', '-', '-', 0) found on session 39 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:47.706374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:47.712622 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:47.718381 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00044854699990537483 future=<Future at 0x71a75c2674a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:47.718509 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:47.718629 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.0845790060000127 future=<Future at 0x71a75c18dbb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:47.718708 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.0844889299999068 future=<Future at 0x71a75c18dbb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:47.719083 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Emitting event <LifecycleEvent: 1779977072.717778, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:47.719269 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Stopped (Lifecycle Event)
May 28 14:04:47.726278 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 39 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:47.726278 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.740791 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:47.741188 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:47.741467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:47.741467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:47.743513 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('8', '-', '-', 0) found on session 40 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:47.743637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:47.760415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 40 and hctl ['8', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:47.828038 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4feb06a7-fcd8-482a-80f9-2269ca5ea1ff tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.154s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:48.006548 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:48.007038 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:48.007373 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:48.009468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No VIF found with MAC fa:16:3e:42:9e:e2, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:48.043771 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:48.047504 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977088.045265, 27823c45-9fce-41b2-923b-a5a907ef029c => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:48.047504 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] VM Paused (Lifecycle Event)
May 28 14:04:48.161776 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:48.162048 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Acquiring lock "8937adb3-1191-477e-a01d-76d29db6b224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:48.162298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:48.165072 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Lock "8937adb3-1191-477e-a01d-76d29db6b224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:48.165351 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] No waiting events found dispatching network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:48.165668 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-unplugged-d6433bbd-634c-4b65-a0a6-256154bfb0cd for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:48.165830 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-plugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:48.166037 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:48.166245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:48.166409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:48.166703 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Processing event network-vif-plugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:04:48.166988 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-plugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:48.167158 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:48.167335 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:48.167582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:48.168043 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] No waiting events found dispatching network-vif-plugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:48.168043 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received unexpected event network-vif-plugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb for instance with vm_state building and task_state spawning.
May 28 14:04:48.168196 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Received event network-vif-deleted-d6433bbd-634c-4b65-a0a6-256154bfb0cd {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:48.170090 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Neutron deleted interface d6433bbd-634c-4b65-a0a6-256154bfb0cd; detaching it from the instance and deleting it from the info cache
May 28 14:04:48.170683 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:04:48.172259 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c921d45b-7b03-4cd0-9f62-ac5f04dc6bea req-08062aaf-673f-48a8-bf86-66e12ebe012c service nova] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Detach interface failed, port_id=d6433bbd-634c-4b65-a0a6-256154bfb0cd, reason: Instance 8937adb3-1191-477e-a01d-76d29db6b224 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:04:48.177420 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:04:48.179629 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Instance spawned successfully.
May 28 14:04:48.180052 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:04:48.225021 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:48.329596 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:48.336998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:48.336998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:48.336998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:48.337234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:48.337362 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:48.339627 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Terminating instance
May 28 14:04:48.547953 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:48.550021 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977088.549763, 27823c45-9fce-41b2-923b-a5a907ef029c => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:48.550136 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] VM Resumed (Lifecycle Event)
May 28 14:04:48.626477 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:48.626623 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:48.626730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No VIF found with MAC fa:16:3e:5f:89:50, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:48.627345 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Using config drive
May 28 14:04:48.686164 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:48.686460 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:48.686757 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:48.687122 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:48.687436 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:48.688013 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:48.761229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 40 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:48.761379 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:48.833335 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Took 1.33 seconds to deallocate network for instance.
May 28 14:04:48.842890 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:04:48.889185 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:48.894237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:48.920757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.054550 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:49.058555 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:49.076440 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07dca8ac-8d69-4f71-a3c1-a6b20543b7ab req-87e4d186-e4fb-4d28-be31-7f394907c16d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:49.076704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-07dca8ac-8d69-4f71-a3c1-a6b20543b7ab req-87e4d186-e4fb-4d28-be31-7f394907c16d service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:49.076907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-07dca8ac-8d69-4f71-a3c1-a6b20543b7ab req-87e4d186-e4fb-4d28-be31-7f394907c16d service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:49.077084 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-07dca8ac-8d69-4f71-a3c1-a6b20543b7ab req-87e4d186-e4fb-4d28-be31-7f394907c16d service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:49.077258 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07dca8ac-8d69-4f71-a3c1-a6b20543b7ab req-87e4d186-e4fb-4d28-be31-7f394907c16d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:49.082804 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07dca8ac-8d69-4f71-a3c1-a6b20543b7ab req-87e4d186-e4fb-4d28-be31-7f394907c16d service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:49.085848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.102670 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.133332 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:49.194145 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Took 9.77 seconds to spawn the instance on the hypervisor.
May 28 14:04:49.194741 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:49.235861 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Instance destroyed successfully.
May 28 14:04:49.235861 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'resources' on Instance uuid 4dc73d91-4d87-4283-9a77-607c0e512265 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:49.335442 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Creating config drive at /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config
May 28 14:04:49.339931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:49.341388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:49.348585 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgr6s8v8f {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:49.365587 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.408378 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgr6s8v8f" returned: 0 in 0.060s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:49.420959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:49.421319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:49.565433 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:04:49.569497 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999692231999916 future=<Future at 0x71a75c29bd10 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:49.573330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found WWN 330000000edd7040f for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:49.573847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:49.575087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000edd7040f', 'path': '/dev/dm-0', 'multipath_id': '330000000edd7040f'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:49.575302 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000edd7040f', 'path': '/dev/dm-0', 'multipath_id': '330000000edd7040f'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:49.609384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b73d9337-defd-4314-a4e8-8756b5205121 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.757s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:49.710323 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Took 18.01 seconds to build instance.
May 28 14:04:49.740535 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1960360925',display_name='tempest-ServerRescueNegativeTestJSON-server-1960360925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-1960360925',id=13,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPY7gcyM15HNMgUUrWL0PnUGvfKERrlJnRdaJjn6fmYO1DMIBfebiD81LEUfKQS34wQzehV/k1KDg8WmREMFPeUgC7522BiSxNEo2YvLvOoa2G23jVYDsxb/94YmFCZRw==',key_name='tempest-keypair-462257235',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:52Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-3jxixxdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=4dc73d91-4d87-4283-9a77-607c0e512265,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:04:49.740790 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "441edb5a-a183-4686-ad86-714a3ab59d5f", "address": "fa:16:3e:1a:79:0d", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap441edb5a-a1", "ovs_interfaceid": "441edb5a-a183-4686-ad86-714a3ab59d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:49.741596 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:49.741913 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:04:49.744629 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.744921 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap441edb5a-a1, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:49.749647 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:49.753693 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.755014 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.755208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f44400c-e3a5-491d-978a-7a7a2b087411) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:49.758900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.759966 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:49.765354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.768338 np0000001643 nova-compute[98269]: INFO os_vif [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:79:0d,bridge_name='br-int',has_traffic_filtering=True,id=441edb5a-a183-4686-ad86-714a3ab59d5f,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441edb5a-a1')
May 28 14:04:49.768729 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Deleting instance files /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265_del
May 28 14:04:49.769662 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Deletion of /opt/stack/data/nova/instances/4dc73d91-4d87-4283-9a77-607c0e512265_del complete
May 28 14:04:49.927966 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'flavor' on Instance uuid 854e01ef-64f4-464f-8a46-ef352e4ccf2a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:49.946828 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:49.977014 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:50.077688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:50.085608 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:04:50.085820 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:50.086350 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:50.087199 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:50.212683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04320bdf-eeec-4251-ae3f-99cd1d52adc6 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.520s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:50.232432 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:50.232681 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:50.282480 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 14:04:50.282969 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:04:50.285541 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:04:50.285541 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:04:50.285541 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:50.364153 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:50.369150 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:50.372881 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:50.398899 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:50.592863 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:50.597636 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] End _get_guest_xml xml=<domain type="qemu">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <uuid>0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</uuid>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <name>instance-0000000f</name>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeTestJSON-server-1095431235</nova:name>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:04:45</nova:creationTime>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:user uuid="d2ab771f08c245c7a7dffca595835dba">tempest-AttachVolumeTestJSON-1658324310-project-member</nova:user>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:project uuid="706c08c92c6844b3ab7b4019269eabad">tempest-AttachVolumeTestJSON-1658324310</nova:project>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         <nova:port uuid="bd542e8b-1f1b-4e59-8c1b-fe44bfd93140">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <system>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <entry name="serial">0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</entry>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <entry name="uuid">0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</entry>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </system>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <os>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   </os>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <features>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   </features>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   <devices>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <alias name="ua-6b283459-8bc2-41e6-a88a-c2719309f7eb"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <serial>6b283459-8bc2-41e6-a88a-c2719309f7eb</serial>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </disk>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:16:45:16"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <target dev="tapbd542e8b-1f"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </interface>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/console.log" append="off"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </serial>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <video>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </video>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </rng>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:   </devices>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]: </domain>
May 28 14:04:50.597636 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:04:50.604124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:50.701030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:50.701945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:50.739756 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:50.805367 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0020993299999645387 future=<Future at 0x71a75c18dbb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:50.805530 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:50.806545 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.649952324999958 future=<Future at 0x71a75c216240 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:50.809465 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.64628437600004 future=<Future at 0x71a75c216240 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:50.811780 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] Emitting event <LifecycleEvent: 1779977075.803136, 36328085-63b7-433c-8518-1786ee151fc0 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:50.812144 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] VM Stopped (Lifecycle Event)
May 28 14:04:50.817747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:50.821716 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:04:50.824108 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:50.935779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:50.998047 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977090.9976838, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:50.998262 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Started (Lifecycle Event)
May 28 14:04:51.016053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55a01596-02cf-4bfe-beab-7ce1ec8dffc2 req-74cb1375-429f-4108-bac2-ee17020777a2 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-deleted-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:51.016251 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-55a01596-02cf-4bfe-beab-7ce1ec8dffc2 req-74cb1375-429f-4108-bac2-ee17020777a2 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Neutron deleted interface 441edb5a-a183-4686-ad86-714a3ab59d5f; detaching it from the instance and deleting it from the info cache
May 28 14:04:51.019389 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55a01596-02cf-4bfe-beab-7ce1ec8dffc2 req-74cb1375-429f-4108-bac2-ee17020777a2 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Detach interface failed, port_id=441edb5a-a183-4686-ad86-714a3ab59d5f, reason: Instance 4dc73d91-4d87-4283-9a77-607c0e512265 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:04:51.171729 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:51.171729 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Acquiring lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:51.171837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:51.171998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Lock "4dc73d91-4d87-4283-9a77-607c0e512265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:51.172106 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] No waiting events found dispatching network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:51.172285 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Received event network-vif-unplugged-441edb5a-a183-4686-ad86-714a3ab59d5f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:51.172584 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:51.173149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:51.173149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:51.173410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:51.173580 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Processing event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:04:51.173805 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:51.174341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:51.174466 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:51.174569 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:51.174692 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:51.174825 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-574f6ac1-baca-47ec-aab6-674fa4d25075 req-1c69566b-1cee-41f2-a4d8-4d0a3c456a23 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state building and task_state spawning.
May 28 14:04:51.175150 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:04:51.178068 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:04:51.180763 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance spawned successfully.
May 28 14:04:51.181180 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:04:51.251242 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.910s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:51.316900 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ba87df4-b8de-401d-9d29-1ce509378b9f tempest-ServerActionsTestOtherB-89556640 tempest-ServerActionsTestOtherB-89556640-project-member] [instance: 36328085-63b7-433c-8518-1786ee151fc0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:51.319149 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Deleted allocations for instance 8937adb3-1191-477e-a01d-76d29db6b224
May 28 14:04:51.328133 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:51.329189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:51.427842 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:51.428384 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:04:51.428581 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:51.442421 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:51.503062 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:51.507161 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:51.522787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:04:51.523560 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Cannot resize image /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:04:51.523852 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'migration_context' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:51.689684 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:51.690119 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:51.690119 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:51.690396 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:51.690693 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:51.690961 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:04:51.947518 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Took 1.66 seconds to deallocate network for instance.
May 28 14:04:52.012399 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:04:52.012399 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977092.0101657, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:52.012399 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Paused (Lifecycle Event)
May 28 14:04:52.019598 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:52.022271 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:52.022271 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Attaching volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74 to /dev/vdb
May 28 14:04:52.030315 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:04:52.031689 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:04:52.032980 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:52.033822 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:52.034532 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:04:52.038249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.038249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:52.041604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:04:52.043566 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.046997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4429436-e6bf-56b1-90db-da3d24573a22', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:52.048636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.051249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:52.056308 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.056676 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd542e8b-1f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:52.057286 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd542e8b-1f, col_values=(('qos', UUID('b88f17ac-5944-49a5-be4b-2e986c54d6ee')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:52.057987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd542e8b-1f, col_values=(('external_ids', {'iface-id': 'bd542e8b-1f1b-4e59-8c1b-fe44bfd93140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:45:16', 'vm-uuid': '0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:52.059497 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.064546 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:52.070700 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.074470 np0000001643 nova-compute[98269]: INFO os_vif [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f')
May 28 14:04:52.147705 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:52.181609 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:04:52.197242 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Took 7.86 seconds to spawn the instance on the hypervisor.
May 28 14:04:52.201473 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:52.208702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:52.277030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:04:52.278215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:04:52.291472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:04:52.293755 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:fe22:8d7d', 'fe80::fc16:3eff:feb2:5c60', 'fe80::240f:c4ff:fe18:31a9', 'fe80::fc16:3eff:fe42:9ee2', 'fe80::fc16:3eff:fe16:3044', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164'] 
May 28 14:04:52.295131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:04:52.295131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:04:52.295131 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:52.295615 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Updating existing volume attachment record: 232ee18b-632c-42dd-82f3-dc51b051485f {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:04:52.334235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6697731c-e44a-4a87-bb6c-215e3b0a7461 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "8937adb3-1191-477e-a01d-76d29db6b224" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.027s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:52.457306 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:52.457549 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:52.515191 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:52.524581 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977092.5234776, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:52.524581 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Resumed (Lifecycle Event)
May 28 14:04:52.685702 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.711707 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.714195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.729005 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Took 13.78 seconds to build instance.
May 28 14:04:52.823096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:52.870887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:52.870887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:52.871796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:52.872005 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:52.872101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:52.874507 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Terminating instance
May 28 14:04:52.895082 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:52.895426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:52.896113 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:52.896113 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:52.896427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:52.918774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:52.919361 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:52.921355 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:52.921601 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:52.922941 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:52.923131 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:52.940354 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:52.940354 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:52.949471 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:52.949471 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:52.955833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:52.970686 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:52.980477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0dfbe06f-87e9-44c6-ac3d-53a9a3025210 req-d06e6cce-80c4-48ef-9c88-52661f73df06 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:52.980477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0dfbe06f-87e9-44c6-ac3d-53a9a3025210 req-d06e6cce-80c4-48ef-9c88-52661f73df06 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:52.980477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0dfbe06f-87e9-44c6-ac3d-53a9a3025210 req-d06e6cce-80c4-48ef-9c88-52661f73df06 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:52.980477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0dfbe06f-87e9-44c6-ac3d-53a9a3025210 req-d06e6cce-80c4-48ef-9c88-52661f73df06 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:52.980477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0dfbe06f-87e9-44c6-ac3d-53a9a3025210 req-d06e6cce-80c4-48ef-9c88-52661f73df06 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:52.980477 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-0dfbe06f-87e9-44c6-ac3d-53a9a3025210 req-d06e6cce-80c4-48ef-9c88-52661f73df06 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state stopped and task_state powering-on.
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.984698 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.984963 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:52.985310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:52.985491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:52.986196 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] HCTL ('11', '0', '0', 0) found on session 37 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:52.986319 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:52.997256 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:52.998467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.075s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:52.998467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:52.999202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] HCTL ('12', '0', '0', 0) found on session 38 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:52.999384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:52.999981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching for a device in session 37 and hctl ('11', '0', '0', 0) yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:53.000202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:53.013195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Searching for a device in session 38 and hctl ('12', '0', '0', 0) yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:53.013195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:53.028369 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:53.031734 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:53.112032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.115208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.119432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.149365 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.236892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.300s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:53.294779 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:53.294990 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:53.307860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:53.308161 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:53.376179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:53.376415 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:53.378484 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:04:53.406962 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.414228 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.433900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.633488 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.639351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:53.724493 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999627201000067 future=<Future at 0x71a75c2145f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:04:53.728267 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Instance destroyed successfully.
May 28 14:04:53.734550 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'resources' on Instance uuid 033c2245-10fc-4568-a15f-3b39ee5258ae {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:53.801919 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:53.814326 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:04:53.840527 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:04:53.842409 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977093.8405302, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:53.842409 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Resumed (Lifecycle Event)
May 28 14:04:53.854015 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance rebooted successfully.
May 28 14:04:53.884497 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid bb01a4a8-04ac-459a-8994-4f6da360c381 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:53.924252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:04:54.238509 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-137732219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-137732219',id=11,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:55Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-9vnyws3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:03Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=033c2245-10fc-4568-a15f-3b39ee5258ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:04:54.238920 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "address": "fa:16:3e:22:8d:7d", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c1b47a-6f", "ovs_interfaceid": "a3c1b47a-6f08-4472-b43d-f02aad3c3ab4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:04:54.239438 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:04:54.239703 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:04:54.241677 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:54.241871 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3c1b47a-6f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:54.245210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:54.245210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:54.246142 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:54.246727 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=368c7f27-6b1f-4aa7-84f0-4021b574795c) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:04:54.249339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:54.249339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:04:54.250797 np0000001643 nova-compute[98269]: INFO os_vif [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8d:7d,bridge_name='br-int',has_traffic_filtering=True,id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c1b47a-6f')
May 28 14:04:54.251941 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:04:54.252271 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:54.252407 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:54.313253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.856s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:54.347474 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:54.354569 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:54.358505 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:54.393206 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:54.394549 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:54.396025 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Deleted allocations for instance 4dc73d91-4d87-4283-9a77-607c0e512265
May 28 14:04:54.402436 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:04:54.402926 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Claim successful on node np0000001643
May 28 14:04:54.860594 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 14:04:54.860594 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977094.8583453, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:04:54.860594 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Started (Lifecycle Event)
May 28 14:04:54.896239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:54.941429 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Found WWN 3300000000a27e1e3 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:54.941907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:54.942221 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '3300000000a27e1e3', 'path': '/dev/dm-4', 'multipath_id': '3300000000a27e1e3'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:54.942384 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a27e1e3', 'path': '/dev/dm-4', 'multipath_id': '3300000000a27e1e3'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:54.943009 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.690s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:54.943438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:04:54.943653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:04:54.948832 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'flavor' on Instance uuid 854e01ef-64f4-464f-8a46-ef352e4ccf2a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:54.972244 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:54.972596 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:54.972596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '40')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:04:54.973133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '18')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:54.973970 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289', '17')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:04:54.974895 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7804b05e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'): ({'sdn'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:04:54.975093 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Removing multipathed devices sdn, sdo {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:04:54.975421 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Flush multipath device 330000000e9f80fd7 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:04:55.009504 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:55.061360 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:04:55.112781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:04:55.113058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:04:55.114710 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:04:55.128497 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:04:55.128712 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:04:55.142673 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:55.142895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:55.143131 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:55.143295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:55.143386 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:55.144144 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state stopped and task_state powering-on.
May 28 14:04:55.144144 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:55.144144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:55.144517 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:55.144517 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:55.144691 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:55.144864 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:55.145210 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:55.145363 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Acquiring lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:55.145542 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:55.145829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:55.146203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:55.146499 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] No waiting events found dispatching network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:04:55.146695 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-unplugged-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:04:55.146748 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:55.146928 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing instance network info cache due to event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:55.147172 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Acquiring lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:55.147294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Acquired lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:55.147576 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing network info cache for port cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:55.178094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.40.100,3260]
May 28 14:04:55.178094 np0000001643 nova-compute[98269]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.40.100,3260] successful.
May 28 14:04:55.178094 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:55.195742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:55.209066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:55.245715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.50.100,3260]
May 28 14:04:55.245715 np0000001643 nova-compute[98269]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289, portal: 192.168.50.100,3260] successful.
May 28 14:04:55.245715 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:55.262144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:55.262348 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:55.262558 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] <== disconnect_volume: return (1009ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:55.262665 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:04:55.262891 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Deleting instance files /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae_del
May 28 14:04:55.263370 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Deletion of /opt/stack/data/nova/instances/033c2245-10fc-4568-a15f-3b39ee5258ae_del complete
May 28 14:04:55.364683 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:55.370013 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:04:55.370656 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:55.370985 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:55.371238 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:55.371331 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No VIF found with MAC fa:16:3e:16:45:16, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:55.371808 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ed940545-50e6-4614-bdd4-244e0f6e8686 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:04:55.412110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d7b40582-dd36-4a0a-a03d-4f68781203b7 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "4dc73d91-4d87-4283-9a77-607c0e512265" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.075s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:55.453011 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Attempting to attach volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:04:55.454969 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:04:55.454969 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:04:55.454969 np0000001643 nova-compute[98269]:   <alias name="ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74"/>
May 28 14:04:55.454969 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:04:55.454969 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:04:55.454969 np0000001643 nova-compute[98269]:   <serial>2860cac6-20a8-4ee7-8a18-4a6531db6b74</serial>
May 28 14:04:55.454969 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:04:55.454969 np0000001643 nova-compute[98269]: </disk>
May 28 14:04:55.454969 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:04:55.654480 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:55.771241 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Took 2.39 seconds to destroy the instance on the hypervisor.
May 28 14:04:55.771775 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:04:55.771935 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:04:55.772036 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:04:55.772258 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:55.872106 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 14:04:55.938011 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:56.020958 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:56.020958 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:56.020958 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Attaching volume 019e3ed8-71c6-4123-999b-ae71d8d21ec5 to /dev/vdb
May 28 14:04:56.078659 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:56.095055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:04:56.124860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:56.181099 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:04:56.181099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:04:56.193417 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:04:56.195364 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fefc:c7d3', 'fe80::aca4:32ff:fe19:9630', 'fe80::d0fe:ffff:fed7:9be3', 'fe80::fc16:3eff:fef1:af1', 'fe80::fc16:3eff:feeb:f82e', 'fe80::fc16:3eff:feb2:5c60', 'fe80::240f:c4ff:fe18:31a9', 'fe80::fc16:3eff:fe42:9ee2', 'fe80::fc16:3eff:fe16:3044', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a'] 
May 28 14:04:56.195508 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:04:56.195606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:04:56.195998 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:56.196072 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Updating existing volume attachment record: 322de4f3-5cea-467c-a3c7-0d2a5257c2cd {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:04:56.202483 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:56.304224 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:56.304326 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:56.361007 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d254e779-930d-4d5e-b03e-12156e5b5665 req-ca9f3fc4-fbf4-4582-8d79-19166cea7368 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Received event network-vif-deleted-a3c1b47a-6f08-4472-b43d-f02aad3c3ab4 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:56.361290 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-d254e779-930d-4d5e-b03e-12156e5b5665 req-ca9f3fc4-fbf4-4582-8d79-19166cea7368 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Neutron deleted interface a3c1b47a-6f08-4472-b43d-f02aad3c3ab4; detaching it from the instance and deleting it from the info cache
May 28 14:04:56.364783 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d254e779-930d-4d5e-b03e-12156e5b5665 req-ca9f3fc4-fbf4-4582-8d79-19166cea7368 service nova] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Detach interface failed, port_id=a3c1b47a-6f08-4472-b43d-f02aad3c3ab4, reason: Instance 033c2245-10fc-4568-a15f-3b39ee5258ae could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:04:56.409298 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updated VIF entry in instance network info cache for port cb4e4b15-723c-469c-b5f8-53863c6ac3d6. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:04:56.409822 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:56.785344 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:04:56.785763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:04:56.785967 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:56.786491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:56.786741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:04:56.799876 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:04:56.802585 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:56.804765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:04:56.805724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:56.805941 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:56.806485 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:04:56.807692 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:56.808180 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:56.821961 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:56.821961 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:56.824010 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:04:56.824010 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:56.835815 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5] added
May 28 14:04:56.835815 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:56.835815 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:56.835815 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:56.835815 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:56.835815 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:56.835815 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:56.836324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:56.836324 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:56.836324 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:56.842628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5] added
May 28 14:04:56.842628 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:04:56.842628 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:56.842628 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:56.842628 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:04:56.842628 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:04:56.842628 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:56.842966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:04:56.843109 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:04:56.843553 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:04:56.911666 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6be6f2d5-a010-4e36-9828-67e5453929e3 req-e0d8e734-53de-4918-a129-1a700894b690 service nova] Releasing lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:04:57.154696 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:57.154870 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:57.155000 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:04:57.155116 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] No VIF found with MAC fa:16:3e:b2:5c:60, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:04:57.307986 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Took 1.54 seconds to deallocate network for instance.
May 28 14:04:57.316999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.923s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:57.317732 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:04:57.825846 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:04:57.826902 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:04:57.826902 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:57.826902 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:57.837050 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:04:57.844026 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:57.854278 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:57.854278 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:04:57.863851 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:04:57.863851 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.873774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.883270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.887760 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Took 0.58 seconds to detach 1 volumes for instance.
May 28 14:04:57.891470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Deleting volume: a0d5efd9-6f21-43ff-8e7c-02fe5bc4c289 {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:04:57.893607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.893607 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.893607 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.893607 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.893607 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.893607 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.893607 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:57.894077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.894077 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.894077 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.894077 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.894077 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.894077 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.894077 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:57.901531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.901531 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.901531 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.901531 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.901531 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.901531 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.901531 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:57.901704 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.901704 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.901704 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.901704 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.901704 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.901704 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.901704 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:57.932421 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81cf50caaafd43ffae63aff9c9258528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4618bb9b554fb8af8f26aae95c016a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:04:57.945530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.40.100,3260]
May 28 14:04:57.945530 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.40.100,3260] successful.
May 28 14:04:57.945530 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.955131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.50.100,3260]
May 28 14:04:57.955131 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.50.100,3260] successful.
May 28 14:04:57.955131 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.961926 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.970591 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.987606 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.987929 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:57.988229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:57.988330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:57.989534 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] HCTL ('13', '-', '-', 0) found on session 41 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:57.989657 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.990740 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:04:57.990974 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:04:57.994920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:57.995138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:04:57.996260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] HCTL ('14', '-', '-', 0) found on session 42 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:04:57.999506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:04:58.030328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching for a device in session 41 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:58.030328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:58.032900 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching for a device in session 42 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:04:58.033843 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:04:58.330856 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:04:58.452456 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:58.452733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:58.664954 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Successfully created port: c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:04:58.731345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1bd04697-9b87-424f-a340-0292ba2bcbb9 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.711s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:58.807324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:04:58.836106 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:04:59.177238 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:04:59.177781 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:04:59.248278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:59.269548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:59.269820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:59.270347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:59.270347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:59.270347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:59.273839 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Successfully updated port: c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:04:59.275704 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Terminating instance
May 28 14:04:59.329777 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-changed-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:04:59.330333 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Refreshing instance network info cache due to event network-changed-c7f757d6-e1c6-43c4-be67-443fe29dcb8a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:04:59.330511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] Acquiring lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:59.330647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] Acquired lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:04:59.330814 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Refreshing network info cache for port c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:04:59.361670 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:59.411990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:59.412245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:59.681159 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:04:59.776004 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:04:59.782490 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:04:59.817481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:59.820679 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:59.834191 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found WWN 330000000a979e371 for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:04:59.834580 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:04:59.834851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000a979e371', 'path': '/dev/dm-5', 'multipath_id': '330000000a979e371'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:04:59.835014 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a979e371', 'path': '/dev/dm-5', 'multipath_id': '330000000a979e371'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:04:59.836042 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:04:59.849625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:04:59.852313 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:04:59.854851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:04:59.856026 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Creating image(s)
May 28 14:04:59.858088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:04:59.858088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:04:59.858088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:04:59.858709 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:59.866745 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:04:59.866745 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid bb01a4a8-04ac-459a-8994-4f6da360c381 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:04:59.867546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:04:59.921622 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Detaching volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74
May 28 14:04:59.975891 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:04:59.997748 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.131s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:00.002085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:00.002796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:00.003298 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:00.007368 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:00.007858 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:00.040776 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Attempting to driver detach volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74 from mountpoint /dev/vdb
May 28 14:05:00.058005 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Found disk vdb by alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:00.059555 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Found disk vdb by alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:00.059778 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Attempting to detach device vdb from instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:05:00.060195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:   <alias name="ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74"/>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:   <serial>2860cac6-20a8-4ee7-8a18-4a6531db6b74</serial>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:00.060195 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:00.075944 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully detached device vdb from instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a from the persistent domain config.
May 28 14:05:00.076204 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] (1/8): Attempting to detach device vdb with device alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 from instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:05:00.076662 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:   <alias name="ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74"/>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:   <serial>2860cac6-20a8-4ee7-8a18-4a6531db6b74</serial>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:00.076662 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:00.129248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.129248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.139248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.130s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:00.139671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:00.171200 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b8494698-91f8-401c-802e-f79652494742 req-329a679d-4175-4adf-9099-1c4feb98710c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:00.171200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b8494698-91f8-401c-802e-f79652494742 req-329a679d-4175-4adf-9099-1c4feb98710c service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:00.173389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b8494698-91f8-401c-802e-f79652494742 req-329a679d-4175-4adf-9099-1c4feb98710c service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:00.175099 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b8494698-91f8-401c-802e-f79652494742 req-329a679d-4175-4adf-9099-1c4feb98710c service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:00.177402 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b8494698-91f8-401c-802e-f79652494742 req-329a679d-4175-4adf-9099-1c4feb98710c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] No waiting events found dispatching network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:00.177402 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b8494698-91f8-401c-802e-f79652494742 req-329a679d-4175-4adf-9099-1c4feb98710c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:00.178574 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99931989400011 future=<Future at 0x71a75c349400 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:00.187298 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Instance destroyed successfully.
May 28 14:05:00.191292 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.738s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:00.196180 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'resources' on Instance uuid 65c247b5-acbc-474a-bb88-a2edf9ac2d0b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:00.208886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk 1073741824" returned: 0 in 0.069s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:00.210194 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:00.210582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:00.307221 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Deleted allocations for instance 033c2245-10fc-4568-a15f-3b39ee5258ae
May 28 14:05:00.327548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.117s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:00.327944 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:05:00.328810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:00.352174 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:00.370052 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Attempting to attach volume 019e3ed8-71c6-4123-999b-ae71d8d21ec5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:05:00.374093 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:05:00.374093 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:00.374093 np0000001643 nova-compute[98269]:   <alias name="ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5"/>
May 28 14:05:00.374093 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:05:00.374093 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:00.374093 np0000001643 nova-compute[98269]:   <serial>019e3ed8-71c6-4123-999b-ae71d8d21ec5</serial>
May 28 14:05:00.374093 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:00.374093 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:05:00.449716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:00.449716 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Cannot resize image /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:05:00.450016 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:05:00.450016 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Ensure instance console log exists: /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:05:00.450263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:00.450476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:00.450598 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:00.702256 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020760314',display_name='tempest-ServerRescueNegativeTestJSON-server-2020760314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020760314',id=9,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:08Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-jz911k8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:09Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=65c247b5-acbc-474a-bb88-a2edf9ac2d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:00.702513 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "address": "fa:16:3e:f1:0a:f1", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af0d2c3-2e", "ovs_interfaceid": "0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:00.703188 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:00.703464 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:00.708326 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.708678 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0af0d2c3-2e, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:00.710098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.711152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:00.715267 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.715267 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.715376 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f7fa2df-1d9a-4c04-bcf2-64e39c5d6419) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:00.715863 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.716375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:00.716770 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:00.719468 np0000001643 nova-compute[98269]: INFO os_vif [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:0a:f1,bridge_name='br-int',has_traffic_filtering=True,id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af0d2c3-2e')
May 28 14:05:00.719468 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Deleting instance files /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b_del
May 28 14:05:00.721486 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Deletion of /opt/stack/data/nova/instances/65c247b5-acbc-474a-bb88-a2edf9ac2d0b_del complete
May 28 14:05:00.791828 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977100.7907755, 854e01ef-64f4-464f-8a46-ef352e4ccf2a => ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:05:00.791988 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 for instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:05:00.796177 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully detached device vdb from instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a from the live domain config.
May 28 14:05:00.857892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5628b5ec-02d6-403b-866d-2541fe3f23f1 req-d89a1fa5-9d99-45bb-a35a-4bfb019da69d service nova] Releasing lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:00.858544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:00.858774 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:05:01.230633 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 14:05:01.233146 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:05:01.233832 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:05:01.233832 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:05:01.234086 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:01.323257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6df669e-3e5f-4b58-bde0-d202300d72f3 tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "033c2245-10fc-4568-a15f-3b39ee5258ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.452s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:01.339490 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:01.355975 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Detected multiple connections on this host for volume: 2860cac6-20a8-4ee7-8a18-4a6531db6b74, skipping target disconnect.
May 28 14:05:01.456138 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00048128299999916635 future=<Future at 0x71a75c216240 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:01.456259 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:01.456404 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.1114051839999775 future=<Future at 0x71a75c29bd10 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:01.456535 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.111270604999845 future=<Future at 0x71a75c29bd10 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:01.456922 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Emitting event <LifecycleEvent: 1779977086.4554222, 8937adb3-1191-477e-a01d-76d29db6b224 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:01.457101 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] VM Stopped (Lifecycle Event)
May 28 14:05:01.498296 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:05:01.792980 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:01.951644 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'flavor' on Instance uuid 854e01ef-64f4-464f-8a46-ef352e4ccf2a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:01.965281 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updating instance_info_cache with network_info: [{"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:01.969246 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8937adb3-1191-477e-a01d-76d29db6b224] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:02.070525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:02.070708 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:02.070813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:02.070868 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No VIF found with MAC fa:16:3e:16:30:44, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:02.125561 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:02.125805 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:02.125989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:02.126157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:02.126307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:02.128104 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Terminating instance
May 28 14:05:02.234513 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:02.234930 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] Acquiring lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:02.238079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:02.238254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:02.238608 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] No waiting events found dispatching network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:02.238866 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-unplugged-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:02.239050 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Received event network-vif-deleted-0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:02.239255 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Neutron deleted interface 0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1; detaching it from the instance and deleting it from the info cache
May 28 14:05:02.241189 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55b6bc8a-c744-4c70-b601-8289e1d1f8e0 req-70440e48-7e35-4e3d-aea5-354107a2368c service nova] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Detach interface failed, port_id=0af0d2c3-2eed-41b8-a5a5-46b4c75abbe1, reason: Instance 65c247b5-acbc-474a-bb88-a2edf9ac2d0b could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:05:02.272152 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:02.472874 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:02.473560 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Instance network_info: |[{"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:05:02.475539 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Start _get_guest_xml network_info=[{"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:05:02.477939 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:02.479235 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='cfa684f7-1fb1-4e0f-bf60-3c42614b2670'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977102.4788177) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:05:02.480311 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:05:02.480835 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:05:02.481643 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:05:02.481857 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:05:02.482854 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:05:02.483225 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:05:02.483428 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:05:02.483600 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:05:02.483758 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:05:02.483861 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:05:02.483964 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:05:02.484133 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:05:02.484229 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:05:02.484341 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:05:02.484440 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:05:02.484591 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:05:02.498588 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=24,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-is2gkfif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=cfa684f7-1fb1-4e0f-bf60-3c42614b2670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:05:02.498891 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:02.500119 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f3:b8,bridge_name='br-int',has_traffic_filtering=True,id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f757d6-e1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:02.500119 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'pci_devices' on Instance uuid cfa684f7-1fb1-4e0f-bf60-3c42614b2670 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:02.631286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:05:02.668654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:02.670368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:02.692686 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:02.719615 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:02.776352 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Took 1.54 seconds to deallocate network for instance.
May 28 14:05:02.957960 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1fe0a888-dd34-433e-bd56-7bf51096d553 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.546s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:02.981198 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:02.990964 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.003749 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] End _get_guest_xml xml=<domain type="qemu">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <uuid>cfa684f7-1fb1-4e0f-bf60-3c42614b2670</uuid>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <name>instance-00000018</name>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:name>multiattach-server-0</nova:name>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:05:02</nova:creationTime>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         <nova:port uuid="c7f757d6-e1c6-43c4-be67-443fe29dcb8a">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <system>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <entry name="serial">cfa684f7-1fb1-4e0f-bf60-3c42614b2670</entry>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <entry name="uuid">cfa684f7-1fb1-4e0f-bf60-3c42614b2670</entry>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </system>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <os>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   </os>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <features>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   </features>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   <devices>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk.config"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:cc:f3:b8"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <target dev="tapc7f757d6-e1"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </interface>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/console.log" append="off"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </serial>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <video>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </video>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </rng>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:   </devices>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]: </domain>
May 28 14:05:03.003749 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:05:03.005702 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Preparing to wait for external event network-vif-plugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:05:03.005702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:03.005702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:03.005702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:03.005702 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=24,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-is2gkfif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:04:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=cfa684f7-1fb1-4e0f-bf60-3c42614b2670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:05:03.005702 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:03.007031 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f3:b8,bridge_name='br-int',has_traffic_filtering=True,id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f757d6-e1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:03.007031 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f3:b8,bridge_name='br-int',has_traffic_filtering=True,id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f757d6-e1') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:05:03.007436 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.007650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:03.007867 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:05:03.010641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.010883 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ecbc1fc-e54e-5f66-bb41-b2808e185625', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:03.013607 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.014367 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999589932999925 future=<Future at 0x71a75c4e8ce0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:03.016778 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:03.020727 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Instance destroyed successfully.
May 28 14:05:03.021186 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lazy-loading 'resources' on Instance uuid 150a83f0-0070-4df3-ab14-6aa1c028be82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:03.022016 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.023205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7f757d6-e1, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:03.023205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7f757d6-e1, col_values=(('qos', UUID('f668bd54-39e3-4387-aa27-321bd09b1443')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:03.023205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7f757d6-e1, col_values=(('external_ids', {'iface-id': 'c7f757d6-e1c6-43c4-be67-443fe29dcb8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f3:b8', 'vm-uuid': 'cfa684f7-1fb1-4e0f-bf60-3c42614b2670'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:03.028950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.030149 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:03.040368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.040610 np0000001643 nova-compute[98269]: INFO os_vif [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f3:b8,bridge_name='br-int',has_traffic_filtering=True,id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f757d6-e1')
May 28 14:05:03.285468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:03.285928 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:03.527813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1503665945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverbootfromvolumestablerescuetest-server-1503665945',id=7,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:01:58Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b74df57519ea42009fcebcff7cfdf94e',ramdisk_id='',reservation_id='r-626j2y02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-241739491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:07Z,user_data=None,user_id='86dc22a5d6a7478dab81969f17d3daab',uuid=150a83f0-0070-4df3-ab14-6aa1c028be82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:03.527813 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converting VIF {"id": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "address": "fa:16:3e:fc:c7:d3", "network": {"id": "560f70fe-c6b5-4744-821e-7def4f85af0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1346510674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b74df57519ea42009fcebcff7cfdf94e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f7408f-0d", "ovs_interfaceid": "25f7408f-0d21-494a-8cf0-b5a78aea3fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:03.533112 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:d3,bridge_name='br-int',has_traffic_filtering=True,id=25f7408f-0d21-494a-8cf0-b5a78aea3fd7,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f7408f-0d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:03.533304 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:d3,bridge_name='br-int',has_traffic_filtering=True,id=25f7408f-0d21-494a-8cf0-b5a78aea3fd7,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f7408f-0d') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:03.535750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.535750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25f7408f-0d, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:03.536843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:03.544521 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.546135 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.546494 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d291e66-5d0b-48aa-ade6-145d708b8175) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:03.547811 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.551989 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:03.556666 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:03.559786 np0000001643 nova-compute[98269]: INFO os_vif [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:d3,bridge_name='br-int',has_traffic_filtering=True,id=25f7408f-0d21-494a-8cf0-b5a78aea3fd7,network=Network(560f70fe-c6b5-4744-821e-7def4f85af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f7408f-0d')
May 28 14:05:03.560114 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Deleting instance files /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82_del
May 28 14:05:03.562392 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Deletion of /opt/stack/data/nova/instances/150a83f0-0070-4df3-ab14-6aa1c028be82_del complete
May 28 14:05:03.629605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c313be1-4a85-4730-ad6a-976647d42327 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.609s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:03.769470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:03.769675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:03.900387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:03.900532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:03.987018 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:03.987351 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:04.069986 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 14:05:04.072507 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:05:04.074870 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:05:04.074870 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:05:04.074870 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:04.149478 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:04.156497 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:04.156768 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:04.271966 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:05:04.333730 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-vif-unplugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:04.334323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:04.335384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:04.335846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:04.336024 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] No waiting events found dispatching network-vif-unplugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:04.336168 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-vif-unplugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:04.336353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-vif-unplugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:04.336590 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] Acquiring lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:04.336799 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:04.336948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:04.337100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] No waiting events found dispatching network-vif-unplugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:04.337316 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4b6cc177-bda1-49f9-a262-164556a39fbc req-fbc0386a-d5d0-4381-9e1c-129a685999be service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-vif-unplugged-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:04.363643 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:04.403027 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Detaching volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74
May 28 14:05:04.470064 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Attempting to driver detach volume 2860cac6-20a8-4ee7-8a18-4a6531db6b74 from mountpoint /dev/vdb
May 28 14:05:04.479754 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Found disk vdb by alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:04.481434 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Found disk vdb by alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:04.481705 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Attempting to detach device vdb from instance 7c6f49c3-6903-4440-987d-dc99e23240bf from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:05:04.482041 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:   <alias name="ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74"/>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:   <serial>2860cac6-20a8-4ee7-8a18-4a6531db6b74</serial>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:04.482041 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:04.495013 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:04.504529 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully detached device vdb from instance 7c6f49c3-6903-4440-987d-dc99e23240bf from the persistent domain config.
May 28 14:05:04.504750 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] (1/8): Attempting to detach device vdb with device alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 from instance 7c6f49c3-6903-4440-987d-dc99e23240bf from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:05:04.505108 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:   <alias name="ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74"/>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:   <serial>2860cac6-20a8-4ee7-8a18-4a6531db6b74</serial>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:04.505108 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:04.564885 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:04.565122 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:04.565371 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:cc:f3:b8, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:04.566020 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Using config drive
May 28 14:05:04.570233 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.002228540000032808 future=<Future at 0x71a75c29bd10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:04.571031 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Emitting event <LifecycleEvent: 1779977089.567736, 4dc73d91-4d87-4283-9a77-607c0e512265 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:04.571592 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:04.572511 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] VM Stopped (Lifecycle Event)
May 28 14:05:04.573211 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.150154980000025 future=<Future at 0x71a75c2145f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:04.573416 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.149892004000094 future=<Future at 0x71a75c2145f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:04.659591 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Detaching volume 019e3ed8-71c6-4123-999b-ae71d8d21ec5
May 28 14:05:04.713880 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Attempting to driver detach volume 019e3ed8-71c6-4123-999b-ae71d8d21ec5 from mountpoint /dev/vdb
May 28 14:05:04.720233 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found disk vdb by alias ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:04.726138 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found disk vdb by alias ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:04.726138 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Attempting to detach device vdb from instance bb01a4a8-04ac-459a-8994-4f6da360c381 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:05:04.726138 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:04.726138 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:04.726138 np0000001643 nova-compute[98269]:   <alias name="ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5"/>
May 28 14:05:04.726138 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:05:04.726138 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:04.726138 np0000001643 nova-compute[98269]:   <serial>019e3ed8-71c6-4123-999b-ae71d8d21ec5</serial>
May 28 14:05:04.726138 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:04.726138 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:04.726138 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:04.732834 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully detached device vdb from instance bb01a4a8-04ac-459a-8994-4f6da360c381 from the persistent domain config.
May 28 14:05:04.733048 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] (1/8): Attempting to detach device vdb with device alias ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5 from instance bb01a4a8-04ac-459a-8994-4f6da360c381 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:05:04.733386 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:04.733386 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:04.733386 np0000001643 nova-compute[98269]:   <alias name="ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5"/>
May 28 14:05:04.733386 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:05:04.733386 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:04.733386 np0000001643 nova-compute[98269]:   <serial>019e3ed8-71c6-4123-999b-ae71d8d21ec5</serial>
May 28 14:05:04.733386 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:04.733386 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:04.733386 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:04.824896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:05.001848 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.716s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:05.002917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.177s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:05.010669 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:05:05.010669 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Claim successful on node np0000001643
May 28 14:05:05.044905 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:05.072286 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:05.076744 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 4dc73d91-4d87-4283-9a77-607c0e512265] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:05.081483 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Deleted allocations for instance 65c247b5-acbc-474a-bb88-a2edf9ac2d0b
May 28 14:05:05.245267 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Creating config drive at /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk.config
May 28 14:05:05.250143 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpapvk7ygq {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:05.306551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpapvk7ygq" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:05.352358 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977105.3518498, bb01a4a8-04ac-459a-8994-4f6da360c381 => ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:05:05.355008 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-019e3ed8-71c6-4123-999b-ae71d8d21ec5 for instance bb01a4a8-04ac-459a-8994-4f6da360c381 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:05:05.358250 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully detached device vdb from instance bb01a4a8-04ac-459a-8994-4f6da360c381 from the live domain config.
May 28 14:05:05.359405 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:05:05.359982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:05.360183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:05.360788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:05.361163 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '019e3ed8-71c6-4123-999b-ae71d8d21ec5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:05:05.361351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:05:05.389364 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5 (non-flash)
May 28 14:05:05.389821 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:05.390116 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', '42')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:05:05.390116 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', '41')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:05:05.391152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5', '42')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:05:05.392134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c300ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:05:05.392404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:05:05.392875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flush multipath device 330000000a979e371 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:05:05.431182 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:05:05.479134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:05:05.537587 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:05:05.538020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:05:05.539802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:05:05.550169 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Took 1.48 seconds to deallocate network for instance.
May 28 14:05:05.556063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:05:05.558048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:05:05.574075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:05.618599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.40.100,3260]
May 28 14:05:05.618599 np0000001643 nova-compute[98269]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.40.100,3260] successful.
May 28 14:05:05.618599 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:05.639790 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:05.655036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:05.688630 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.50.100,3260]
May 28 14:05:05.688630 np0000001643 nova-compute[98269]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-019e3ed8-71c6-4123-999b-ae71d8d21ec5, portal: 192.168.50.100,3260] successful.
May 28 14:05:05.688630 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:05.717814 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:05.718151 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:05.718299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== disconnect_volume: return (358ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:05.718415 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:05:05.866773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:05.899777 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:05.902087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:06.009820 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:06.058359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:06.074431 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:06.075558 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:06.094600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd52-7b75-4b36-a4af-cf47da96c9e8 tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "65c247b5-acbc-474a-bb88-a2edf9ac2d0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.824s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:06.287511 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid bb01a4a8-04ac-459a-8994-4f6da360c381 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:06.449074 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Received event network-vif-deleted-25f7408f-0d21-494a-8cf0-b5a78aea3fd7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:06.449808 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-vif-plugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:06.449808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:06.452182 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Processing event network-vif-plugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-vif-plugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] No waiting events found dispatching network-vif-plugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:06.455353 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-3f5a0c13-673e-43a2-b7e3-8341289bf806 req-d1dd59b9-eabf-4ef2-89ea-fba6ff53c353 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received unexpected event network-vif-plugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a for instance with vm_state building and task_state spawning.
May 28 14:05:06.803430 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:06.803711 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:06.953374 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977106.9529314, cfa684f7-1fb1-4e0f-bf60-3c42614b2670 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:06.953676 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] VM Started (Lifecycle Event)
May 28 14:05:06.955148 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:05:06.958953 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:05:06.964090 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Instance spawned successfully.
May 28 14:05:06.964652 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:05:06.980239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:06.980239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:06.980239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:06.980239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:06.980239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:06.983004 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Terminating instance
May 28 14:05:07.125479 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74 for instance 7c6f49c3-6903-4440-987d-dc99e23240bf {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:05:07.298171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ed1e450-61c9-41e4-b180-ee88ce3d595f tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.141s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:07.307087 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:07.456986 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:07.459049 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:07.475476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:07.475932 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:07.476292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:07.476655 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:07.477111 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:07.477497 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:07.487941 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:05:07.507885 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:07.508100 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:07.508690 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:07.508782 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:07.509555 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:07.511679 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Terminating instance
May 28 14:05:07.517316 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:07.522507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:07.551069 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:07.579572 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:07.770210 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9c209d5-1892-405e-a140-21c62b325052 req-4c7d0a66-dd18-41d6-8363-6001eb3bc32d service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:07.773058 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9c209d5-1892-405e-a140-21c62b325052 req-4c7d0a66-dd18-41d6-8363-6001eb3bc32d service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:07.773353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9c209d5-1892-405e-a140-21c62b325052 req-4c7d0a66-dd18-41d6-8363-6001eb3bc32d service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:07.776777 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9c209d5-1892-405e-a140-21c62b325052 req-4c7d0a66-dd18-41d6-8363-6001eb3bc32d service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:07.776962 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9c209d5-1892-405e-a140-21c62b325052 req-4c7d0a66-dd18-41d6-8363-6001eb3bc32d service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:07.777254 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9c209d5-1892-405e-a140-21c62b325052 req-4c7d0a66-dd18-41d6-8363-6001eb3bc32d service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:07.816311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.813s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:07.816311 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:05:07.819434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.761s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:07.880407 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Instance destroyed successfully.
May 28 14:05:07.880863 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lazy-loading 'resources' on Instance uuid fb9d4d3f-f068-49a2-ba11-114989ee8d9e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:07.962370 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:05:07.963283 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977107.9630477, cfa684f7-1fb1-4e0f-bf60-3c42614b2670 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:07.963422 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] VM Paused (Lifecycle Event)
May 28 14:05:07.986587 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Took 8.13 seconds to spawn the instance on the hypervisor.
May 28 14:05:07.986587 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:08.018914 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:05:08.051849 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.062120 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.093486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.111871 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.142495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.327147 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:05:08.327325 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:05:08.328343 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:08.328843 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:08.384362 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020791412',display_name='tempest-ServerRescueNegativeTestJSON-server-2020791412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverrescuenegativetestjson-server-2020791412',id=8,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:02:24Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfe2941b78c4f2e9f16f60e05ec5dcc',ramdisk_id='',reservation_id='r-7ieaqe8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1154493123',owner_user_name='tempest-ServerRescueNegativeTestJSON-1154493123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:02:30Z,user_data=None,user_id='3deb2050ffd5441bb38c08eb82707d7d',uuid=fb9d4d3f-f068-49a2-ba11-114989ee8d9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:08.384683 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converting VIF {"id": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "address": "fa:16:3e:eb:f8:2e", "network": {"id": "80c3d491-ae78-4109-afec-946c0df3bf83", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-958987073-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9bfe2941b78c4f2e9f16f60e05ec5dcc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape57ade8b-a1", "ovs_interfaceid": "e57ade8b-a180-4fd2-9951-a99aec03b52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:08.385570 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:08.385940 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:08.388674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.389080 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape57ade8b-a1, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:08.390233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.391185 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:08.396765 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Instance destroyed successfully.
May 28 14:05:08.398519 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'resources' on Instance uuid bb01a4a8-04ac-459a-8994-4f6da360c381 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:08.399596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.402769 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.403136 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6398fbf7-71b6-4012-8df6-8944a5f64f65) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:08.406509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:08.413936 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.417302 np0000001643 nova-compute[98269]: INFO os_vif [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f8:2e,bridge_name='br-int',has_traffic_filtering=True,id=e57ade8b-a180-4fd2-9951-a99aec03b52c,network=Network(80c3d491-ae78-4109-afec-946c0df3bf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57ade8b-a1')
May 28 14:05:08.417663 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Deleting instance files /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e_del
May 28 14:05:08.418416 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Deletion of /opt/stack/data/nova/instances/fb9d4d3f-f068-49a2-ba11-114989ee8d9e_del complete
May 28 14:05:08.456987 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '357253ac91f34daeb60ae1dfd3e4a86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a74849f3fb24097a5a42457746f02d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:05:08.469375 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:08.474379 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977108.4740286, cfa684f7-1fb1-4e0f-bf60-3c42614b2670 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:08.474600 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] VM Resumed (Lifecycle Event)
May 28 14:05:08.507016 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Took 14.18 seconds to build instance.
May 28 14:05:08.539929 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1a5ca06f-f478-4490-815b-e6b699b56acd req-8fb83cfe-b62e-45c0-8c2e-c77cf3c6c4c9 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-vif-unplugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:08.540706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1a5ca06f-f478-4490-815b-e6b699b56acd req-8fb83cfe-b62e-45c0-8c2e-c77cf3c6c4c9 service nova] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:08.540943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1a5ca06f-f478-4490-815b-e6b699b56acd req-8fb83cfe-b62e-45c0-8c2e-c77cf3c6c4c9 service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:08.541093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1a5ca06f-f478-4490-815b-e6b699b56acd req-8fb83cfe-b62e-45c0-8c2e-c77cf3c6c4c9 service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:08.541898 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1a5ca06f-f478-4490-815b-e6b699b56acd req-8fb83cfe-b62e-45c0-8c2e-c77cf3c6c4c9 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] No waiting events found dispatching network-vif-unplugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:08.543030 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1a5ca06f-f478-4490-815b-e6b699b56acd req-8fb83cfe-b62e-45c0-8c2e-c77cf3c6c4c9 service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-vif-unplugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:08.624487 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:08.624880 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:08.724289 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0008653279999180086 future=<Future at 0x71a75c2145f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:08.725080 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] Emitting event <LifecycleEvent: 1779977093.7232165, 033c2245-10fc-4568-a15f-3b39ee5258ae => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:08.725218 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:08.725423 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] VM Stopped (Lifecycle Event)
May 28 14:05:08.726497 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.451371125000151 future=<Future at 0x71a75c349400 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:08.726634 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.451205669000046 future=<Future at 0x71a75c349400 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:08.834497 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:05:08.907674 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273714186',display_name='tempest-AttachVolumeNegativeTest-server-273714186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-273714186',id=20,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjQXAZqnbqc11ZlId/bMF3BqtKngTJu9gV4RR9MI8IV3A8jPUc4U9rMVmPDrbgKLcQBvTBzPJi+rW7Ie68yuF1DXOQiWiNG3YRfOdcZ3j1s/a5nOwLccP9yxYkBBxcPtg==',key_name='tempest-keypair-1896788631',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:04:12Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-90zrt082',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:04:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=bb01a4a8-04ac-459a-8994-4f6da360c381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:08.907938 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "address": "fa:16:3e:16:30:44", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap399f6d10-d0", "ovs_interfaceid": "399f6d10-d05d-458c-b840-0a3f8d294ea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:08.908483 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:30:44,bridge_name='br-int',has_traffic_filtering=True,id=399f6d10-d05d-458c-b840-0a3f8d294ea3,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f6d10-d0') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:08.908814 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:30:44,bridge_name='br-int',has_traffic_filtering=True,id=399f6d10-d05d-458c-b840-0a3f8d294ea3,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f6d10-d0') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:08.909814 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.910040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap399f6d10-d0, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:08.911696 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.912467 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:08.913963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.915155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.915525 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8104e638-6abe-4330-bb3f-19f73c109f2e) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:08.916267 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.917387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:08.917387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:08.920951 np0000001643 nova-compute[98269]: INFO os_vif [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:30:44,bridge_name='br-int',has_traffic_filtering=True,id=399f6d10-d05d-458c-b840-0a3f8d294ea3,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399f6d10-d0')
May 28 14:05:08.921068 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Deleting instance files /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381_del
May 28 14:05:08.923001 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Deletion of /opt/stack/data/nova/instances/bb01a4a8-04ac-459a-8994-4f6da360c381_del complete
May 28 14:05:08.927865 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 14:05:08.928271 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:05:08.928593 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:05:08.928800 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:05:08.929020 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:08.980648 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:08.983405 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:09.008157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-240697ed-17cc-442c-9af1-e9d65c2d7098 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.700s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:09.042895 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:09.113562 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Successfully created port: 61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:05:09.128165 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:09.228231 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 033c2245-10fc-4568-a15f-3b39ee5258ae] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:09.336891 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:05:09.367483 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:09.430738 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 14:05:09.432142 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:05:09.433548 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:05:09.433757 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:05:09.435509 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:09.489967 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977109.4895809, 7c6f49c3-6903-4440-987d-dc99e23240bf => ua-2860cac6-20a8-4ee7-8a18-4a6531db6b74> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:05:09.490421 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999851445999866 future=<Future at 0x71a75c7916a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:09.490988 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999856874999978 future=<Future at 0x71a75c776f00 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:09.493180 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully detached device vdb from instance 7c6f49c3-6903-4440-987d-dc99e23240bf from the live domain config.
May 28 14:05:09.546138 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:05:09.546407 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:09.546571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:09.546885 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:09.547181 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2860cac6-20a8-4ee7-8a18-4a6531db6b74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:05:09.547340 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:05:09.577693 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:09.581147 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:09.581147 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:09.581147 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:09.581147 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:09.581147 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:09.581147 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:09.581147 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:09.581425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:09.581425 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:09.581425 np0000001643 nova-compute[98269]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:09.581425 np0000001643 nova-compute[98269]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74 (non-flash)
May 28 14:05:09.581425 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:09.581425 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:09.581425 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:09.581425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '40')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:05:09.581688 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '37')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:05:09.582437 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74', '38')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:05:09.583167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780148ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:05:09.583388 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:05:09.585550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Flush multipath device 3300000000a27e1e3 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:05:09.610174 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:05:09.635762 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.817s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:09.654040 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:05:09.702531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:05:09.702739 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:05:09.704130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:05:09.717418 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Deleted allocations for instance 150a83f0-0070-4df3-ab14-6aa1c028be82
May 28 14:05:09.720526 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:05:09.720986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:05:09.735012 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:09.772129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.40.100,3260]
May 28 14:05:09.772129 np0000001643 nova-compute[98269]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.40.100,3260] successful.
May 28 14:05:09.772129 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:09.793514 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:09.811245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:09.848725 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Successfully updated port: 61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:05:09.851001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.50.100,3260]
May 28 14:05:09.851001 np0000001643 nova-compute[98269]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-2860cac6-20a8-4ee7-8a18-4a6531db6b74, portal: 192.168.50.100,3260] successful.
May 28 14:05:09.851001 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:09.871756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:09.874400 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:09.875366 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] <== disconnect_volume: return (328ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:09.875366 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:05:09.884944 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7b85e586-90fa-43af-8ee8-ae7ba88df9b1 req-16c6e9c0-52b5-4649-b8da-9c3f5bdfa971 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:09.885141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7b85e586-90fa-43af-8ee8-ae7ba88df9b1 req-16c6e9c0-52b5-4649-b8da-9c3f5bdfa971 service nova] Acquiring lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:09.885227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7b85e586-90fa-43af-8ee8-ae7ba88df9b1 req-16c6e9c0-52b5-4649-b8da-9c3f5bdfa971 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:09.885646 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7b85e586-90fa-43af-8ee8-ae7ba88df9b1 req-16c6e9c0-52b5-4649-b8da-9c3f5bdfa971 service nova] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:09.886193 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7b85e586-90fa-43af-8ee8-ae7ba88df9b1 req-16c6e9c0-52b5-4649-b8da-9c3f5bdfa971 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] No waiting events found dispatching network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:09.886364 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7b85e586-90fa-43af-8ee8-ae7ba88df9b1 req-16c6e9c0-52b5-4649-b8da-9c3f5bdfa971 service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-unplugged-e57ade8b-a180-4fd2-9951-a99aec03b52c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:09.899736 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:10.347143 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:05:10.352810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:05:10.353986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:10.355087 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Creating image(s)
May 28 14:05:10.361684 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquired lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:10.361684 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-changed-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:10.361684 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Refreshing instance network info cache due to event network-changed-c7f757d6-e1c6-43c4-be67-443fe29dcb8a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:10.361855 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:05:10.362672 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] Acquiring lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:10.362869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] Acquired lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:10.362987 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Refreshing network info cache for port c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:10.366055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:10.366752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.007s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:10.367624 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:10.368396 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:10.371575 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:10.374773 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:10.407475 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Took 1.48 seconds to deallocate network for instance.
May 28 14:05:10.474225 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'flavor' on Instance uuid 7c6f49c3-6903-4440-987d-dc99e23240bf {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:10.504652 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.130s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:10.505544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:10.506131 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:10.507245 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:10.510783 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:10.511215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:10.600462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:10.601166 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:10.640508 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:10.645824 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-vif-unplugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:10.647018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] Acquiring lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:10.647874 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:10.648104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:10.648259 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] No waiting events found dispatching network-vif-unplugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:10.648421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-vif-unplugged-399f6d10-d05d-458c-b840-0a3f8d294ea3 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:10.648500 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Received event network-vif-deleted-e57ade8b-a180-4fd2-9951-a99aec03b52c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:10.648759 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Received event network-vif-deleted-399f6d10-d05d-458c-b840-0a3f8d294ea3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:10.649135 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Neutron deleted interface 399f6d10-d05d-458c-b840-0a3f8d294ea3; detaching it from the instance and deleting it from the info cache
May 28 14:05:10.651786 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37d8b384-517a-4d6b-853d-68ca20f16885 req-5c925d13-fc9c-43a1-b039-f9c6c2b2410f service nova] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Detach interface failed, port_id=399f6d10-d05d-458c-b840-0a3f8d294ea3, reason: Instance bb01a4a8-04ac-459a-8994-4f6da360c381 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:05:10.668516 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk 1073741824" returned: 0 in 0.067s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:10.668843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:10.669171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:10.729687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-88cf2b75-d758-44a1-b1df-9efe81b5f51d tempest-ServerBootFromVolumeStableRescueTest-241739491 tempest-ServerBootFromVolumeStableRescueTest-241739491-project-member] Lock "150a83f0-0070-4df3-ab14-6aa1c028be82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.604s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:10.766149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:10.766966 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:05:10.767289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:10.863144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:10.863766 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Cannot resize image /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:05:10.864206 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:05:10.864684 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Ensure instance console log exists: /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:05:10.864925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:10.865172 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:10.865333 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:10.875264 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:10.916496 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:10.916496 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:10.987981 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:05:11.150683 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Took 1.72 seconds to deallocate network for instance.
May 28 14:05:11.202809 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:11.385286 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:11.437926 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updating instance_info_cache with network_info: [{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:11.483218 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4053e8d6-8396-4928-99a7-3dd0d4671fe6 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.583s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:11.614946 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updated VIF entry in instance network info cache for port c7f757d6-e1c6-43c4-be67-443fe29dcb8a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:05:11.615306 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updating instance_info_cache with network_info: [{"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:11.658816 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:11.660755 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:11.661031 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:11.857907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:11.858073 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:11.940631 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Releasing lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:11.941136 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance network_info: |[{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:05:11.942774 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Start _get_guest_xml network_info=[{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:05:11.945040 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:11.946393 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-1187018804', uuid='b8315b4c-90be-498b-bdc8-1a775a1480bc'), owner=OwnerMeta(userid='357253ac91f34daeb60ae1dfd3e4a86f', username='tempest-ServerActionsTestOtherA-354716614-project-member', projectid='6a74849f3fb24097a5a42457746f02d2', projectname='tempest-ServerActionsTestOtherA-354716614'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977111.9460294) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:05:11.947405 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:05:11.948299 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:05:11.948647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:05:11.948803 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:05:11.949841 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:05:11.950110 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:05:11.950253 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:05:11.950361 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:05:11.950539 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:05:11.950656 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:05:11.950803 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:05:11.951025 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:05:11.951179 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:05:11.951338 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:05:11.951540 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:05:11.951766 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:05:11.965166 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-changed-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:11.965538 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Refreshing instance network info cache due to event network-changed-61ba7305-7cba-43a7-933f-1bb3fb5e7377. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:11.965769 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] Acquiring lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:11.965898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] Acquired lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:11.966064 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Refreshing network info cache for port 61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:11.968749 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1187018804',display_name='tempest-tempest.common.compute-instance-1187018804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-tempest-common-compute-instance-1187018804',id=25,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjudjxGx9MLYUVvFGlZfcC71jfy/sR8oZUcTCdliwi/R7kQu6rBd56Xf/TSYh/iBZLjjnI4has/s0nB3GdSPd4bXfjOiBefr+Yd6Vvfl1uwmkrcaxbNjs9Ha5YmPEohA==',key_name='tempest-keypair-1270102767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-04k7gxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=b8315b4c-90be-498b-bdc8-1a775a1480bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:05:11.968955 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:11.969675 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:11.970442 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'pci_devices' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:12.118970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c5cba277-65c9-415f-93f9-b0bdbe4a04c5 req-323638b8-d0d9-4809-8526-aa105fd5b4de service nova] Releasing lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:12.165111 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:12.363003 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:05:12.471532 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:12.479442 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] End _get_guest_xml xml=<domain type="qemu">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <uuid>b8315b4c-90be-498b-bdc8-1a775a1480bc</uuid>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <name>instance-00000019</name>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:name>tempest-tempest.common.compute-instance-1187018804</nova:name>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:05:11</nova:creationTime>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:user uuid="357253ac91f34daeb60ae1dfd3e4a86f">tempest-ServerActionsTestOtherA-354716614-project-member</nova:user>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:project uuid="6a74849f3fb24097a5a42457746f02d2">tempest-ServerActionsTestOtherA-354716614</nova:project>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         <nova:port uuid="61ba7305-7cba-43a7-933f-1bb3fb5e7377">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <system>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <entry name="serial">b8315b4c-90be-498b-bdc8-1a775a1480bc</entry>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <entry name="uuid">b8315b4c-90be-498b-bdc8-1a775a1480bc</entry>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </system>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <os>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   </os>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <features>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   </features>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   <devices>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ab:25:f1"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <target dev="tap61ba7305-7c"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </interface>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/console.log" append="off"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </serial>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <video>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </video>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </rng>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:   </devices>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]: </domain>
May 28 14:05:12.479442 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Preparing to wait for external event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1187018804',display_name='tempest-tempest.common.compute-instance-1187018804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-tempest-common-compute-instance-1187018804',id=25,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjudjxGx9MLYUVvFGlZfcC71jfy/sR8oZUcTCdliwi/R7kQu6rBd56Xf/TSYh/iBZLjjnI4has/s0nB3GdSPd4bXfjOiBefr+Yd6Vvfl1uwmkrcaxbNjs9Ha5YmPEohA==',key_name='tempest-keypair-1270102767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-04k7gxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=b8315b4c-90be-498b-bdc8-1a775a1480bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:05:12.482087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:12.482596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:12.482887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:05:12.486463 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:12.486528 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '350ba440-cdd3-5048-bd6f-1440f9ede4c7', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:12.487605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:12.488297 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:12.488820 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:12.492831 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:12.492953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61ba7305-7c, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:12.493263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61ba7305-7c, col_values=(('qos', UUID('6d245ef3-d7cf-420d-8c94-c2ab6b61362d')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:12.493439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61ba7305-7c, col_values=(('external_ids', {'iface-id': '61ba7305-7cba-43a7-933f-1bb3fb5e7377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:25:f1', 'vm-uuid': 'b8315b4c-90be-498b-bdc8-1a775a1480bc'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:12.494710 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:12.495739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:12.503518 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:12.504625 np0000001643 nova-compute[98269]: INFO os_vif [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c')
May 28 14:05:12.507342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:12.507436 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:12.509469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:12.509469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:12.509469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:12.510721 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Terminating instance
May 28 14:05:12.614965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:12.614965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:12.614965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:12.614965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:12.614965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:12.617397 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Terminating instance
May 28 14:05:12.673861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.758s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:12.676901 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.016s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:12.768063 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Deleted allocations for instance fb9d4d3f-f068-49a2-ba11-114989ee8d9e
May 28 14:05:12.961040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:12.973971 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:13.020095 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:05:13.066222 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.070220 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.096912 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.122375 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:05:13.174940 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.178710 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.207816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.279437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.282817 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updated VIF entry in instance network info cache for port 61ba7305-7cba-43a7-933f-1bb3fb5e7377. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:05:13.283686 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updating instance_info_cache with network_info: [{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:13.301604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.333713 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.356909 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.501271 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:13.501531 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:13.512813 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.534920 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:13.555510 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999670773000162 future=<Future at 0x71a7802d38f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:13.566320 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Instance destroyed successfully.
May 28 14:05:13.568149 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'resources' on Instance uuid 854e01ef-64f4-464f-8a46-ef352e4ccf2a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:13.572395 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999665232000098 future=<Future at 0x71a7802d3140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:13.581083 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Instance destroyed successfully.
May 28 14:05:13.582436 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lazy-loading 'resources' on Instance uuid 7c6f49c3-6903-4440-987d-dc99e23240bf {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:13.788910 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4511a88b-d268-467d-b19d-aa6b7dc8cf42 req-70b8e957-c397-4b70-95ae-bf4b06941548 service nova] Releasing lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:13.790168 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26c8c5bf-ae46-4ec7-a549-ef62bf5abb0c tempest-ServerRescueNegativeTestJSON-1154493123 tempest-ServerRescueNegativeTestJSON-1154493123-project-member] Lock "fb9d4d3f-f068-49a2-ba11-114989ee8d9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.810s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:14.009550 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:14.033144 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:14.033144 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:14.033552 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No VIF found with MAC fa:16:3e:ab:25:f1, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:14.033995 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Using config drive
May 28 14:05:14.074393 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-952631114-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testmultiattachvolumeswap-server-952631114-1',id=17,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymOBRdK4BTpFgE86zLGQ/ieEXGqO4hU/tjuUDx5k3Ub5SCTnNZeFqJRhsAdh6olRD8+ep0TkCvA93/y/m0ISZOrKT2ZNkp5UiBCf++59eYCxpLfaERm0W9KLDWT/8UNg==',key_name='tempest-keypair-2006327443',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc79c5d191d54ea188016726111808fd',ramdisk_id='',reservation_id='r-r51iwbsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1324034633',owner_user_name='tempest-TestMultiAttachVolumeSwap-1324034633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331414b567e44229ba16f8d95b6133ed',uuid=854e01ef-64f4-464f-8a46-ef352e4ccf2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:14.074671 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converting VIF {"id": "216c46d3-e616-44df-a61a-5882b0ce26ec", "address": "fa:16:3e:b2:5c:60", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap216c46d3-e6", "ovs_interfaceid": "216c46d3-e616-44df-a61a-5882b0ce26ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:14.075973 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=216c46d3-e616-44df-a61a-5882b0ce26ec,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216c46d3-e6') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:14.076433 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=216c46d3-e616-44df-a61a-5882b0ce26ec,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216c46d3-e6') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:14.082704 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.082970 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap216c46d3-e6, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:14.086590 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:14.088483 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-952631114-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testmultiattachvolumeswap-server-952631114-2',id=18,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymOBRdK4BTpFgE86zLGQ/ieEXGqO4hU/tjuUDx5k3Ub5SCTnNZeFqJRhsAdh6olRD8+ep0TkCvA93/y/m0ISZOrKT2ZNkp5UiBCf++59eYCxpLfaERm0W9KLDWT/8UNg==',key_name='tempest-keypair-2006327443',keypairs=<?>,launch_index=1,launched_at=2026-05-28T14:03:55Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc79c5d191d54ea188016726111808fd',ramdisk_id='',reservation_id='r-r51iwbsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1324034633',owner_user_name='tempest-TestMultiAttachVolumeSwap-1324034633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='331414b567e44229ba16f8d95b6133ed',uuid=7c6f49c3-6903-4440-987d-dc99e23240bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:14.088798 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converting VIF {"id": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "address": "fa:16:3e:42:9e:e2", "network": {"id": "7f5996df-441b-459a-8e37-1d379838be69", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-653638900-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc79c5d191d54ea188016726111808fd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap069820b4-ab", "ovs_interfaceid": "069820b4-ab96-49ca-aa7b-fdf17b731e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:14.089376 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:9e:e2,bridge_name='br-int',has_traffic_filtering=True,id=069820b4-ab96-49ca-aa7b-fdf17b731e95,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069820b4-ab') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:14.089752 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:9e:e2,bridge_name='br-int',has_traffic_filtering=True,id=069820b4-ab96-49ca-aa7b-fdf17b731e95,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069820b4-ab') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:14.097350 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.097920 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.098074 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap069820b4-ab, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:14.099687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.101275 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:14.104441 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-vif-unplugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:14.104981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:14.105067 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:14.105350 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:14.105350 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] No waiting events found dispatching network-vif-unplugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:14.105535 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-vif-unplugged-216c46d3-e616-44df-a61a-5882b0ce26ec for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:14.107557 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-vif-unplugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:14.108020 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Acquiring lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:14.108196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:14.108341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:14.108577 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] No waiting events found dispatching network-vif-unplugged-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:14.108721 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-vif-unplugged-216c46d3-e616-44df-a61a-5882b0ce26ec for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:14.108873 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-vif-unplugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:14.109033 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:14.109201 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:14.109339 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:14.109498 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] No waiting events found dispatching network-vif-unplugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:14.109704 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4e1d34b3-e143-4678-9956-8980b20f96ed req-d4e5c84f-0366-454a-a15d-67b067e7e55c service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-vif-unplugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:14.109870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.110988 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.111593 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca7a6f18-a692-4784-a8c8-c5ecfe57e752) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:14.113008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:14.119364 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.120940 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.120940 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8812233-bb0f-4701-8cde-815472199f8f) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:14.121625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:14.123125 np0000001643 nova-compute[98269]: INFO os_vif [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=216c46d3-e616-44df-a61a-5882b0ce26ec,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap216c46d3-e6')
May 28 14:05:14.123673 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Deleting instance files /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a_del
May 28 14:05:14.124167 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Deletion of /opt/stack/data/nova/instances/854e01ef-64f4-464f-8a46-ef352e4ccf2a_del complete
May 28 14:05:14.130123 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.131202 np0000001643 nova-compute[98269]: INFO os_vif [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:9e:e2,bridge_name='br-int',has_traffic_filtering=True,id=069820b4-ab96-49ca-aa7b-fdf17b731e95,network=Network(7f5996df-441b-459a-8e37-1d379838be69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069820b4-ab')
May 28 14:05:14.131476 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Deleting instance files /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf_del
May 28 14:05:14.132402 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Deletion of /opt/stack/data/nova/instances/7c6f49c3-6903-4440-987d-dc99e23240bf_del complete
May 28 14:05:14.369065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:14.513982 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.837s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:14.515618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.555s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:14.518954 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:05:14.519099 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Claim successful on node np0000001643
May 28 14:05:14.546477 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:14.598661 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Deleted allocations for instance bb01a4a8-04ac-459a-8994-4f6da360c381
May 28 14:05:14.632210 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Took 1.61 seconds to destroy the instance on the hypervisor.
May 28 14:05:14.632955 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:05:14.633323 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:05:14.633537 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:05:14.633895 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:14.639171 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Took 1.52 seconds to destroy the instance on the hypervisor.
May 28 14:05:14.640043 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:05:14.640428 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:05:14.640597 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:05:14.641124 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:14.790383 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:14.818395 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Creating config drive at /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config
May 28 14:05:14.824385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcuyf3izx {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:14.864164 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:14.886312 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcuyf3izx" returned: 0 in 0.061s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:15.178950 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0010773559999961435 future=<Future at 0x71a75c349400 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:15.179694 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:15.180079 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] Emitting event <LifecycleEvent: 1779977100.1776512, 65c247b5-acbc-474a-bb88-a2edf9ac2d0b => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:15.180244 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] VM Stopped (Lifecycle Event)
May 28 14:05:15.182036 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=2.8319181269998808 future=<Future at 0x71a75c4e8ce0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:15.182189 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=2.831764723999868 future=<Future at 0x71a75c4e8ce0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:15.340570 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7977e6e5-c8dc-4b6a-b10c-32d608222c0a req-88e25f68-8898-4415-a5d6-1f1b98031719 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-vif-deleted-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:15.341967 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-7977e6e5-c8dc-4b6a-b10c-32d608222c0a req-88e25f68-8898-4415-a5d6-1f1b98031719 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Neutron deleted interface 069820b4-ab96-49ca-aa7b-fdf17b731e95; detaching it from the instance and deleting it from the info cache
May 28 14:05:15.346281 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7977e6e5-c8dc-4b6a-b10c-32d608222c0a req-88e25f68-8898-4415-a5d6-1f1b98031719 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Detach interface failed, port_id=069820b4-ab96-49ca-aa7b-fdf17b731e95, reason: Instance 7c6f49c3-6903-4440-987d-dc99e23240bf could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:05:15.421973 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:15.454356 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:15.548663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:15.611288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-32b4d487-379d-449d-b559-eb2c35df5bf5 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "bb01a4a8-04ac-459a-8994-4f6da360c381" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.103s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:15.648725 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:15.653891 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:15.686906 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c5f51cda-6685-40f4-a9c8-869aef1b4a86 None None] [instance: 65c247b5-acbc-474a-bb88-a2edf9ac2d0b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:15.771309 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:15.842988 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-833522ca-ab3c-4af2-84bf-dfecbe5206d7 req-a47c569c-5657-4cc2-b925-0ea4105d3bab service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:15.843812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-833522ca-ab3c-4af2-84bf-dfecbe5206d7 req-a47c569c-5657-4cc2-b925-0ea4105d3bab service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:15.844039 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-833522ca-ab3c-4af2-84bf-dfecbe5206d7 req-a47c569c-5657-4cc2-b925-0ea4105d3bab service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:15.844214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-833522ca-ab3c-4af2-84bf-dfecbe5206d7 req-a47c569c-5657-4cc2-b925-0ea4105d3bab service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:15.844381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-833522ca-ab3c-4af2-84bf-dfecbe5206d7 req-a47c569c-5657-4cc2-b925-0ea4105d3bab service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Processing event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:05:15.937880 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:16.096303 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:16.096483 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:16.175900 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-921174a5-810d-4d3e-b859-1d0d1b21f478 req-3e12d744-8a59-48c7-a018-0f602e6c32b6 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-vif-unplugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:16.179196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-921174a5-810d-4d3e-b859-1d0d1b21f478 req-3e12d744-8a59-48c7-a018-0f602e6c32b6 service nova] Acquiring lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:16.181659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-921174a5-810d-4d3e-b859-1d0d1b21f478 req-3e12d744-8a59-48c7-a018-0f602e6c32b6 service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:16.183716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-921174a5-810d-4d3e-b859-1d0d1b21f478 req-3e12d744-8a59-48c7-a018-0f602e6c32b6 service nova] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:16.184094 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-921174a5-810d-4d3e-b859-1d0d1b21f478 req-3e12d744-8a59-48c7-a018-0f602e6c32b6 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] No waiting events found dispatching network-vif-unplugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:16.184564 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-921174a5-810d-4d3e-b859-1d0d1b21f478 req-3e12d744-8a59-48c7-a018-0f602e6c32b6 service nova] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Received event network-vif-unplugged-069820b4-ab96-49ca-aa7b-fdf17b731e95 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:16.184901 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-921174a5-810d-4d3e-b859-1d0d1b21f478 req-3e12d744-8a59-48c7-a018-0f602e6c32b6 service nova] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Received event network-vif-deleted-216c46d3-e616-44df-a61a-5882b0ce26ec {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:16.273366 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Took 1.63 seconds to deallocate network for instance.
May 28 14:05:16.439789 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Took 1.81 seconds to deallocate network for instance.
May 28 14:05:16.473385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:16.493366 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977116.4927263, b8315b4c-90be-498b-bdc8-1a775a1480bc => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:16.493775 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:05:16.493982 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] VM Started (Lifecycle Event)
May 28 14:05:16.497749 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:05:16.503231 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance spawned successfully.
May 28 14:05:16.504247 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:05:16.599269 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:16.781836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:16.946502 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:16.999463 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:17.004897 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:17.014821 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:17.015059 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:17.015563 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:17.015974 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:17.016360 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:17.018170 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:17.108553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.593s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:17.109122 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:05:17.112319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.331s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:17.505869 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:05:17.506116 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977117.5058897, b8315b4c-90be-498b-bdc8-1a775a1480bc => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:17.506297 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] VM Paused (Lifecycle Event)
May 28 14:05:17.525484 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Took 7.18 seconds to spawn the instance on the hypervisor.
May 28 14:05:17.525484 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:17.619041 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:05:17.619651 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:05:17.619998 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:17.620338 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:17.688145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:17.688318 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:17.750946 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81cf50caaafd43ffae63aff9c9258528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4618bb9b554fb8af8f26aae95c016a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:05:17.925644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f5e5674-e6f3-48b3-9443-1983978b2f96 req-85bc604d-9c58-4c5b-b77c-2fb69c538849 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:17.926260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f5e5674-e6f3-48b3-9443-1983978b2f96 req-85bc604d-9c58-4c5b-b77c-2fb69c538849 service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:17.927052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f5e5674-e6f3-48b3-9443-1983978b2f96 req-85bc604d-9c58-4c5b-b77c-2fb69c538849 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:17.927052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f5e5674-e6f3-48b3-9443-1983978b2f96 req-85bc604d-9c58-4c5b-b77c-2fb69c538849 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:17.927052 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f5e5674-e6f3-48b3-9443-1983978b2f96 req-85bc604d-9c58-4c5b-b77c-2fb69c538849 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] No waiting events found dispatching network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:17.927052 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2f5e5674-e6f3-48b3-9443-1983978b2f96 req-85bc604d-9c58-4c5b-b77c-2fb69c538849 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received unexpected event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 for instance with vm_state active and task_state None.
May 28 14:05:18.010896 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:18.014355 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003798929999447864 future=<Future at 0x71a75c4e8ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:18.014509 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:18.014740 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.47544277399993 future=<Future at 0x71a75c7916a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:18.014740 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.475321721 future=<Future at 0x71a75c7916a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:18.015082 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Emitting event <LifecycleEvent: 1779977103.013864, 150a83f0-0070-4df3-ab14-6aa1c028be82 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:18.015318 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] VM Stopped (Lifecycle Event)
May 28 14:05:18.021327 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977118.0210018, b8315b4c-90be-498b-bdc8-1a775a1480bc => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:18.021607 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] VM Resumed (Lifecycle Event)
May 28 14:05:18.036351 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Took 13.26 seconds to build instance.
May 28 14:05:18.123154 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:05:18.191014 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:18.369849 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Successfully created port: a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:05:18.519998 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 150a83f0-0070-4df3-ab14-6aa1c028be82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:18.525583 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:18.531481 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:18.539778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.770s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:18.632389 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:05:18.699798 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.588s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:18.701411 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.755s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:18.766302 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Deleted allocations for instance 7c6f49c3-6903-4440-987d-dc99e23240bf
May 28 14:05:19.090169 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Successfully updated port: a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:05:19.120876 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:19.156769 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-changed-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:19.159651 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Refreshing instance network info cache due to event network-changed-a6d11da0-3e5d-4d81-890b-33bfa2b1583d. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:19.159651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] Acquiring lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:19.159651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] Acquired lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:19.159651 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Refreshing network info cache for port a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:19.173807 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:19.175670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:19.184326 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-changed-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:19.184657 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Refreshing instance network info cache due to event network-changed-61ba7305-7cba-43a7-933f-1bb3fb5e7377. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:19.187586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] Acquiring lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:19.187778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] Acquired lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:19.188048 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Refreshing network info cache for port 61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:19.242888 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:19.243158 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:19.385476 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:19.595772 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:19.643766 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:05:19.645220 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:05:19.646481 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Creating image(s)
May 28 14:05:19.648109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:19.648109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:19.648763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:19.649979 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:19.655753 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:19.657625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:19.683572 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:19.690156 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:05:19.700032 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:19.746712 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:19.779967 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a42c9c79-5ecd-4ce8-945e-88148a6ea449 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "7c6f49c3-6903-4440-987d-dc99e23240bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.167s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:19.782949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.125s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:19.786858 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:19.787690 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:19.788611 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:19.792978 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:19.793824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:19.851287 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:05:19.897667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:19.898899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:19.971942 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk 1073741824" returned: 0 in 0.073s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:19.972573 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:19.973034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:20.095281 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:20.098228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.125s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:20.101475 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:05:20.101475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:20.205414 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:20.211715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:20.216230 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Cannot resize image /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:05:20.216230 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:05:20.216230 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Ensure instance console log exists: /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:05:20.219255 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:20.219794 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:20.220090 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:20.257185 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.556s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:20.274774 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:20.274987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:20.278918 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:05:20.278918 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Claim successful on node np0000001643
May 28 14:05:20.361253 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Deleted allocations for instance 854e01ef-64f4-464f-8a46-ef352e4ccf2a
May 28 14:05:20.458960 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updated VIF entry in instance network info cache for port 61ba7305-7cba-43a7-933f-1bb3fb5e7377. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:05:20.458960 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updating instance_info_cache with network_info: [{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:20.598734 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2045e587-316e-4ea3-b942-4b90872ef46d req-7adf26c2-127e-4ac0-ac4d-eaaebde058b1 service nova] Releasing lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:20.599239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:20.599623 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:05:20.962179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c28e8c4e-0770-43aa-a547-6a70d3a650bf req-1fa6d558-3e2f-4f95-b7bc-1d0ea6a68c8f service nova] Releasing lock "refresh_cache-b8315b4c-90be-498b-bdc8-1a775a1480bc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:21.217854 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:05:21.382354 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4e5b14b9-a46f-4c1e-a6d5-218d3dd5eecd tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Lock "854e01ef-64f4-464f-8a46-ef352e4ccf2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.874s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:21.494788 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:21.737940 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updating instance_info_cache with network_info: [{"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:21.912948 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:21.912948 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:22.240113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:22.240595 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Instance network_info: |[{"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:05:22.242225 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Start _get_guest_xml network_info=[{"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:05:22.244541 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:22.245984 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='0cb5afe2-5125-4261-b2f3-f0431bc65134'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977122.2455337) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:05:22.248072 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:05:22.248409 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:05:22.249154 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:05:22.249478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:05:22.250660 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:05:22.251170 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:05:22.251288 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:05:22.251381 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:05:22.251639 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:05:22.251691 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:05:22.251784 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:05:22.252559 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:05:22.252559 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:05:22.252559 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:05:22.252559 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:05:22.252559 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:05:22.265277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=26,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-4yyq63oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=0cb5afe2-5125-4261-b2f3-f0431bc65134,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:05:22.265539 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:22.266022 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:16:34,bridge_name='br-int',has_traffic_filtering=True,id=a6d11da0-3e5d-4d81-890b-33bfa2b1583d,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11da0-3e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:22.266686 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cb5afe2-5125-4261-b2f3-f0431bc65134 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:22.417224 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:22.769598 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] End _get_guest_xml xml=<domain type="qemu">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <uuid>0cb5afe2-5125-4261-b2f3-f0431bc65134</uuid>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <name>instance-0000001a</name>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:name>multiattach-server-1</nova:name>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:05:22</nova:creationTime>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         <nova:port uuid="a6d11da0-3e5d-4d81-890b-33bfa2b1583d">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <system>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <entry name="serial">0cb5afe2-5125-4261-b2f3-f0431bc65134</entry>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <entry name="uuid">0cb5afe2-5125-4261-b2f3-f0431bc65134</entry>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </system>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <os>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   </os>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <features>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   </features>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   <devices>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk.config"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:cc:16:34"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <target dev="tapa6d11da0-3e"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </interface>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/console.log" append="off"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </serial>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <video>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </video>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </rng>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:   </devices>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]: </domain>
May 28 14:05:22.769598 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Preparing to wait for external event network-vif-plugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=26,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-4yyq63oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=0cb5afe2-5125-4261-b2f3-f0431bc65134,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:16:34,bridge_name='br-int',has_traffic_filtering=True,id=a6d11da0-3e5d-4d81-890b-33bfa2b1583d,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11da0-3e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:16:34,bridge_name='br-int',has_traffic_filtering=True,id=a6d11da0-3e5d-4d81-890b-33bfa2b1583d,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11da0-3e') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:22.775687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7552d433-5523-50ff-b987-e71344502dd3', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:22.783282 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:22.785714 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:22.786701 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:22.789687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:22.789945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6d11da0-3e, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:22.790437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6d11da0-3e, col_values=(('qos', UUID('8aa12b93-6cb4-4aa4-951c-1f3a45ad7049')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:22.790437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6d11da0-3e, col_values=(('external_ids', {'iface-id': 'a6d11da0-3e5d-4d81-890b-33bfa2b1583d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:16:34', 'vm-uuid': '0cb5afe2-5125-4261-b2f3-f0431bc65134'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:22.791495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:22.793342 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:22.803502 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:22.805014 np0000001643 nova-compute[98269]: INFO os_vif [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:16:34,bridge_name='br-int',has_traffic_filtering=True,id=a6d11da0-3e5d-4d81-890b-33bfa2b1583d,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11da0-3e')
May 28 14:05:22.924944 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.650s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:22.925524 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:05:23.433023 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:05:23.433443 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:05:23.433598 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:23.433826 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:23.525730 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d135543093d4ca0849ab043df8e19ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a792bdb63c954739ad33cb2fedeedee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:05:23.936007 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:05:24.172669 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Successfully created port: cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:05:24.336529 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:24.336740 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:24.336880 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:cc:16:34, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:24.337369 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Using config drive
May 28 14:05:24.388257 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:24.439995 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:05:24.490687 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004938790000323934 future=<Future at 0x71a75c7916a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:24.490811 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:24.490892 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-4.5131999968361924e-05 future=<Future at 0x71a75c776f00 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:24.491044 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0002018210000187537 future=<Future at 0x71a75c776f00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:24.492801 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:24.492905 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Emitting event <LifecycleEvent: 1779977109.4907851, bb01a4a8-04ac-459a-8994-4f6da360c381 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:24.494106 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Emitting event <LifecycleEvent: 1779977109.4899962, fb9d4d3f-f068-49a2-ba11-114989ee8d9e => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:24.494106 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.061387897000031 future=<Future at 0x71a7802d38f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:24.494106 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.061249612000211 future=<Future at 0x71a7802d38f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:24.494251 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] VM Stopped (Lifecycle Event)
May 28 14:05:24.496834 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] VM Stopped (Lifecycle Event)
May 28 14:05:24.849998 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:24.928111 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Successfully updated port: cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:05:25.001019 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: bb01a4a8-04ac-459a-8994-4f6da360c381] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:25.005852 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Creating config drive at /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk.config
May 28 14:05:25.007208 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: fb9d4d3f-f068-49a2-ba11-114989ee8d9e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:25.014811 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-changed-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:25.014811 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Refreshing instance network info cache due to event network-changed-cfb057e3-cb74-4043-93db-9aad57a412dc. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:25.015789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] Acquiring lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:25.018227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] Acquired lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:25.018437 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Refreshing network info cache for port cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:25.023212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpivifjfls {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:25.093218 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpivifjfls" returned: 0 in 0.071s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:25.435864 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:25.454162 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:05:25.454620 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:05:25.454620 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Creating image(s)
May 28 14:05:25.455185 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "/opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:25.455484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:25.456281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "/opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:25.457878 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:25.466843 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:25.471325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:25.525968 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:25.594150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:25.594722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:25.595962 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:25.597986 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:25.603192 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:25.603675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:25.710002 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:25.749671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:25.758219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:25.810080 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.206s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:25.810604 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:25.861404 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:25.877824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk 1073741824" returned: 0 in 0.067s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:25.878539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:25.878963 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:25.906303 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:05:25.959571 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:25.983730 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:25.984788 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:05:25.985145 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:26.100204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:26.101072 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Cannot resize image /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:05:26.101072 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:05:26.102294 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Ensure instance console log exists: /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:05:26.105579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:26.105916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:26.107651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:26.321605 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:26.825230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-609a3789-c8ac-4506-b618-8b177201a0fa req-cea06577-1946-43e0-b826-3668051dbf6f service nova] Releasing lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:26.826761 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquired lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:26.827000 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:05:26.848420 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977126.847848, 0cb5afe2-5125-4261-b2f3-f0431bc65134 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:26.848925 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] VM Started (Lifecycle Event)
May 28 14:05:27.106483 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-vif-plugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:27.106787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:27.107554 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:27.107847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:27.107922 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Processing event network-vif-plugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:05:27.108182 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-vif-plugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:27.108364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:27.108532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:27.108648 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:27.108779 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] No waiting events found dispatching network-vif-plugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:27.110060 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:05:27.110252 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-24d630ae-1fcb-45cb-b60a-7b4e075a665c req-4a27c68c-a76f-4d60-a89a-44e332b9205f service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received unexpected event network-vif-plugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d for instance with vm_state building and task_state spawning.
May 28 14:05:27.117470 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:05:27.117470 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Instance spawned successfully.
May 28 14:05:27.117807 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:05:27.356007 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:27.359223 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:27.448501 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:05:27.630085 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:27.630244 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:27.630746 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:27.631081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:27.632371 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:27.632726 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:27.661979 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:27.799497 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:27.860463 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Updating instance_info_cache with network_info: [{"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:27.863281 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:05:27.863281 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977127.862821, 0cb5afe2-5125-4261-b2f3-f0431bc65134 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:27.863281 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] VM Paused (Lifecycle Event)
May 28 14:05:27.976067 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.142807 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Took 8.50 seconds to spawn the instance on the hypervisor.
May 28 14:05:28.142807 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:28.338435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.368306 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Releasing lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:28.370915 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Instance network_info: |[{"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:05:28.373485 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:28.374042 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Start _get_guest_xml network_info=[{"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:05:28.379466 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977128.3791072, 0cb5afe2-5125-4261-b2f3-f0431bc65134 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:28.379877 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] VM Resumed (Lifecycle Event)
May 28 14:05:28.382048 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:28.383773 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-192110835', uuid='67d9145b-f424-411a-b3aa-f1b56dc42f2b'), owner=OwnerMeta(userid='2d135543093d4ca0849ab043df8e19ca', username='tempest-AttachVolumeNegativeTest-703881462-project-member', projectid='a792bdb63c954739ad33cb2fedeedee4', projectname='tempest-AttachVolumeNegativeTest-703881462'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977128.3832333) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:05:28.385138 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:05:28.385832 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:05:28.387243 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:05:28.388600 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:05:28.390021 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:05:28.390564 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:05:28.390771 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:05:28.390905 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:05:28.391072 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:05:28.391180 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:05:28.391763 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:05:28.392182 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:05:28.392392 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:05:28.392604 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:05:28.392805 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:05:28.393019 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:05:28.412867 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-192110835',display_name='tempest-AttachVolumeNegativeTest-server-192110835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-192110835',id=27,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmnR26C+q4jGYK/NvoqlfxDAZ+EOhgWBERdz2lr7ZENLnNW2f3eKhbOU7gPWTDZw4e/InB0eP/MKvUa1WjZcgOIBW2Moe8Ff3/O6GI6QXBBw8+n33dtknD8E2Oy9R3wBA==',key_name='tempest-keypair-2033227267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-60tvowlh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=67d9145b-f424-411a-b3aa-f1b56dc42f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:05:28.413163 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:28.414017 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:94:cb,bridge_name='br-int',has_traffic_filtering=True,id=cfb057e3-cb74-4043-93db-9aad57a412dc,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb057e3-cb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:28.414811 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'pci_devices' on Instance uuid 67d9145b-f424-411a-b3aa-f1b56dc42f2b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:28.556989 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0018937169998025638 future=<Future at 0x71a7802d38f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:28.557142 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:28.557300 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.0147409979999793 future=<Future at 0x71a7802d3140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:28.557431 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.014599847999988924 future=<Future at 0x71a7802d3140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:28.560660 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Emitting event <LifecycleEvent: 1779977113.5549676, 854e01ef-64f4-464f-8a46-ef352e4ccf2a => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:28.561485 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] VM Stopped (Lifecycle Event)
May 28 14:05:28.574465 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0021662879998984863 future=<Future at 0x71a7802d3140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:28.574465 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:28.575331 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Emitting event <LifecycleEvent: 1779977113.5719638, 7c6f49c3-6903-4440-987d-dc99e23240bf => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:28.575538 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] VM Stopped (Lifecycle Event)
May 28 14:05:28.655554 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Took 15.78 seconds to build instance.
May 28 14:05:28.885549 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:28.887496 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:28.920337 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] End _get_guest_xml xml=<domain type="qemu">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <uuid>67d9145b-f424-411a-b3aa-f1b56dc42f2b</uuid>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <name>instance-0000001b</name>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-192110835</nova:name>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:05:28</nova:creationTime>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:user uuid="2d135543093d4ca0849ab043df8e19ca">tempest-AttachVolumeNegativeTest-703881462-project-member</nova:user>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:project uuid="a792bdb63c954739ad33cb2fedeedee4">tempest-AttachVolumeNegativeTest-703881462</nova:project>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         <nova:port uuid="cfb057e3-cb74-4043-93db-9aad57a412dc">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <system>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <entry name="serial">67d9145b-f424-411a-b3aa-f1b56dc42f2b</entry>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <entry name="uuid">67d9145b-f424-411a-b3aa-f1b56dc42f2b</entry>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </system>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <os>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   </os>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <features>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   </features>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   <devices>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk.config"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:a7:94:cb"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <target dev="tapcfb057e3-cb"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </interface>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/console.log" append="off"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </serial>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <video>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </video>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </rng>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:   </devices>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]: </domain>
May 28 14:05:28.920337 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:05:28.920337 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Preparing to wait for external event network-vif-plugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:05:28.920337 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:28.929522 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:28.929522 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.005s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:28.929522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-192110835',display_name='tempest-AttachVolumeNegativeTest-server-192110835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-192110835',id=27,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmnR26C+q4jGYK/NvoqlfxDAZ+EOhgWBERdz2lr7ZENLnNW2f3eKhbOU7gPWTDZw4e/InB0eP/MKvUa1WjZcgOIBW2Moe8Ff3/O6GI6QXBBw8+n33dtknD8E2Oy9R3wBA==',key_name='tempest-keypair-2033227267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-60tvowlh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=67d9145b-f424-411a-b3aa-f1b56dc42f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:05:28.929522 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:28.929522 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:94:cb,bridge_name='br-int',has_traffic_filtering=True,id=cfb057e3-cb74-4043-93db-9aad57a412dc,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb057e3-cb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:28.929522 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:94:cb,bridge_name='br-int',has_traffic_filtering=True,id=cfb057e3-cb74-4043-93db-9aad57a412dc,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb057e3-cb') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:05:28.932670 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.933040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:28.933492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:05:28.934405 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.934715 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac618faa-bce6-5075-89f1-6d67c89a5f5c', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:28.944002 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.944988 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:28.945928 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.949946 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.950148 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfb057e3-cb, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:28.950564 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfb057e3-cb, col_values=(('qos', UUID('2f26ef40-8af2-4ae6-87c4-d79092011063')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:28.950778 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfb057e3-cb, col_values=(('external_ids', {'iface-id': 'cfb057e3-cb74-4043-93db-9aad57a412dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:94:cb', 'vm-uuid': '67d9145b-f424-411a-b3aa-f1b56dc42f2b'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:28.953011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.956706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:28.963362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:28.963362 np0000001643 nova-compute[98269]: INFO os_vif [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:94:cb,bridge_name='br-int',has_traffic_filtering=True,id=cfb057e3-cb74-4043-93db-9aad57a412dc,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb057e3-cb')
May 28 14:05:29.066306 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bb6acf0a-3766-48a2-96f9-0a75f19f7fbf tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 854e01ef-64f4-464f-8a46-ef352e4ccf2a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:29.079759 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4ea27ef7-2b85-439e-9299-f460dafd73a9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 7c6f49c3-6903-4440-987d-dc99e23240bf] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:29.156610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1d45cc1e-15aa-436d-972b-3113fe1968ba tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.298s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:29.391956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:29.701610 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-changed-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:29.701977 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Refreshing instance network info cache due to event network-changed-c7f757d6-e1c6-43c4-be67-443fe29dcb8a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:29.702115 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] Acquiring lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:29.702232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] Acquired lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:29.704575 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Refreshing network info cache for port c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:30.209035 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:30.502825 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:30.502825 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:30.502825 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No VIF found with MAC fa:16:3e:a7:94:cb, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:30.502825 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Using config drive
May 28 14:05:30.583323 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:30.646896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:30.765478 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updated VIF entry in instance network info cache for port c7f757d6-e1c6-43c4-be67-443fe29dcb8a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:05:30.765850 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updating instance_info_cache with network_info: [{"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:31.009827 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:31.182772 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Creating config drive at /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk.config
May 28 14:05:31.187351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl9sowk1_ {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:31.254215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl9sowk1_" returned: 0 in 0.066s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:31.269194 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c76192e-f44c-4a9c-8fd3-45b776e5e2d9 req-254c8b16-c052-4400-9ca2-1c80116054be service nova] Releasing lock "refresh_cache-cfa684f7-1fb1-4e0f-bf60-3c42614b2670" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:31.563173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:31.563173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:31.795127 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-changed-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:31.795127 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Refreshing instance network info cache due to event network-changed-a6d11da0-3e5d-4d81-890b-33bfa2b1583d. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:31.795438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] Acquiring lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:31.795542 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] Acquired lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:31.795696 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Refreshing network info cache for port a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:31.824288 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:31.834263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:31.857750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:31.947947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:32.019140 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:32.068736 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid cfa684f7-1fb1-4e0f-bf60-3c42614b2670 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:32.260626 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:32.266969 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:32.272874 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:32.299590 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:32.305912 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:32.534677 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] instance snapshotting
May 28 14:05:32.687913 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Beginning live snapshot process
May 28 14:05:32.830239 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:33.011132 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977133.0101452, 67d9145b-f424-411a-b3aa-f1b56dc42f2b => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:33.011132 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] VM Started (Lifecycle Event)
May 28 14:05:33.020655 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updated VIF entry in instance network info cache for port a6d11da0-3e5d-4d81-890b-33bfa2b1583d. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:05:33.021318 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updating instance_info_cache with network_info: [{"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:33.083702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:33.125061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:33.125569 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:33.517616 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:33.521406 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977133.5210493, 67d9145b-f424-411a-b3aa-f1b56dc42f2b => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:33.521728 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] VM Paused (Lifecycle Event)
May 28 14:05:33.524899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5859b06a-6f7b-4df9-a55b-ce78f9cb4b51 req-82247ae6-8d5c-4d62-b9a2-c52727f65da2 service nova] Releasing lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:33.628424 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Detaching volume 6b283459-8bc2-41e6-a88a-c2719309f7eb
May 28 14:05:33.694047 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Attempting to driver detach volume 6b283459-8bc2-41e6-a88a-c2719309f7eb from mountpoint /dev/vdb
May 28 14:05:33.711961 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found disk vdb by alias ua-6b283459-8bc2-41e6-a88a-c2719309f7eb {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:33.713805 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found disk vdb by alias ua-6b283459-8bc2-41e6-a88a-c2719309f7eb {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:33.713992 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Attempting to detach device vdb from instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:05:33.714366 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:33.714366 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:33.714366 np0000001643 nova-compute[98269]:   <alias name="ua-6b283459-8bc2-41e6-a88a-c2719309f7eb"/>
May 28 14:05:33.714366 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:33.714366 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:33.714366 np0000001643 nova-compute[98269]:   <serial>6b283459-8bc2-41e6-a88a-c2719309f7eb</serial>
May 28 14:05:33.714366 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:05:33.714366 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:33.714366 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:33.721221 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully detached device vdb from instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc from the persistent domain config.
May 28 14:05:33.721474 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] (1/8): Attempting to detach device vdb with device alias ua-6b283459-8bc2-41e6-a88a-c2719309f7eb from instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:05:33.721809 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:33.721809 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:33.721809 np0000001643 nova-compute[98269]:   <alias name="ua-6b283459-8bc2-41e6-a88a-c2719309f7eb"/>
May 28 14:05:33.721809 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:33.721809 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:33.721809 np0000001643 nova-compute[98269]:   <serial>6b283459-8bc2-41e6-a88a-c2719309f7eb</serial>
May 28 14:05:33.721809 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:05:33.721809 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:33.721809 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:33.952058 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:34.025012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:34.025932 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:34.027459 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:34.182976 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:34.183165 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:34.183402 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Attaching volume 81237ce9-250e-4283-8767-236dd4c25fdd to /dev/vdb
May 28 14:05:34.210361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:34.242933 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:34.262492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:05:34.296471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:34.320627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json -f qcow2" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:34.321410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:34.350327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:05:34.350794 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:05:34.361887 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:05:34.364497 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:feab:25f1', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60'] 
May 28 14:05:34.365215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:05:34.366931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:05:34.366931 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:34.367140 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updating existing volume attachment record: 0d95cfb8-38fb-498f-b32e-21f56e1b9e40 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:05:34.395821 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:34.419040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6b283459-8bc2-41e6-a88a-c2719309f7eb for instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:05:34.447659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json -f qcow2" returned: 0 in 0.126s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:34.448595 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:34.454898 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:34.455543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:34.530909 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:05:34.531596 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977134.531172, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => ua-6b283459-8bc2-41e6-a88a-c2719309f7eb> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:05:34.538844 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully detached device vdb from instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc from the live domain config.
May 28 14:05:34.542479 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:05:34.542673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:34.542866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:34.543330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:34.543678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b283459-8bc2-41e6-a88a-c2719309f7eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:05:34.543804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:05:34.566801 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:34.567328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbiwcn3zv/6ebaf41c64584bc5bb924280673edbd4.delta 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:34.583004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:34.583004 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:34.583004 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:34.583004 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:34.583004 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:34.583419 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:34.583419 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:34.583419 np0000001643 nova-compute[98269]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:34.583419 np0000001643 nova-compute[98269]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb (non-flash)
May 28 14:05:34.583419 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:34.583850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '40')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:05:34.584109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '39')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:05:34.585753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb', '40')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:05:34.586827 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780149f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:05:34.587253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:05:34.587725 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flush multipath device 330000000edd7040f {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:05:34.618442 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:05:34.635643 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbiwcn3zv/6ebaf41c64584bc5bb924280673edbd4.delta 1073741824" returned: 0 in 0.068s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:34.637749 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 14:05:34.661524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:05:34.721724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:05:34.722241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:05:34.723498 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:05:34.741540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:05:34.741540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:05:34.763775 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:34.798912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260]
May 28 14:05:34.798912 np0000001643 nova-compute[98269]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.40.100,3260] successful.
May 28 14:05:34.798912 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:34.817748 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:34.834869 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:34.872975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260]
May 28 14:05:34.872975 np0000001643 nova-compute[98269]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-6b283459-8bc2-41e6-a88a-c2719309f7eb, portal: 192.168.50.100,3260] successful.
May 28 14:05:34.872975 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:34.887953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:34.888072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:34.888165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== disconnect_volume: return (345ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:34.890545 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:05:34.963922 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:05:34.964442 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:34.964724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:34.965685 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:34.965685 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:05:34.981035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:34.981610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:34.982959 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:05:34.983213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:34.983614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:34.983999 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:05:34.996043 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] COPY block job progress, current cursor: 0 final cursor: 77070336 {{(pid=98269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 14:05:35.002373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:05:35.002373 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:35.004836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:05:35.004836 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:35.019845 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd] added
May 28 14:05:35.019845 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:05:35.019845 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:35.019845 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:35.019845 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:35.019845 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:35.019845 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:35.020102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:05:35.023469 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:05:35.023469 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:05:35.026010 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd] added
May 28 14:05:35.026010 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:05:35.026010 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:35.026010 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:35.026010 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:35.026010 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:35.026010 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:35.026743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:05:35.026743 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0426(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:05:35.026743 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:05:35.072438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:35.072704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:35.462908 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:35.495406 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] COPY block job progress, current cursor: 77070336 final cursor: 77070336 {{(pid=98269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 14:05:35.497596 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 14:05:35.537269 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:05:35.537684 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbiwcn3zv/6ebaf41c64584bc5bb924280673edbd4.delta /opt/stack/data/nova/instances/snapshots/tmpbiwcn3zv/6ebaf41c64584bc5bb924280673edbd4 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:35.576213 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:05:35.783931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbiwcn3zv/6ebaf41c64584bc5bb924280673edbd4.delta /opt/stack/data/nova/instances/snapshots/tmpbiwcn3zv/6ebaf41c64584bc5bb924280673edbd4" returned: 0 in 0.246s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:35.788610 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Snapshot extracted, beginning image upload
May 28 14:05:36.022058 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:05:36.029820 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:05:36.037548 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:05:36.037548 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:05:36.044299 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:05:36.044299 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.051122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.057304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.064758 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.064758 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.064758 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:36.064946 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.064946 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.064946 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:36.071438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.071438 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.071438 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:36.071657 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.071657 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.071657 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:36.101488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.40.100,3260]
May 28 14:05:36.101488 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.40.100,3260] successful.
May 28 14:05:36.101488 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.109308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.50.100,3260]
May 28 14:05:36.109308 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.50.100,3260] successful.
May 28 14:05:36.109308 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.115485 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.124099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:36.132726 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.132726 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.132726 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.132726 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.132726 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:36.132997 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.132997 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.132997 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.132997 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.132997 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:36.133620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:36.133620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:05:36.134387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('7', '-', '-', 0) found on session 43 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:05:36.134575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:36.143424 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:36.144522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:36.144522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:05:36.145492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('8', '-', '-', 0) found on session 44 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:05:36.145650 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:05:36.161344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:36.161824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:36.162684 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 43 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:05:36.162759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:05:36.174691 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:05:36.174691 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Claim successful on node np0000001643
May 28 14:05:36.177921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 44 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:05:36.179216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:05:36.406956 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:36.470291 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04315fee-fd89-4061-8697-b8704b0f6843 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.344s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:36.470664 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.064s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:36.470858 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:36.473617 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98269) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 14:05:36.474326 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:36.988274 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:05:37.522980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:37.552758 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:37.557576 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:37.589406 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:37.804927 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:37.804927 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:37.815575 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:37.828663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:37.849776 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999694195000075 future=<Future at 0x71a75c36ddf0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:37.851695 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997784859000149 future=<Future at 0x71a75c36ddf0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:37.851833 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997597627000005 future=<Future at 0x71a75c36ddf0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:37.856169 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance destroyed successfully.
May 28 14:05:37.856694 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:37.865269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc9c47f-c9ac-4b8f-bd18-c0d358776fb8 req-0b011a9e-9487-4068-b029-3fb759140099 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:37.865574 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc9c47f-c9ac-4b8f-bd18-c0d358776fb8 req-0b011a9e-9487-4068-b029-3fb759140099 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:37.867975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc9c47f-c9ac-4b8f-bd18-c0d358776fb8 req-0b011a9e-9487-4068-b029-3fb759140099 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:37.868215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc9c47f-c9ac-4b8f-bd18-c0d358776fb8 req-0b011a9e-9487-4068-b029-3fb759140099 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:37.871608 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc9c47f-c9ac-4b8f-bd18-c0d358776fb8 req-0b011a9e-9487-4068-b029-3fb759140099 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:37.871912 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-4fc9c47f-c9ac-4b8f-bd18-c0d358776fb8 req-0b011a9e-9487-4068-b029-3fb759140099 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state active and task_state powering-off.
May 28 14:05:38.021457 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-13e1f403-d860-4a9c-a62b-8ce70d81012e req-a9643100-a89b-49dc-9f60-06f8d479757c service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-vif-plugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:38.021821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13e1f403-d860-4a9c-a62b-8ce70d81012e req-a9643100-a89b-49dc-9f60-06f8d479757c service nova] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:38.021854 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13e1f403-d860-4a9c-a62b-8ce70d81012e req-a9643100-a89b-49dc-9f60-06f8d479757c service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:38.022031 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13e1f403-d860-4a9c-a62b-8ce70d81012e req-a9643100-a89b-49dc-9f60-06f8d479757c service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:38.022181 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-13e1f403-d860-4a9c-a62b-8ce70d81012e req-a9643100-a89b-49dc-9f60-06f8d479757c service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Processing event network-vif-plugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:05:38.022942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 3300000004156ad88 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:05:38.023399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.058s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:38.023641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (3058ms) {'type': 'block', 'scsi_wwn': '3300000004156ad88', 'path': '/dev/dm-0', 'multipath_id': '3300000004156ad88'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:38.023806 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004156ad88', 'path': '/dev/dm-0', 'multipath_id': '3300000004156ad88'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:05:38.026050 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:05:38.032481 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977138.031392, 67d9145b-f424-411a-b3aa-f1b56dc42f2b => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:38.033140 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:05:38.033283 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] VM Resumed (Lifecycle Event)
May 28 14:05:38.034805 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid cfa684f7-1fb1-4e0f-bf60-3c42614b2670 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:38.038604 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Instance spawned successfully.
May 28 14:05:38.042120 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:05:38.309695 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:38.344610 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.345019 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.345377 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.346638 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.346638 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.346638 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.346879 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.347051 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:05:38.347431 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:05:38.359304 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:38.359641 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:38.541155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Attempting to attach volume 81237ce9-250e-4283-8767-236dd4c25fdd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:05:38.542100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:38.544883 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:05:38.544883 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:38.544883 np0000001643 nova-compute[98269]:   <alias name="ua-81237ce9-250e-4283-8767-236dd4c25fdd"/>
May 28 14:05:38.544883 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:38.544883 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:38.544883 np0000001643 nova-compute[98269]:   <serial>81237ce9-250e-4283-8767-236dd4c25fdd</serial>
May 28 14:05:38.544883 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:38.544883 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:38.544883 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:05:38.549646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:38.564674 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:38.566878 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:38.567401 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:38.567742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:38.568111 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:38.568726 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:38.819524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.658s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:38.820014 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:05:38.853193 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:38.859710 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:38.861630 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.007s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:38.862908 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:05:38.870310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f9735bd-6184-4752-b849-4f13b9b84c73 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.400s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:38.954887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:39.058649 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:05:39.084530 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Took 13.63 seconds to spawn the instance on the hypervisor.
May 28 14:05:39.088946 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:39.179729 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Snapshot image upload complete
May 28 14:05:39.179932 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0828b3b5-df17-4780-9ffb-09542667de8a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Took 6.64 seconds to snapshot the instance on the hypervisor.
May 28 14:05:39.325555 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:05:39.330035 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:05:39.330035 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:39.330035 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:39.398503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:39.432332 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:39.449948 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd63519537b49cc88a46117da664f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f216176f6d4f43b4d9b887d97b5c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:05:39.603797 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Took 19.39 seconds to build instance.
May 28 14:05:39.833805 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:05:39.928255 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:39.964116 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:39.964852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquired lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:39.965056 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:05:39.965459 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'info_cache' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:39.991541 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c6fecc3e-3749-4ef7-a775-11c5b0ee8431 req-db4881de-f806-4ffc-8faf-625b3d032226 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:39.994118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c6fecc3e-3749-4ef7-a775-11c5b0ee8431 req-db4881de-f806-4ffc-8faf-625b3d032226 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:39.994610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c6fecc3e-3749-4ef7-a775-11c5b0ee8431 req-db4881de-f806-4ffc-8faf-625b3d032226 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:39.995078 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c6fecc3e-3749-4ef7-a775-11c5b0ee8431 req-db4881de-f806-4ffc-8faf-625b3d032226 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:39.996370 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c6fecc3e-3749-4ef7-a775-11c5b0ee8431 req-db4881de-f806-4ffc-8faf-625b3d032226 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:39.996370 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-c6fecc3e-3749-4ef7-a775-11c5b0ee8431 req-db4881de-f806-4ffc-8faf-625b3d032226 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state stopped and task_state powering-on.
May 28 14:05:40.059140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.060625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:40.110977 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b0a9dbb2-0034-40de-94c6-63a02d54b321 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.935s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:40.124248 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-77a0489a-7ce2-44a9-b4e8-0402b01ab1c1 req-091fcc2a-edf6-4d0f-a5a4-faedb7108c53 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-vif-plugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:40.125219 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-77a0489a-7ce2-44a9-b4e8-0402b01ab1c1 req-091fcc2a-edf6-4d0f-a5a4-faedb7108c53 service nova] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:40.130340 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-77a0489a-7ce2-44a9-b4e8-0402b01ab1c1 req-091fcc2a-edf6-4d0f-a5a4-faedb7108c53 service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:40.130537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-77a0489a-7ce2-44a9-b4e8-0402b01ab1c1 req-091fcc2a-edf6-4d0f-a5a4-faedb7108c53 service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:40.132572 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-77a0489a-7ce2-44a9-b4e8-0402b01ab1c1 req-091fcc2a-edf6-4d0f-a5a4-faedb7108c53 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] No waiting events found dispatching network-vif-plugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:40.132572 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-77a0489a-7ce2-44a9-b4e8-0402b01ab1c1 req-091fcc2a-edf6-4d0f-a5a4-faedb7108c53 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received unexpected event network-vif-plugged-cfb057e3-cb74-4043-93db-9aad57a412dc for instance with vm_state active and task_state None.
May 28 14:05:40.163932 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Successfully created port: 72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:05:40.182508 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.186483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:40.244239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:40.244458 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:40.244571 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:40.244759 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:cc:f3:b8, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:40.319835 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.324521 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:40.340026 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:05:40.452549 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.457590 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:40.476888 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:40.576846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.578154 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:40.695537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.704340 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:40.776632 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-changed-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:40.776856 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Refreshing instance network info cache due to event network-changed-cfb057e3-cb74-4043-93db-9aad57a412dc. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:40.779069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] Acquiring lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:40.779069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] Acquired lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:40.779069 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Refreshing network info cache for port cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:40.837981 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:40.859408 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.859943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:40.982329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:40.983475 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:05:40.984530 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:40.992161 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.058464 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Successfully updated port: 72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:05:41.108277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.109062 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.142906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:41.143688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:41.222949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.227679 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.283338 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:41.324661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.325230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.359727 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:05:41.362217 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:05:41.367512 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Creating image(s)
May 28 14:05:41.368438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "/opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:41.368762 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "/opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:41.369371 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "/opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:41.370015 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:41.378537 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:41.381855 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.431986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.436881 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:05:41.439705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.501430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.502487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:41.502954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:41.503392 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:41.506669 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:41.507019 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.567495 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:41.570642 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "refresh_cache-58824ea3-a859-43f6-a8f5-763cf1115f57" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:41.570791 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquired lock "refresh_cache-58824ea3-a859-43f6-a8f5-763cf1115f57" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:41.571633 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.572733 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:05:41.574888 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.610553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:41.611048 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:41.623879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.117s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.624252 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.661108 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'flavor' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:41.686250 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.692361 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:41.693433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.716359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk 1073741824" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.719771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:41.719771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.748871 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.760470 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12141MB free_disk=74.33284759521484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:05:41.760470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:41.761954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:41.829769 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.830279 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:05:41.831476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:41.880585 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updating instance_info_cache with network_info: [{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:41.886585 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a69bccf2-34a4-4f33-8ded-65c25b23595f tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.703s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:41.943634 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:41.947836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:41.949870 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Cannot resize image /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:05:41.950242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:05:41.950419 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Ensure instance console log exists: /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:05:41.950853 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:41.951118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:41.951118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:42.122681 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid 0cb5afe2-5125-4261-b2f3-f0431bc65134 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:42.149773 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Updated VIF entry in instance network info cache for port cfb057e3-cb74-4043-93db-9aad57a412dc. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:05:42.150488 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Updating instance_info_cache with network_info: [{"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:42.208350 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:05:42.317328 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-changed-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:42.317662 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Refreshing instance network info cache due to event network-changed-72439f87-1c22-41a2-b94e-abba578a54e6. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:05:42.319066 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] Acquiring lock "refresh_cache-58824ea3-a859-43f6-a8f5-763cf1115f57" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:42.388466 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Releasing lock "refresh_cache-0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:42.444474 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:42.643364 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Updating instance_info_cache with network_info: [{"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:42.653406 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-971119a8-296d-4a4c-a768-d9eb2bdb2fa5 req-a524b56e-5c02-4ac5-8424-f45b49efa3f5 service nova] Releasing lock "refresh_cache-67d9145b-f424-411a-b3aa-f1b56dc42f2b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:42.680167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.537s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:42.865952 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.866150 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 90b0ea10-2b38-4907-aa11-02454a817a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.866692 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 27823c45-9fce-41b2-923b-a5a907ef029c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.866882 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.867040 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.867187 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance b8315b4c-90be-498b-bdc8-1a775a1480bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.867703 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.867846 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.867972 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 58824ea3-a859-43f6-a8f5-763cf1115f57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:05:42.868209 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:05:42.868430 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:05:41 up 32 min,  2 users,  load average: 9.94, 6.83, 3.34\n', 'num_instances': '9', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_os_type_None': '9', 'num_proj_706c08c92c6844b3ab7b4019269eabad': '1', 'io_workload': '1', 'num_vm_active': '7', 'num_task_None': '7', 'num_proj_6a74849f3fb24097a5a42457746f02d2': '2', 'num_proj_ac4618bb9b554fb8af8f26aae95c016a': '3', 'num_proj_38e8657cdaa8482182b12ae39785f074': '1', 'num_proj_a792bdb63c954739ad33cb2fedeedee4': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_55f216176f6d4f43b4d9b887d97b5c16': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:05:43.128123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:43.146101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Releasing lock "refresh_cache-58824ea3-a859-43f6-a8f5-763cf1115f57" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:43.146101 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Instance network_info: |[{"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:05:43.146101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] Acquired lock "refresh_cache-58824ea3-a859-43f6-a8f5-763cf1115f57" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:43.146415 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Refreshing network info cache for port 72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:05:43.149195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Start _get_guest_xml network_info=[{"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:05:43.157345 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:43.162197 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1051464578', uuid='58824ea3-a859-43f6-a8f5-763cf1115f57'), owner=OwnerMeta(userid='5cd63519537b49cc88a46117da664f6a', username='tempest-VolumesActionsTest-95313981-project-member', projectid='55f216176f6d4f43b4d9b887d97b5c16', projectname='tempest-VolumesActionsTest-95313981'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977143.158502) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:05:43.169483 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:05:43.170238 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:05:43.173663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:05:43.173895 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:05:43.175284 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:05:43.175792 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:05:43.176000 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:05:43.176193 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:05:43.176279 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:05:43.176439 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:05:43.178803 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:05:43.179107 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:05:43.182579 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:05:43.182579 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:05:43.182579 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:05:43.182579 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:05:43.205964 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1051464578',display_name='tempest-VolumesActionsTest-instance-1051464578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-1051464578',id=28,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55f216176f6d4f43b4d9b887d97b5c16',ramdisk_id='',reservation_id='r-fydqje63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-95313981',owner_user_name='tempest-VolumesActionsTest-95313981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:40Z,user_data=None,user_id='5cd63519537b49cc88a46117da664f6a',uuid=58824ea3-a859-43f6-a8f5-763cf1115f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:05:43.206153 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converting VIF {"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:43.207041 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:70:97,bridge_name='br-int',has_traffic_filtering=True,id=72439f87-1c22-41a2-b94e-abba578a54e6,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72439f87-1c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:43.207923 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lazy-loading 'pci_devices' on Instance uuid 58824ea3-a859-43f6-a8f5-763cf1115f57 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:43.408431 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance destroyed successfully.
May 28 14:05:43.408871 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:43.466659 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:43.466969 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:43.654687 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:43.714677 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] End _get_guest_xml xml=<domain type="qemu">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <uuid>58824ea3-a859-43f6-a8f5-763cf1115f57</uuid>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <name>instance-0000001c</name>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesActionsTest-instance-1051464578</nova:name>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:05:43</nova:creationTime>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:user uuid="5cd63519537b49cc88a46117da664f6a">tempest-VolumesActionsTest-95313981-project-member</nova:user>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:project uuid="55f216176f6d4f43b4d9b887d97b5c16">tempest-VolumesActionsTest-95313981</nova:project>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         <nova:port uuid="72439f87-1c22-41a2-b94e-abba578a54e6">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <system>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <entry name="serial">58824ea3-a859-43f6-a8f5-763cf1115f57</entry>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <entry name="uuid">58824ea3-a859-43f6-a8f5-763cf1115f57</entry>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </system>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <os>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   </os>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <features>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   </features>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   <devices>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk.config"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:bd:70:97"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <target dev="tap72439f87-1c"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </interface>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/console.log" append="off"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </serial>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <video>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </video>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </rng>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:   </devices>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]: </domain>
May 28 14:05:43.714677 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Preparing to wait for external event network-vif-plugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:05:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1051464578',display_name='tempest-VolumesActionsTest-instance-1051464578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-1051464578',id=28,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55f216176f6d4f43b4d9b887d97b5c16',ramdisk_id='',reservation_id='r-fydqje63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-95313981',owner_user_name='tempest-VolumesActionsTest-95313981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:40Z,user_data=None,user_id='5cd63519537b49cc88a46117da664f6a',uuid=58824ea3-a859-43f6-a8f5-763cf1115f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converting VIF {"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:70:97,bridge_name='br-int',has_traffic_filtering=True,id=72439f87-1c22-41a2-b94e-abba578a54e6,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72439f87-1c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:43.719625 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:70:97,bridge_name='br-int',has_traffic_filtering=True,id=72439f87-1c22-41a2-b94e-abba578a54e6,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72439f87-1c') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:05:43.722708 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:43.723747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:43.724105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:05:43.725637 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:43.725925 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77d25e33-66be-5a7d-ba60-7a86834dded2', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:43.728405 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:43.733924 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:43.736724 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:43.736970 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72439f87-1c, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:43.737507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72439f87-1c, col_values=(('qos', UUID('75e5d10e-401c-414f-8e9f-1495757cc7c3')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:43.737709 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72439f87-1c, col_values=(('external_ids', {'iface-id': '72439f87-1c22-41a2-b94e-abba578a54e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:70:97', 'vm-uuid': '58824ea3-a859-43f6-a8f5-763cf1115f57'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:43.739719 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:43.741654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:43.753532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:43.753532 np0000001643 nova-compute[98269]: INFO os_vif [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:70:97,bridge_name='br-int',has_traffic_filtering=True,id=72439f87-1c22-41a2-b94e-abba578a54e6,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72439f87-1c')
May 28 14:05:43.771523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:43.771768 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:43.771945 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Attaching volume e6d17c2a-e75e-4c20-b161-33662ed99965 to /dev/vdb
May 28 14:05:43.831597 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:43.853474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:05:43.876884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:43.912374 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:43.919599 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'resources' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:43.921971 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:05:43.922291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:05:43.934563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:05:43.934563 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:feab:25f1', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60'] 
May 28 14:05:43.934752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:05:43.934851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:05:43.935114 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:43.935401 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating existing volume attachment record: a79dbb0e-491f-4963-b0da-ef6116427c4c {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:05:43.971572 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:44.059637 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:44.206696 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:44.207260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:44.207260 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Attaching volume 81237ce9-250e-4283-8767-236dd4c25fdd to /dev/vdb
May 28 14:05:44.260173 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Updated VIF entry in instance network info cache for port 72439f87-1c22-41a2-b94e-abba578a54e6. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:05:44.261490 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:44.261920 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Updating instance_info_cache with network_info: [{"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:44.276683 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:05:44.299027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:44.346300 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:05:44.348741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:05:44.361688 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:05:44.363379 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:feab:25f1', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60'] 
May 28 14:05:44.364254 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:05:44.364460 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:05:44.366732 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:44.366732 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updating existing volume attachment record: 8cab0c18-5e5d-42f5-a43d-a6e4036c221d {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:05:44.401285 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:44.424789 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:44.425470 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:44.425811 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:44.429907 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:44.429907 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:44.429907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:44.429907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd542e8b-1f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:44.432825 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:44.438626 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:44.440139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:44.440402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b88f17ac-5944-49a5-be4b-2e986c54d6ee) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:44.442055 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:44.451008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:44.453867 np0000001643 nova-compute[98269]: INFO os_vif [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f')
May 28 14:05:44.461266 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Start _get_guest_xml network_info=[{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:05:44.465465 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:44.466977 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1095431235', uuid='0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc'), owner=OwnerMeta(userid='d2ab771f08c245c7a7dffca595835dba', username='tempest-AttachVolumeTestJSON-1658324310-project-member', projectid='706c08c92c6844b3ab7b4019269eabad', projectname='tempest-AttachVolumeTestJSON-1658324310'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977144.4665632) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:05:44.468199 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:05:44.469242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:05:44.470784 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:05:44.470974 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:05:44.472188 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:05:44.472513 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:05:44.473218 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:05:44.473218 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:05:44.473218 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:05:44.473218 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:05:44.473218 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:05:44.473484 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:05:44.473484 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:05:44.474612 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:05:44.477091 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:05:44.477091 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:05:44.477091 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:44.485989 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:05:44.486206 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.725s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:44.486708 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.48 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:05:44.527563 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:05:44.528022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:44.528222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:44.529293 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:44.529562 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:05:44.543792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:44.550274 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:44.551046 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:44.551661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:44.552501 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:44.552929 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:05:44.553397 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:05:44.566487 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:05:44.566487 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:44.576841 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:05:44.576841 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:44.587491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965] added
May 28 14:05:44.587491 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:05:44.587491 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:44.587491 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:44.587491 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:44.587491 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:44.587491 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:44.587931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:05:44.588137 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:05:44.588295 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:05:44.591155 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965] added
May 28 14:05:44.591155 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:05:44.591155 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:44.591155 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:44.591155 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:44.591155 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:44.591155 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:44.591619 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:05:44.591619 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:05:44.591732 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:05:44.764376 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bb39f0cd-d7aa-4228-935e-efa385a82553 req-e06f4656-2e64-4f6e-8a9c-8770a453ea26 service nova] Releasing lock "refresh_cache-58824ea3-a859-43f6-a8f5-763cf1115f57" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:44.929839 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:05:44.930326 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:44.930555 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:44.978858 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:44.991026 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:05:44.991357 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:44.991798 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:44.992461 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:45.275334 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:45.275759 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:45.275759 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] No VIF found with MAC fa:16:3e:bd:70:97, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:45.276163 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Using config drive
May 28 14:05:45.494717 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:45.495526 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] End _get_guest_xml xml=<domain type="qemu">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <uuid>0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</uuid>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <name>instance-0000000f</name>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeTestJSON-server-1095431235</nova:name>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:05:44</nova:creationTime>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:user uuid="d2ab771f08c245c7a7dffca595835dba">tempest-AttachVolumeTestJSON-1658324310-project-member</nova:user>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:project uuid="706c08c92c6844b3ab7b4019269eabad">tempest-AttachVolumeTestJSON-1658324310</nova:project>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         <nova:port uuid="bd542e8b-1f1b-4e59-8c1b-fe44bfd93140">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <system>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <entry name="serial">0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</entry>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <entry name="uuid">0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc</entry>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </system>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <os>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   </os>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <features>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   </features>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   <devices>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk.config"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </disk>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:16:45:16"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <target dev="tapbd542e8b-1f"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </interface>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/console.log" append="off"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </serial>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <video>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </video>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </rng>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:   </devices>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]: </domain>
May 28 14:05:45.495526 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:05:45.498158 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:45.589278 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:05:45.592251 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:05:45.600222 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:45.600222 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:05:45.614361 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:05:45.614361 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:05:45.618983 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:05:45.618983 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.629031 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.631761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.649129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.649129 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.649129 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.649129 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.649129 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:45.650043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.650043 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.650043 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.650043 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.650043 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:45.651189 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.651189 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.651189 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.651189 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.651189 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:45.651476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.651476 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.651476 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.651476 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.651476 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:45.687209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.40.100,3260]
May 28 14:05:45.687209 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.40.100,3260] successful.
May 28 14:05:45.687209 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.696244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.50.100,3260]
May 28 14:05:45.696244 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.50.100,3260] successful.
May 28 14:05:45.696244 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.701475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.709706 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:45.711644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:45.713974 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:45.722954 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.722954 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.722954 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.722954 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.722954 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.722954 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.722954 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:45.723375 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.723375 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.723375 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.723375 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.723375 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.723375 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.723375 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:45.723912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:45.723912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:05:45.724787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] HCTL ('11', '-', '-', 0) found on session 45 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:05:45.725193 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:05:45.732007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.732007 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.732007 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.732007 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.732007 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.732007 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.732007 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:45.732344 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.732344 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:45.732344 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.732344 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:45.732344 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.732344 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:45.732344 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:45.732595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:45.732595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:05:45.737313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] HCTL ('12', '-', '-', 0) found on session 46 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:05:45.737562 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:05:45.751930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching for a device in session 45 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:05:45.751930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:05:45.763138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching for a device in session 46 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:05:45.763138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:05:45.786022 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:45.963476 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Creating config drive at /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk.config
May 28 14:05:45.967122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmponm5b02v {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:45.983637 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.025675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmponm5b02v" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:46.217143 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:46.218293 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:46.307774 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:46.308190 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:05:46.308375 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:46.416468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:46.416468 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Cannot resize image /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:05:46.416468 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'migration_context' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:46.502791 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.535688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.536274 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.558145 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:05:46.633063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.907353 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.912129 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.915534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.915534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.917606 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Object Instance<0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4429436-e6bf-56b1-90db-da3d24573a22', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.927396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:46.943011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.947430 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.949233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd542e8b-1f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:46.949869 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd542e8b-1f, col_values=(('qos', UUID('09b6ad14-9527-4452-9fc9-5cfaf437d958')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:46.950228 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd542e8b-1f, col_values=(('external_ids', {'iface-id': 'bd542e8b-1f1b-4e59-8c1b-fe44bfd93140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:45:16', 'vm-uuid': '0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:46.953424 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:46.959424 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:46.960902 np0000001643 nova-compute[98269]: INFO os_vif [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f')
May 28 14:05:47.502206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:47.534900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:47.535976 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:47.581662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Found WWN 3300000006b06ae27 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:05:47.582477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:47.582861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] <== connect_volume: return (3053ms) {'type': 'block', 'scsi_wwn': '3300000006b06ae27', 'path': '/dev/dm-4', 'multipath_id': '3300000006b06ae27'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:47.583814 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006b06ae27', 'path': '/dev/dm-4', 'multipath_id': '3300000006b06ae27'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:05:47.585355 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.654s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:47.585765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:05:47.588310 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977147.5878708, 58824ea3-a859-43f6-a8f5-763cf1115f57 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:47.592522 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] VM Started (Lifecycle Event)
May 28 14:05:47.594039 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'flavor' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:47.607008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:47.607416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:47.607700 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:05:47.608482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:47.610269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:47.610269 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:05:47.627123 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:05:47.627123 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:05:47.636144 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:05:47.636144 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:47.649909 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:47.656047 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:47.656666 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:47.679838 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.679838 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.679838 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.679838 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.679838 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.679838 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.679838 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:47.680107 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.680107 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.680107 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.680107 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.680107 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.680107 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.680107 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:47.680588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:47.680588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:05:47.681217 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('7', '0', '0', 0) found on session 43 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:05:47.681352 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:05:47.691104 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:05:47.692812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.083s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:47.692812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:05:47.692812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('8', '0', '0', 0) found on session 44 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:05:47.692812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:05:47.704119 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 43 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:05:47.704332 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:05:47.707850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 44 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:05:47.708127 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:05:47.743238 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b5d0ebe8-f8b1-4506-9461-2529caed0915 req-99ad1ac5-c56d-4eb4-ab3a-693e794529c3 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:47.743895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b5d0ebe8-f8b1-4506-9461-2529caed0915 req-99ad1ac5-c56d-4eb4-ab3a-693e794529c3 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:47.744106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b5d0ebe8-f8b1-4506-9461-2529caed0915 req-99ad1ac5-c56d-4eb4-ab3a-693e794529c3 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:47.744264 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b5d0ebe8-f8b1-4506-9461-2529caed0915 req-99ad1ac5-c56d-4eb4-ab3a-693e794529c3 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:47.744493 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b5d0ebe8-f8b1-4506-9461-2529caed0915 req-99ad1ac5-c56d-4eb4-ab3a-693e794529c3 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:47.744616 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b5d0ebe8-f8b1-4506-9461-2529caed0915 req-99ad1ac5-c56d-4eb4-ab3a-693e794529c3 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state stopped and task_state powering-on.
May 28 14:05:47.969525 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:47.988270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:48.094829 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:48.097674 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977148.0971267, 58824ea3-a859-43f6-a8f5-763cf1115f57 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:48.098935 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] VM Paused (Lifecycle Event)
May 28 14:05:48.101990 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Attempting to attach volume e6d17c2a-e75e-4c20-b161-33662ed99965 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:05:48.103396 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:05:48.103396 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:48.103396 np0000001643 nova-compute[98269]:   <alias name="ua-e6d17c2a-e75e-4c20-b161-33662ed99965"/>
May 28 14:05:48.103396 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:05:48.103396 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:48.103396 np0000001643 nova-compute[98269]:   <serial>e6d17c2a-e75e-4c20-b161-33662ed99965</serial>
May 28 14:05:48.103396 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:48.103396 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:05:48.238135 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:48.601786 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:48.607960 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:48.612263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:05:48.649868 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:05:48.654982 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance rebooted successfully.
May 28 14:05:49.113822 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:05:49.113822 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc due to new event <LifecycleEvent: 1779977149.1133373, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:05:49.113822 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977149.1133373, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:49.114928 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Resumed (Lifecycle Event)
May 28 14:05:49.406205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:49.616976 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:49.620836 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:49.634559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 3300000004156ad88 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:05:49.634985 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.050s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:05:49.635225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (4704ms) {'type': 'block', 'scsi_wwn': '3300000004156ad88', 'path': '/dev/dm-0', 'multipath_id': '3300000004156ad88'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:49.635408 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004156ad88', 'path': '/dev/dm-0', 'multipath_id': '3300000004156ad88'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:05:49.638391 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid 0cb5afe2-5125-4261-b2f3-f0431bc65134 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:49.801910 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:49.802112 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:49.802611 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:49.802778 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No VIF found with MAC fa:16:3e:5f:89:50, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:49.812789 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2358a8c8-bf2b-4b93-b491-ed871967fda2 req-86aec7a4-59ed-4e34-9d19-fcac666bee03 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:49.812789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2358a8c8-bf2b-4b93-b491-ed871967fda2 req-86aec7a4-59ed-4e34-9d19-fcac666bee03 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:49.812789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2358a8c8-bf2b-4b93-b491-ed871967fda2 req-86aec7a4-59ed-4e34-9d19-fcac666bee03 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:49.812914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2358a8c8-bf2b-4b93-b491-ed871967fda2 req-86aec7a4-59ed-4e34-9d19-fcac666bee03 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:49.813056 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2358a8c8-bf2b-4b93-b491-ed871967fda2 req-86aec7a4-59ed-4e34-9d19-fcac666bee03 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:49.813165 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2358a8c8-bf2b-4b93-b491-ed871967fda2 req-86aec7a4-59ed-4e34-9d19-fcac666bee03 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received unexpected event network-vif-plugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with vm_state stopped and task_state powering-on.
May 28 14:05:50.125084 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 14:05:50.125084 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977150.1231318, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:50.125084 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Started (Lifecycle Event)
May 28 14:05:50.143873 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Attempting to attach volume 81237ce9-250e-4283-8767-236dd4c25fdd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:05:50.145307 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:05:50.145307 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:50.145307 np0000001643 nova-compute[98269]:   <alias name="ua-81237ce9-250e-4283-8767-236dd4c25fdd"/>
May 28 14:05:50.145307 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:50.145307 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:50.145307 np0000001643 nova-compute[98269]:   <serial>81237ce9-250e-4283-8767-236dd4c25fdd</serial>
May 28 14:05:50.145307 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:50.145307 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:50.145307 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:05:50.165718 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:50.165934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:50.166056 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No VIF found with MAC fa:16:3e:16:45:16, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:50.166414 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3b2d4294-3692-4e70-a568-15e0e3f71035 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:50.606761 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c71cca38-f381-40d4-b85f-8c44cc73874b req-967612a6-c13e-4699-8faa-fba11bef3b72 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-vif-plugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:50.607227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c71cca38-f381-40d4-b85f-8c44cc73874b req-967612a6-c13e-4699-8faa-fba11bef3b72 service nova] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:50.607370 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c71cca38-f381-40d4-b85f-8c44cc73874b req-967612a6-c13e-4699-8faa-fba11bef3b72 service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:50.607556 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c71cca38-f381-40d4-b85f-8c44cc73874b req-967612a6-c13e-4699-8faa-fba11bef3b72 service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:50.607701 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c71cca38-f381-40d4-b85f-8c44cc73874b req-967612a6-c13e-4699-8faa-fba11bef3b72 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Processing event network-vif-plugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:05:50.608024 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:05:50.613465 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:05:50.616190 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Instance spawned successfully.
May 28 14:05:50.616770 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:05:50.628678 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:50.631394 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:51.130410 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:51.130637 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:51.131159 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:51.131600 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:51.132107 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:51.133927 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:05:51.139246 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:51.153618 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977151.1532414, 58824ea3-a859-43f6-a8f5-763cf1115f57 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:05:51.153790 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] VM Resumed (Lifecycle Event)
May 28 14:05:51.371483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33b581e5-180a-48d1-b175-4cd6450b8795 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.598s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:51.655074 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Took 10.30 seconds to spawn the instance on the hypervisor.
May 28 14:05:51.656199 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:51.662378 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:05:51.665509 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:05:51.840554 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:51.840758 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:51.840924 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:05:51.841071 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:cc:16:34, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:05:51.952321 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:52.027464 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Rescuing
May 28 14:05:52.027683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:05:52.027864 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquired lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:05:52.028046 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:05:52.166899 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Took 16.08 seconds to build instance.
May 28 14:05:52.174347 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:05:52.531264 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:52.668544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bee3c539-b7de-49ee-85a3-489bc8e9ff6e tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.596s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:52.689487 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d60ce385-2269-46df-a732-37ef2fb4fc7b req-7c926acc-28d2-4795-b1d4-df37d89f605d service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-vif-plugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:52.690971 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d60ce385-2269-46df-a732-37ef2fb4fc7b req-7c926acc-28d2-4795-b1d4-df37d89f605d service nova] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:52.691290 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d60ce385-2269-46df-a732-37ef2fb4fc7b req-7c926acc-28d2-4795-b1d4-df37d89f605d service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:52.691675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d60ce385-2269-46df-a732-37ef2fb4fc7b req-7c926acc-28d2-4795-b1d4-df37d89f605d service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:52.691746 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d60ce385-2269-46df-a732-37ef2fb4fc7b req-7c926acc-28d2-4795-b1d4-df37d89f605d service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] No waiting events found dispatching network-vif-plugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:52.691928 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-d60ce385-2269-46df-a732-37ef2fb4fc7b req-7c926acc-28d2-4795-b1d4-df37d89f605d service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received unexpected event network-vif-plugged-72439f87-1c22-41a2-b94e-abba578a54e6 for instance with vm_state active and task_state None.
May 28 14:05:52.850270 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.000793253999972876 future=<Future at 0x71a75c36ddf0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:52.850662 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:52.941333 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:53.123019 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:53.411155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf995e74-14a5-46d7-a96e-0cf4f7f153bc tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.204s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:53.625184 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Releasing lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:05:54.408038 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:54.492172 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:54.492437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:54.516130 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:54.516130 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:54.516388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:54.516661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:54.516797 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:54.521604 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Terminating instance
May 28 14:05:54.995160 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Detaching volume 81237ce9-250e-4283-8767-236dd4c25fdd
May 28 14:05:55.025834 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:05:55.046046 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Attempting to driver detach volume 81237ce9-250e-4283-8767-236dd4c25fdd from mountpoint /dev/vdb
May 28 14:05:55.051200 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.055266 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.063629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-81237ce9-250e-4283-8767-236dd4c25fdd {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:55.068196 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-81237ce9-250e-4283-8767-236dd4c25fdd {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:55.068196 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Attempting to detach device vdb from instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:05:55.068309 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:   <alias name="ua-81237ce9-250e-4283-8767-236dd4c25fdd"/>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:   <serial>81237ce9-250e-4283-8767-236dd4c25fdd</serial>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:55.068309 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:55.083681 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 from the persistent domain config.
May 28 14:05:55.083681 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] (1/8): Attempting to detach device vdb with device alias ua-81237ce9-250e-4283-8767-236dd4c25fdd from instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:05:55.083681 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:   <alias name="ua-81237ce9-250e-4283-8767-236dd4c25fdd"/>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:   <serial>81237ce9-250e-4283-8767-236dd4c25fdd</serial>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:55.083681 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:55.083681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.089126 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.121724 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.263973 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f7e540df-f4a4-4431-aba3-b88a71258b79 req-a78446dc-dd77-458e-b9b7-64ee721fc067 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-vif-unplugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:55.266273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f7e540df-f4a4-4431-aba3-b88a71258b79 req-a78446dc-dd77-458e-b9b7-64ee721fc067 service nova] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:55.266273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f7e540df-f4a4-4431-aba3-b88a71258b79 req-a78446dc-dd77-458e-b9b7-64ee721fc067 service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:55.266273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f7e540df-f4a4-4431-aba3-b88a71258b79 req-a78446dc-dd77-458e-b9b7-64ee721fc067 service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:55.266273 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f7e540df-f4a4-4431-aba3-b88a71258b79 req-a78446dc-dd77-458e-b9b7-64ee721fc067 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] No waiting events found dispatching network-vif-unplugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:55.266273 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f7e540df-f4a4-4431-aba3-b88a71258b79 req-a78446dc-dd77-458e-b9b7-64ee721fc067 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-vif-unplugged-72439f87-1c22-41a2-b94e-abba578a54e6 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:55.269229 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.276234 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.300024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.303233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.334621 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.335957 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.408532 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99965624299989 future=<Future at 0x71a75c30e360 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:55.409804 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998512020999897 future=<Future at 0x71a75c30e360 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:55.409804 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99832007000009 future=<Future at 0x71a75c30e360 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:55.412650 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Instance destroyed successfully.
May 28 14:05:55.413674 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lazy-loading 'resources' on Instance uuid 58824ea3-a859-43f6-a8f5-763cf1115f57 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:55.717551 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977155.7172012, cfa684f7-1fb1-4e0f-bf60-3c42614b2670 => ua-81237ce9-250e-4283-8767-236dd4c25fdd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:05:55.717825 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999823967999873 future=<Future at 0x71a75c30cfe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:05:55.720078 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-81237ce9-250e-4283-8767-236dd4c25fdd for instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:05:55.721838 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance destroyed successfully.
May 28 14:05:55.722866 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'numa_topology' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:55.724662 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 from the live domain config.
May 28 14:05:55.918918 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:05:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1051464578',display_name='tempest-VolumesActionsTest-instance-1051464578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-1051464578',id=28,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:05:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55f216176f6d4f43b4d9b887d97b5c16',ramdisk_id='',reservation_id='r-fydqje63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-95313981',owner_user_name='tempest-VolumesActionsTest-95313981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:05:52Z,user_data=None,user_id='5cd63519537b49cc88a46117da664f6a',uuid=58824ea3-a859-43f6-a8f5-763cf1115f57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:05:55.919182 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converting VIF {"id": "72439f87-1c22-41a2-b94e-abba578a54e6", "address": "fa:16:3e:bd:70:97", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72439f87-1c", "ovs_interfaceid": "72439f87-1c22-41a2-b94e-abba578a54e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:05:55.920009 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:70:97,bridge_name='br-int',has_traffic_filtering=True,id=72439f87-1c22-41a2-b94e-abba578a54e6,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72439f87-1c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:05:55.920214 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:70:97,bridge_name='br-int',has_traffic_filtering=True,id=72439f87-1c22-41a2-b94e-abba578a54e6,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72439f87-1c') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:05:55.922114 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.922727 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72439f87-1c, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:55.924945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:55.926600 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:55.926954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:55.934132 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.936527 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.936527 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75e5d10e-401c-414f-8e9f-1495757cc7c3) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:05:55.937080 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.937897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:05:55.944275 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:55.946918 np0000001643 nova-compute[98269]: INFO os_vif [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:70:97,bridge_name='br-int',has_traffic_filtering=True,id=72439f87-1c22-41a2-b94e-abba578a54e6,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72439f87-1c')
May 28 14:05:55.947243 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Deleting instance files /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57_del
May 28 14:05:55.947935 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Deletion of /opt/stack/data/nova/instances/58824ea3-a859-43f6-a8f5-763cf1115f57_del complete
May 28 14:05:56.227514 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Attempting a stable device rescue
May 28 14:05:56.284075 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Detected multiple connections on this host for volume: 81237ce9-250e-4283-8767-236dd4c25fdd, skipping target disconnect.
May 28 14:05:56.361971 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 14:05:56.365684 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:05:56.365843 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Creating image(s)
May 28 14:05:56.366525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:56.366749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:56.367311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:56.367519 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:56.434084 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'flavor' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:56.453953 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 14:05:56.455001 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:05:56.455330 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:05:56.455489 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:05:56.455920 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:56.532359 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:05:56.856511 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid cfa684f7-1fb1-4e0f-bf60-3c42614b2670 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:56.869248 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:56.869541 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "45d209954120862597b4e05919d1830a7b151743" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:56.869952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "45d209954120862597b4e05919d1830a7b151743" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:56.874398 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0a28f6c-316f-430a-b828-73f673c15802 req-83921cc7-9465-4a73-8a17-b038827283e1 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-vif-deleted-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:56.875161 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-e0a28f6c-316f-430a-b828-73f673c15802 req-83921cc7-9465-4a73-8a17-b038827283e1 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Neutron deleted interface 72439f87-1c22-41a2-b94e-abba578a54e6; detaching it from the instance and deleting it from the info cache
May 28 14:05:56.877932 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e0a28f6c-316f-430a-b828-73f673c15802 req-83921cc7-9465-4a73-8a17-b038827283e1 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Detach interface failed, port_id=72439f87-1c22-41a2-b94e-abba578a54e6, reason: Instance 58824ea3-a859-43f6-a8f5-763cf1115f57 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:05:57.305822 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:05:57.391836 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-vif-unplugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:57.392065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Acquiring lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:57.395975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:57.398421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:57.398421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] No waiting events found dispatching network-vif-unplugged-72439f87-1c22-41a2-b94e-abba578a54e6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:57.398421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Received event network-vif-unplugged-72439f87-1c22-41a2-b94e-abba578a54e6 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:05:57.399040 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:57.399643 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:57.400193 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:57.400614 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:57.400669 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:57.400934 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state active and task_state rescuing.
May 28 14:05:57.401019 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:05:57.401293 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:57.401467 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:57.401668 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:57.402028 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:05:57.402028 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8d7238fc-7bbe-4f9d-b6c1-ef1713c216ed req-ed1eedc5-3540-4667-9c7e-700ccebfd901 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state active and task_state rescuing.
May 28 14:05:57.446083 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:57.811689 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Took 1.36 seconds to deallocate network for instance.
May 28 14:05:57.870948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f04eba1e-9d01-41b7-9321-5da1d30ef739 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.378s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:58.104059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:58.104816 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:58.113008 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:58.116186 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:58.116944 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:58.220164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.part --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:58.220728 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] 7fbda62f-9559-4afc-a001-61d161426491 was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:05:58.221746 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:05:58.222145 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.part /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:58.322427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:58.322974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:58.527769 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.part /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.converted" returned: 0 in 0.305s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:58.547055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:58.588939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:58.589476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:58.590146 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attaching volume 83919653-256c-49d2-bfc5-5d52203ab840 to /dev/vdb
May 28 14:05:58.612477 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Detaching volume 81237ce9-250e-4283-8767-236dd4c25fdd
May 28 14:05:58.671142 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:58.671715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743.converted --force-share --output=json" returned: 0 in 0.125s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:58.675536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "45d209954120862597b4e05919d1830a7b151743" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.802s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:58.677349 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:58.681920 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:58.683500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "45d209954120862597b4e05919d1830a7b151743" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:05:58.684089 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "45d209954120862597b4e05919d1830a7b151743" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:05:58.684839 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:58.690557 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:05:58.691104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:58.710367 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:05:58.712251 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Attempting to driver detach volume 81237ce9-250e-4283-8767-236dd4c25fdd from mountpoint /dev/vdb
May 28 14:05:58.743260 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-81237ce9-250e-4283-8767-236dd4c25fdd {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:58.747145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-81237ce9-250e-4283-8767-236dd4c25fdd {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:05:58.747145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Attempting to detach device vdb from instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:05:58.747145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:   <alias name="ua-81237ce9-250e-4283-8767-236dd4c25fdd"/>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:   <serial>81237ce9-250e-4283-8767-236dd4c25fdd</serial>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:58.747145 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:58.748531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:58.780004 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 from the persistent domain config.
May 28 14:05:58.780756 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] (1/8): Attempting to detach device vdb with device alias ua-81237ce9-250e-4283-8767-236dd4c25fdd from instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:05:58.781902 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:   <alias name="ua-81237ce9-250e-4283-8767-236dd4c25fdd"/>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:   <serial>81237ce9-250e-4283-8767-236dd4c25fdd</serial>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]: </disk>
May 28 14:05:58.781902 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:05:58.804049 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743 --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:58.805129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743,backing_fmt=raw /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.rescue {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:05:58.821540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:05:58.831896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:05:58.845260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:05:58.848023 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:feab:25f1', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a'] 
May 28 14:05:58.849035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:05:58.849035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:05:58.849035 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:05:58.849710 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updating existing volume attachment record: 1903e719-aa73-49aa-91a3-d5f55f387878 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:05:58.889058 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743,backing_fmt=raw /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.rescue" returned: 0 in 0.084s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:05:58.889865 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "45d209954120862597b4e05919d1830a7b151743" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:05:58.889865 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'migration_context' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:59.068756 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:05:59.069066 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:05:59.393809 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:59.394148 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:05:59.399167 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Start _get_guest_xml network_info=[{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "vif_mac": "fa:16:3e:5f:89:50"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fbda62f-9559-4afc-a001-61d161426491', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'a79dbb0e-491f-4963-b0da-ef6116427c4c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '8584659f-147f-4b78-ad59-e0eebdb9aaf3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'serial': 'e6d17c2a-e75e-4c20-b161-33662ed99965'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:05:59.399167 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'resources' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:05:59.417003 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:05:59.428528 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:05:59.430098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:05:59.430356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:59.430711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:59.430952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:05:59.447226 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:59.447818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:59.448159 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:05:59.454701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:05:59.455246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:05:59.455440 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:05:59.466798 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:05:59.466798 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:59.477256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:05:59.477256 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:59.483309 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840] added
May 28 14:05:59.483309 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:05:59.483309 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:59.483309 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:59.483309 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:59.483309 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:59.483309 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:59.483700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:05:59.483700 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:05:59.483800 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:05:59.494019 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840] added
May 28 14:05:59.494019 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:05:59.494019 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:59.494019 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:59.494019 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:05:59.494019 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:05:59.494019 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:05:59.494221 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:05:59.494503 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:05:59.495109 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:05:59.572131 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:05:59.901069 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:05:59.903991 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:05:59.905713 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-294841717', uuid='8584659f-147f-4b78-ad59-e0eebdb9aaf3'), owner=OwnerMeta(userid='01855887e3a0438bbe84fb9664132ad1', username='tempest-ServerStableDeviceRescueTest-456151526-project-member', projectid='38e8657cdaa8482182b12ae39785f074', projectname='tempest-ServerStableDeviceRescueTest-456151526'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "vif_mac": "fa:16:3e:5f:89:50"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977159.9052713) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:05:59.906917 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:05:59.907300 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:05:59.908211 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:05:59.908382 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:05:59.909361 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:05:59.909952 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:05:59.909952 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:05:59.910085 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:05:59.910194 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:05:59.910315 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:05:59.910441 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:05:59.910681 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:05:59.910803 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:05:59.910971 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:05:59.911223 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:05:59.911274 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:05:59.911472 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:00.084793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.762s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:00.151007 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Deleted allocations for instance 58824ea3-a859-43f6-a8f5-763cf1115f57
May 28 14:06:00.415776 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:06:00.429823 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:00.485428 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:00.495279 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:00.505713 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:00.505713 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:00.515475 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:00.515475 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.519400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:00.519400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:00.519400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:00.519400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:00.519400 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:06:00.519400 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:00.519400 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:00.521677 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.531850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.539334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.539334 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.539334 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.539334 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.539334 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.539334 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.539334 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:00.540232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.540232 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.540232 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.540232 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.540232 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.540232 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.540232 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:00.546890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.546890 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.546890 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.546890 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.546890 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.546890 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.546890 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:00.547232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.547232 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.547232 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.547232 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.547232 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.547232 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.547232 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:00.585209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260]
May 28 14:06:00.585209 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260] successful.
May 28 14:06:00.585209 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.597679 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.601312 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260]
May 28 14:06:00.601312 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260] successful.
May 28 14:06:00.601312 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.616537 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.619022 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.619561 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:00.619866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:00.619866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:00.620812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('13', '-', '-', 0) found on session 47 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:00.621075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.637615 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:00.638261 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:00.638261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:00.639457 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('14', '-', '-', 0) found on session 48 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:00.643095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:00.643095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 47 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:00.643095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:00.659636 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 48 and hctl ['14', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:00.937835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:01.163559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7be62bf4-2802-4f01-a0e8-3b0eb3a34ce8 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "58824ea3-a859-43f6-a8f5-763cf1115f57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.647s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:01.660148 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 48 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:01.660438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:01.915546 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977161.9150565, 0cb5afe2-5125-4261-b2f3-f0431bc65134 => ua-81237ce9-250e-4283-8767-236dd4c25fdd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:06:01.916369 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-81237ce9-250e-4283-8767-236dd4c25fdd for instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:06:01.919602 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 from the live domain config.
May 28 14:06:01.959431 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:06:01.959877 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:01.959989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:02.472265 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Found WWN 330000000179b7052 for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:02.472644 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:02.472900 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000179b7052', 'path': '/dev/dm-5', 'multipath_id': '330000000179b7052'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:02.473178 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000179b7052', 'path': '/dev/dm-5', 'multipath_id': '330000000179b7052'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:02.473523 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.955s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:02.473829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:06:02.475785 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'flavor' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:02.486939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:02.487643 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:02.488603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:02.489274 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:02.489662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:02.489945 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:02.504436 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:02.504436 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:02.512532 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:02.512532 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:02.517236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:02.527651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.537387 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.047s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] HCTL ('11', '0', '0', 0) found on session 45 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:02.537387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:02.544254 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching for a device in session 45 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:02.546157 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:02.547753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:02.547753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:02.547753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] HCTL ('12', '0', '0', 0) found on session 46 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:02.547753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:02.559275 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Searching for a device in session 46 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:02.559430 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:02.909102 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:02.910045 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:02.981726 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attempting to attach volume 83919653-256c-49d2-bfc5-5d52203ab840 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:06:02.983106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:06:02.983106 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:02.983106 np0000001643 nova-compute[98269]:   <alias name="ua-83919653-256c-49d2-bfc5-5d52203ab840"/>
May 28 14:06:02.983106 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:06:02.983106 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:02.983106 np0000001643 nova-compute[98269]:   <serial>83919653-256c-49d2-bfc5-5d52203ab840</serial>
May 28 14:06:02.983106 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:02.983106 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:06:03.411854 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:06:03.489301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:06:03.976732 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:03.977215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:03.980367 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:06:03.980587 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Claim successful on node np0000001643
May 28 14:06:04.419472 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:04.509904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Found WWN 3300000006b06ae27 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:04.510263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:04.510472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] <== connect_volume: return (3991ms) {'type': 'block', 'scsi_wwn': '3300000006b06ae27', 'path': '/dev/dm-4', 'multipath_id': '3300000006b06ae27'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:04.510785 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006b06ae27', 'path': '/dev/dm-4', 'multipath_id': '3300000006b06ae27'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:04.511290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.551s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:04.511836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81237ce9-250e-4283-8767-236dd4c25fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:06:04.512112 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:04.548003 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:04.548376 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '48')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:06:04.548376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', '43')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:04.549954 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd', '44')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:04.551059 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781a62a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:06:04.551522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:06:04.551609 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flush multipath device 3300000004156ad88 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:06:04.594381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:04.640195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:04.640195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:04.640195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:04.640408 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No VIF found with MAC fa:16:3e:ab:25:f1, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:04.651145 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:04.695229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:06:04.695676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:06:04.697233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:06:04.710661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:06:04.711072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:06:04.726596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:04.765781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.40.100,3260]
May 28 14:06:04.765781 np0000001643 nova-compute[98269]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.40.100,3260] successful.
May 28 14:06:04.765781 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:04.788669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:04.806712 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:04.840939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.50.100,3260]
May 28 14:06:04.840939 np0000001643 nova-compute[98269]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-81237ce9-250e-4283-8767-236dd4c25fdd, portal: 192.168.50.100,3260] successful.
May 28 14:06:04.840939 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:04.857493 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:04.857911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:04.858094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== disconnect_volume: return (2898ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:04.858481 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:06:05.018414 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-294841717',display_name='tempest-ServerStableDeviceRescueTest-server-294841717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverstabledevicerescuetest-server-294841717',id=23,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0NOTH30hDWSiHEniaN0RC5oWheCyp/m3BonLN/TN1md0y7tPyNxh4sAnGG+z2B7LwUqdQHyPvX8A7mOyGnWq+aFvvM6+hI6nlYEMk1CjTlbq7QgfcIKB9Pbgk76U14Fw==',key_name='tempest-keypair-1832891856',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:04:52Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38e8657cdaa8482182b12ae39785f074',ramdisk_id='',reservation_id='r-d4uk1qsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-456151526',owner_user_name='tempest-ServerStableDeviceRescueTest-456151526-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:05:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01855887e3a0438bbe84fb9664132ad1',uuid=8584659f-147f-4b78-ad59-e0eebdb9aaf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "vif_mac": "fa:16:3e:5f:89:50"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:05.019274 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converting VIF {"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "vif_mac": "fa:16:3e:5f:89:50"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:05.019274 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:05.020101 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'pci_devices' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:05.310748 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:05.310949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:05.422509 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid 0cb5afe2-5125-4261-b2f3-f0431bc65134 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:05.525975 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:06:05.527107 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] End _get_guest_xml xml=<domain type="qemu">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <uuid>8584659f-147f-4b78-ad59-e0eebdb9aaf3</uuid>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <name>instance-00000017</name>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-294841717</nova:name>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:05:59</nova:creationTime>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:user uuid="01855887e3a0438bbe84fb9664132ad1">tempest-ServerStableDeviceRescueTest-456151526-project-member</nova:user>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:project uuid="38e8657cdaa8482182b12ae39785f074">tempest-ServerStableDeviceRescueTest-456151526</nova:project>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         <nova:port uuid="cb4e4b15-723c-469c-b5f8-53863c6ac3d6">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <system>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <entry name="serial">8584659f-147f-4b78-ad59-e0eebdb9aaf3</entry>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <entry name="uuid">8584659f-147f-4b78-ad59-e0eebdb9aaf3</entry>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </system>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <os>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   </os>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <features>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   </features>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   <devices>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <alias name="ua-e6d17c2a-e75e-4c20-b161-33662ed99965"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-4"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <serial>e6d17c2a-e75e-4c20-b161-33662ed99965</serial>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.rescue"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <target dev="vdc" bus="virtio"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <boot order="1"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:5f:89:50"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <target dev="tapcb4e4b15-72"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/console.log" append="off"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </serial>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <video>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </video>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </rng>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:   </devices>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]: </domain>
May 28 14:06:05.527107 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:06:05.533008 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance destroyed successfully.
May 28 14:06:05.641873 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:05.642169 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:05.812855 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:06:05.939198 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:06.144946 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:06.208857 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3491e689-0161-46d3-b6e4-674ce82705d9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.619s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:06.373224 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:06.430272 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-44047aec-f9d4-4f90-a8af-66833e4d34f3 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.326s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:06.653575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.676s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:06.653575 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:06:06.656348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.283s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:06.660879 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:06:06.661070 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Claim successful on node np0000001643
May 28 14:06:07.060518 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:07.060728 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:07.060979 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:07.061242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:07.061242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] No VIF found with MAC fa:16:3e:5f:89:50, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:07.061793 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Using config drive
May 28 14:06:07.161544 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:06:07.164851 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:06:07.165249 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:07.165655 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:07.271337 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd63519537b49cc88a46117da664f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f216176f6d4f43b4d9b887d97b5c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:06:07.566074 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'ec2_ids' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:07.672860 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:06:07.802083 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Rebuilding instance
May 28 14:06:07.859177 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:07.859511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:07.980550 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Successfully created port: 600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:08.074520 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:06:08.077000 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:08.080958 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'keypairs' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:08.178747 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:06:08.363977 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:06:08.446083 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:08.446497 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:08.591362 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:06:08.594352 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:08.712163 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Successfully updated port: 600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:08.776099 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-changed-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:08.776279 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Refreshing instance network info cache due to event network-changed-600c6c7f-5bc9-487a-9e11-8cd545ef22f7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:08.776508 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] Acquiring lock "refresh_cache-cab3ed09-e0a5-4e51-b159-65f9f38398d0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:08.776647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] Acquired lock "refresh_cache-cab3ed09-e0a5-4e51-b159-65f9f38398d0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:08.780774 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Refreshing network info cache for port 600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:08.890082 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Creating config drive at /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config.rescue
May 28 14:06:08.893912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgqunm6gl {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:08.950645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:08.952150 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:08.966600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgqunm6gl" returned: 0 in 0.073s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:09.128223 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.134674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.156753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.189646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:06:09.189646 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:06:09.189646 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Creating image(s)
May 28 14:06:09.189646 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "/opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:09.190309 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "/opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:09.190369 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "/opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:09.191030 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:09.195516 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:09.195937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:09.219420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "refresh_cache-cab3ed09-e0a5-4e51-b159-65f9f38398d0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:09.286005 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:09.317566 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:09.317770 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:09.318133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:09.318646 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:09.321232 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:09.321579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:09.339045 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.347390 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.417836 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:09.421075 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.442305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:09.442824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:09.473678 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.815s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:09.474790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:06:09.484772 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.494384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.526s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:09.509348 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:06:09.509490 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Claim successful on node np0000001643
May 28 14:06:09.511699 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.528128 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk 1073741824" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:09.529655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:09.531234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:09.642314 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:09.642895 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:06:09.643123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:09.713152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.729235 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998764488999996 future=<Future at 0x71a7781f6ff0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:09.738715 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance destroyed successfully.
May 28 14:06:09.759761 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:09.759944 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Cannot resize image /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:06:09.761027 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:06:09.761249 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Ensure instance console log exists: /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:06:09.761727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:09.762005 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:09.762105 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:09.801303 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:09.809337 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e3077f60-04fc-4675-8834-52be5f89a882 req-17e59bf1-5f89-4ca1-ac25-106d632c57c7 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:09.812086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3077f60-04fc-4675-8834-52be5f89a882 req-17e59bf1-5f89-4ca1-ac25-106d632c57c7 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:09.812167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3077f60-04fc-4675-8834-52be5f89a882 req-17e59bf1-5f89-4ca1-ac25-106d632c57c7 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:09.812382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3077f60-04fc-4675-8834-52be5f89a882 req-17e59bf1-5f89-4ca1-ac25-106d632c57c7 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:09.812926 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e3077f60-04fc-4675-8834-52be5f89a882 req-17e59bf1-5f89-4ca1-ac25-106d632c57c7 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:09.813171 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e3077f60-04fc-4675-8834-52be5f89a882 req-17e59bf1-5f89-4ca1-ac25-106d632c57c7 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state active and task_state rescuing.
May 28 14:06:09.849507 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Detaching volume 83919653-256c-49d2-bfc5-5d52203ab840
May 28 14:06:09.903468 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attempting to driver detach volume 83919653-256c-49d2-bfc5-5d52203ab840 from mountpoint /dev/vdb
May 28 14:06:09.909397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Found disk vdb by alias ua-83919653-256c-49d2-bfc5-5d52203ab840 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:06:09.909625 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Attempting to detach device vdb from instance b8315b4c-90be-498b-bdc8-1a775a1480bc from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:06:09.910004 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:06:09.910004 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:09.910004 np0000001643 nova-compute[98269]:   <alias name="ua-83919653-256c-49d2-bfc5-5d52203ab840"/>
May 28 14:06:09.910004 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:06:09.910004 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:09.910004 np0000001643 nova-compute[98269]:   <serial>83919653-256c-49d2-bfc5-5d52203ab840</serial>
May 28 14:06:09.910004 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:06:09.910004 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:09.910004 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:06:09.922456 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully detached device vdb from instance b8315b4c-90be-498b-bdc8-1a775a1480bc from the persistent domain config.
May 28 14:06:09.924349 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:06:09.924866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:09.925023 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:09.925472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:09.925812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:06:09.925958 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:06:09.932788 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.938389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.942727 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.963514 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:09.963514 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:09.963514 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:09.963514 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:09.963514 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:09.963514 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:09.963514 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:09.963981 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '48')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:06:09.963981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '47')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:09.965469 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:09.969268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '48')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:09.969268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c767380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:06:09.969268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:06:09.969268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flush multipath device 330000000179b7052 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:06:09.969686 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:10.007105 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:06:10.007370 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:06:10.007845 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:10.008173 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:10.018339 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:10.071201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:10.121652 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:06:10.121917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:06:10.123485 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:06:10.138171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:06:10.138403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:06:10.151364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:10.185247 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260]
May 28 14:06:10.185247 np0000001643 nova-compute[98269]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260] successful.
May 28 14:06:10.185247 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:10.201290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:10.212802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:10.256098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260]
May 28 14:06:10.256098 np0000001643 nova-compute[98269]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260] successful.
May 28 14:06:10.256098 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:10.258869 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a28d8974a9141cb8333d6ae154e7387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378d3afdd7e4c58bb7884c3cdea9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:06:10.273637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:10.273902 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:10.273986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== disconnect_volume: return (349ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:10.274140 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:06:10.307510 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f8f54f2d-d144-42c0-86e5-b02579b9f62f req-3b8b86b0-ff0b-4103-b97a-8ab6189af4ff service nova] Releasing lock "refresh_cache-cab3ed09-e0a5-4e51-b159-65f9f38398d0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:10.307865 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquired lock "refresh_cache-cab3ed09-e0a5-4e51-b159-65f9f38398d0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:10.308023 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:06:10.408589 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004376179999781016 future=<Future at 0x71a75c30e360 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.408724 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.408724 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.3089084749999529 future=<Future at 0x71a75c30cfe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.408846 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.3088393749999341 future=<Future at 0x71a75c30cfe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.409327 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Emitting event <LifecycleEvent: 1779977155.4080324, 58824ea3-a859-43f6-a8f5-763cf1115f57 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:10.409327 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] VM Stopped (Lifecycle Event)
May 28 14:06:10.518721 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:06:10.651081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 8584659f-147f-4b78-ad59-e0eebdb9aaf3 due to new event <LifecycleEvent: 1779977170.6505966, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:06:10.651304 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977170.6505966, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:10.651529 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Resumed (Lifecycle Event)
May 28 14:06:10.657070 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-eb0bb341-b87c-42f8-8fec-1d79ebf99ac0 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:10.718042 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00034778200006257975 future=<Future at 0x71a75c30cfe0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.718215 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.718320 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.00960351599997 future=<Future at 0x71a7781f6ff0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.718441 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.00948870000002 future=<Future at 0x71a7781f6ff0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:10.867567 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:10.867650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:10.867828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:10.868007 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:10.868769 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] No waiting events found dispatching network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:10.869002 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received unexpected event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 for instance with vm_state active and task_state rebuilding.
May 28 14:06:10.869159 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:10.869341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:10.872345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:10.872345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:10.872345 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] No waiting events found dispatching network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:10.872345 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-06ff73e7-e3ca-4ddd-a85c-3fad19fd706f req-0f47fd00-dd7f-46d6-a219-d3d73c27f299 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received unexpected event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 for instance with vm_state active and task_state rebuilding.
May 28 14:06:10.912175 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 58824ea3-a859-43f6-a8f5-763cf1115f57] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:10.941753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:10.953665 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully created port: 300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:11.087070 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:11.171727 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:11.180004 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:11.319347 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:11.360344 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:11.360561 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:11.376080 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance destroyed successfully.
May 28 14:06:11.376931 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1187018804',display_name='tempest-ServerActionsTestOtherA-server-20810810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-tempest-common-compute-instance-1187018804',id=25,image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjudjxGx9MLYUVvFGlZfcC71jfy/sR8oZUcTCdliwi/R7kQu6rBd56Xf/TSYh/iBZLjjnI4has/s0nB3GdSPd4bXfjOiBefr+Yd6Vvfl1uwmkrcaxbNjs9Ha5YmPEohA==',key_name='tempest-keypair-1270102767',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:05:17Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-04k7gxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=b8315b4c-90be-498b-bdc8-1a775a1480bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:06:11.377132 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:11.377642 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:11.377877 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:06:11.379881 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:11.380194 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61ba7305-7c, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:11.391427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:11.391427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:11.391427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d245ef3-d7cf-420d-8c94-c2ab6b61362d) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:11.391427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:11.391427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:11.391427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:11.400773 np0000001643 nova-compute[98269]: INFO os_vif [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c')
May 28 14:06:11.402352 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:06:11.403261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:11.403682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:11.405133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:11.405549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:06:11.405700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:06:11.439875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:11.439875 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:11.439875 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:11.439875 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:11.439875 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:11.440077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:11.440077 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:11.440077 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:11.440077 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:11.440077 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:11.440206 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '46')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:06:11.440338 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:11.441145 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:06:11.441279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:11.441408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:06:11.441567 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c15a980>, {}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:06:11.441703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Disconnecting from: [] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:06:11.441937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:11.442104 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== disconnect_volume: return (38ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:11.442207 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:06:11.442849 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Deleting instance files /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc_del
May 28 14:06:11.445344 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Deletion of /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc_del complete
May 28 14:06:11.477909 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Updating instance_info_cache with network_info: [{"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:11.528836 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully created port: 28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:11.685737 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977171.6853285, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:11.685904 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Started (Lifecycle Event)
May 28 14:06:11.853471 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Unrescuing
May 28 14:06:11.853471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:11.853471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquired lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:11.853471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:06:11.863673 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:11.982594 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Releasing lock "refresh_cache-cab3ed09-e0a5-4e51-b159-65f9f38398d0" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:11.982943 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Instance network_info: |[{"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:06:11.985342 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Start _get_guest_xml network_info=[{"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:06:11.989380 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:06:11.990890 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-2043744317', uuid='cab3ed09-e0a5-4e51-b159-65f9f38398d0'), owner=OwnerMeta(userid='5cd63519537b49cc88a46117da664f6a', username='tempest-VolumesActionsTest-95313981-project-member', projectid='55f216176f6d4f43b4d9b887d97b5c16', projectname='tempest-VolumesActionsTest-95313981'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977171.9904227) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:06:11.995812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:06:11.995812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:06:11.995812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:06:11.995812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:06:11.995812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:06:11.996097 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:06:11.996249 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:06:11.996373 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:06:11.996547 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:06:11.996893 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:06:11.996893 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:06:11.996950 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:06:11.999501 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:06:11.999501 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:06:11.999501 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:06:11.999501 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:06:12.014067 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2043744317',display_name='tempest-VolumesActionsTest-instance-2043744317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-2043744317',id=29,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55f216176f6d4f43b4d9b887d97b5c16',ramdisk_id='',reservation_id='r-8apxy6h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-95313981',owner_user_name='tempest-VolumesActionsTest-95313981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:08Z,user_data=None,user_id='5cd63519537b49cc88a46117da664f6a',uuid=cab3ed09-e0a5-4e51-b159-65f9f38398d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:12.015244 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converting VIF {"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:12.015828 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:10:8a,bridge_name='br-int',has_traffic_filtering=True,id=600c6c7f-5bc9-487a-9e11-8cd545ef22f7,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600c6c7f-5b') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:12.016823 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lazy-loading 'pci_devices' on Instance uuid cab3ed09-e0a5-4e51-b159-65f9f38398d0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:12.035520 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully created port: 9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:12.038545 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:06:12.077117 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-886792f9-dd4f-4184-a961-2effc77fdd2e req-11a24e77-b950-45a6-b029-ea8a5c08b29b service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:12.077262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-886792f9-dd4f-4184-a961-2effc77fdd2e req-11a24e77-b950-45a6-b029-ea8a5c08b29b service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:12.080530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-886792f9-dd4f-4184-a961-2effc77fdd2e req-11a24e77-b950-45a6-b029-ea8a5c08b29b service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:12.083181 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-886792f9-dd4f-4184-a961-2effc77fdd2e req-11a24e77-b950-45a6-b029-ea8a5c08b29b service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:12.083421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-886792f9-dd4f-4184-a961-2effc77fdd2e req-11a24e77-b950-45a6-b029-ea8a5c08b29b service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:12.083550 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-886792f9-dd4f-4184-a961-2effc77fdd2e req-11a24e77-b950-45a6-b029-ea8a5c08b29b service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state rescued and task_state unrescuing.
May 28 14:06:12.189166 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:12.192231 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:12.353326 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:12.375904 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.900s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:12.376439 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:06:12.468558 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Booting with volume 83919653-256c-49d2-bfc5-5d52203ab840 at /dev/vdb
May 28 14:06:12.520988 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] End _get_guest_xml xml=<domain type="qemu">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <uuid>cab3ed09-e0a5-4e51-b159-65f9f38398d0</uuid>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <name>instance-0000001d</name>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesActionsTest-instance-2043744317</nova:name>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:06:11</nova:creationTime>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:user uuid="5cd63519537b49cc88a46117da664f6a">tempest-VolumesActionsTest-95313981-project-member</nova:user>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:project uuid="55f216176f6d4f43b4d9b887d97b5c16">tempest-VolumesActionsTest-95313981</nova:project>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         <nova:port uuid="600c6c7f-5bc9-487a-9e11-8cd545ef22f7">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <system>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <entry name="serial">cab3ed09-e0a5-4e51-b159-65f9f38398d0</entry>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <entry name="uuid">cab3ed09-e0a5-4e51-b159-65f9f38398d0</entry>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </system>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <os>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   </os>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <features>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   </features>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   <devices>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk.config"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:73:10:8a"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <target dev="tap600c6c7f-5b"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/console.log" append="off"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </serial>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <video>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </video>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </rng>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:   </devices>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]: </domain>
May 28 14:06:12.520988 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Preparing to wait for external event network-vif-plugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2043744317',display_name='tempest-VolumesActionsTest-instance-2043744317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-2043744317',id=29,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55f216176f6d4f43b4d9b887d97b5c16',ramdisk_id='',reservation_id='r-8apxy6h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-95313981',owner_user_name='tempest-VolumesActionsTest-95313981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:08Z,user_data=None,user_id='5cd63519537b49cc88a46117da664f6a',uuid=cab3ed09-e0a5-4e51-b159-65f9f38398d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converting VIF {"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:10:8a,bridge_name='br-int',has_traffic_filtering=True,id=600c6c7f-5bc9-487a-9e11-8cd545ef22f7,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600c6c7f-5b') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:10:8a,bridge_name='br-int',has_traffic_filtering=True,id=600c6c7f-5bc9-487a-9e11-8cd545ef22f7,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600c6c7f-5b') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:12.528655 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a162ef6-5faa-56c8-bc7d-3f78b2cccd5b', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:12.532716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:12.534665 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:12.538113 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:12.538681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap600c6c7f-5b, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:12.538862 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap600c6c7f-5b, col_values=(('qos', UUID('9a337bbf-03d3-4f91-867f-55c5b28f2855')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:12.539067 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap600c6c7f-5b, col_values=(('external_ids', {'iface-id': '600c6c7f-5bc9-487a-9e11-8cd545ef22f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:10:8a', 'vm-uuid': 'cab3ed09-e0a5-4e51-b159-65f9f38398d0'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:12.543599 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:12.546323 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Booting with volume 0bb48f61-5540-460d-95d2-f0ef27a59003 at /dev/vda
May 28 14:06:12.550968 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:12.554163 np0000001643 nova-compute[98269]: INFO os_vif [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:10:8a,bridge_name='br-int',has_traffic_filtering=True,id=600c6c7f-5bc9-487a-9e11-8cd545ef22f7,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600c6c7f-5b')
May 28 14:06:12.557387 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully created port: 9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:12.562482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:06:12.601563 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:12.630164 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:12.642298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:06:12.643109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:06:12.646628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:06:12.653406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:06:12.655893 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164'] 
May 28 14:06:12.656018 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:06:12.656121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:06:12.656320 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:12.657919 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updating existing volume attachment record: f233c572-6a0f-41f5-ae6c-b621019628ec {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:06:12.674509 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:12.696294 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 14:06:12.723726 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:06:12.724184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:06:12.740372 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:06:12.741664 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164'] 
May 28 14:06:12.741797 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:06:12.741968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:06:12.742193 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:12.742787 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating existing volume attachment record: 0d3c19cb-5e22-4884-a97e-4163809df50f {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:06:12.866891 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:12.885206 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:06:12.886350 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:06:12.886700 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:12.886893 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:12.942932 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:12.943350 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing instance network info cache due to event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:12.946669 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] Acquiring lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:13.013603 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81cf50caaafd43ffae63aff9c9258528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4618bb9b554fb8af8f26aae95c016a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:06:13.058386 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:13.104842 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully created port: c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:13.391037 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:06:13.560703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Releasing lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:13.562079 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'flavor' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:13.562844 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] Acquired lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:13.563230 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing network info cache for port cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:13.750184 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Successfully created port: 027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:13.852949 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully updated port: 300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:13.895327 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:06:13.950243 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:13.950810 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-300da7b6-2392-463e-9abf-448f59da647d. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:13.951106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:13.951259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:13.951479 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port 300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:14.067605 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:14.091423 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:14.091423 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:14.091423 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] No VIF found with MAC fa:16:3e:73:10:8a, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:14.091423 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Using config drive
May 28 14:06:14.101037 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.104219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.125862 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.139569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.176327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.309762 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-028f8397-6373-4624-813c-ea2c1e62db41 req-5a5f5881-e754-4da6-9d77-00058d946eb4 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:14.311081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-028f8397-6373-4624-813c-ea2c1e62db41 req-5a5f5881-e754-4da6-9d77-00058d946eb4 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:14.311295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-028f8397-6373-4624-813c-ea2c1e62db41 req-5a5f5881-e754-4da6-9d77-00058d946eb4 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:14.311950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-028f8397-6373-4624-813c-ea2c1e62db41 req-5a5f5881-e754-4da6-9d77-00058d946eb4 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:14.311950 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-028f8397-6373-4624-813c-ea2c1e62db41 req-5a5f5881-e754-4da6-9d77-00058d946eb4 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:14.311950 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-028f8397-6373-4624-813c-ea2c1e62db41 req-5a5f5881-e754-4da6-9d77-00058d946eb4 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state rescued and task_state unrescuing.
May 28 14:06:14.333104 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Successfully updated port: 027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:14.363410 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Booting with volume 1f783b53-ba58-4c15-95ee-2b30fb9c5957 at /dev/vdb
May 28 14:06:14.398779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.421635 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.422836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:14.439332 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:14.454342 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:14.458830 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999608283999805 future=<Future at 0x71a75c29e540 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:14.460436 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:06:14.466818 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance destroyed successfully.
May 28 14:06:14.468246 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'numa_topology' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:14.497354 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:14.541937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:06:14.542981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:06:14.561334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:06:14.561949 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a'] 
May 28 14:06:14.561949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:06:14.561949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:06:14.562156 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:14.562663 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating existing volume attachment record: cb130a3b-17b6-4217-8509-a8c8c74f854d {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:06:14.606834 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:14.646541 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:14.703583 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:14.805870 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:06:14.806582 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Creating image(s)
May 28 14:06:14.811937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:14.812164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:14.812749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:14.813059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "31f70ec784d0bd85b3ed416babb6129d671fe555" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:14.813421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "31f70ec784d0bd85b3ed416babb6129d671fe555" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:14.822776 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Creating config drive at /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk.config
May 28 14:06:14.835482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpal06ql6h {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:14.861525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:14.861525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:14.861525 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:06:14.890842 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:14.914171 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:06:14.919991 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:06:14.919991 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Creating image(s)
May 28 14:06:14.921462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpal06ql6h" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:14.921683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:14.921852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:14.929329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:14.929488 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:14.934214 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:14.937500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:14.979591 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updated VIF entry in instance network info cache for port cb4e4b15-723c-469c-b5f8-53863c6ac3d6. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:14.980168 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Object Instance<8584659f-147f-4b78-ad59-e0eebdb9aaf3> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:06:14.981261 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:15.056127 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:15.056856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:15.057846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:15.063194 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-changed-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:15.065985 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing instance network info cache due to event network-changed-027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:15.065985 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:15.068509 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:15.072635 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:15.072635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:15.133364 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully updated port: ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:15.177468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:15.177958 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:15.248211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk 1073741824" returned: 0 in 0.070s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:15.248790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:15.250546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:15.362132 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.112s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:15.363431 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:06:15.363763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:15.396020 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6194cc28-f560-4432-b7e5-5e7b4ed2d48a req-d3978c39-d6d4-4434-9824-d27168c531d5 service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:15.464644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:15.465242 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Cannot resize image /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:06:15.465242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:06:15.465324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Ensure instance console log exists: /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:06:15.465681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:15.465868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:15.466018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:15.485836 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:15.488355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] Releasing lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:15.488740 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:15.488948 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing instance network info cache due to event network-changed-cb4e4b15-723c-469c-b5f8-53863c6ac3d6. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:15.489148 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] Acquiring lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:15.489253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] Acquired lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:15.489574 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Refreshing network info cache for port cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:15.708159 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:15.711048 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:15.711682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:15.826699 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.part --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:15.827088 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] 1b08055e-7d23-4643-8d4a-4349e3da4086 was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:06:15.827836 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:06:15.828267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.part /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:15.885368 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:15.966795 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:15.993290 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:16.025096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:16.033178 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:16.096833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.part /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.converted" returned: 0 in 0.268s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:16.107422 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:16.140768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:16.163129 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:16.230620 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555.converted --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:16.230620 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "31f70ec784d0bd85b3ed416babb6129d671fe555" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.417s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:16.230776 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:16.236405 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:16.238196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:16.258202 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Booting with volume 7f27c099-929f-4674-ac6f-7f8e770116d8 at /dev/vdc
May 28 14:06:16.280781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:16.339582 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:16.341645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555 --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:16.343216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "31f70ec784d0bd85b3ed416babb6129d671fe555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:16.343853 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "31f70ec784d0bd85b3ed416babb6129d671fe555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:16.344479 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:16.351695 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:16.352608 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:16.378305 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:06:16.413196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:16.457364 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:16.467743 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cf5ba82f-d657-42ef-a044-78b65b9d2b56 req-aaa85c77-1684-4420-9e5d-6198f4669545 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:16.468258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cf5ba82f-d657-42ef-a044-78b65b9d2b56 req-aaa85c77-1684-4420-9e5d-6198f4669545 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:16.468308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cf5ba82f-d657-42ef-a044-78b65b9d2b56 req-aaa85c77-1684-4420-9e5d-6198f4669545 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:16.470863 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cf5ba82f-d657-42ef-a044-78b65b9d2b56 req-aaa85c77-1684-4420-9e5d-6198f4669545 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:16.470863 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cf5ba82f-d657-42ef-a044-78b65b9d2b56 req-aaa85c77-1684-4420-9e5d-6198f4669545 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:16.473022 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-cf5ba82f-d657-42ef-a044-78b65b9d2b56 req-aaa85c77-1684-4420-9e5d-6198f4669545 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state rescued and task_state unrescuing.
May 28 14:06:16.473555 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:16.477518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:06:16.477518 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:06:16.491295 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:06:16.499080 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:fe73:108a', 'fe80::fc16:3eff:fe5f:8950', 'fe80::dc20:e6ff:feaf:6b56'] 
May 28 14:06:16.500711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:06:16.500711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:06:16.501030 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:16.501265 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating existing volume attachment record: 03dda205-61fc-4db1-8c5b-b11f8ac65654 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:06:16.506425 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:16.516181 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ac98b45-c242-4605-8619-7102ce45cc97 req-6e0a6d26-fb2f-4342-a224-d555c875c135 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-vif-plugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:16.519083 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ac98b45-c242-4605-8619-7102ce45cc97 req-6e0a6d26-fb2f-4342-a224-d555c875c135 service nova] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:16.520947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ac98b45-c242-4605-8619-7102ce45cc97 req-6e0a6d26-fb2f-4342-a224-d555c875c135 service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:16.521530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ac98b45-c242-4605-8619-7102ce45cc97 req-6e0a6d26-fb2f-4342-a224-d555c875c135 service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:16.521530 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ac98b45-c242-4605-8619-7102ce45cc97 req-6e0a6d26-fb2f-4342-a224-d555c875c135 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Processing event network-vif-plugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:16.523466 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555 --force-share --output=json" returned: 0 in 0.170s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:16.524092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555,backing_fmt=raw /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:16.616010 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555,backing_fmt=raw /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk 1073741824" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:16.618070 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "31f70ec784d0bd85b3ed416babb6129d671fe555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:16.618461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:16.667994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:16.681642 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance network_info: |[{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:06:16.682069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:16.685152 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:16.690927 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Start _get_guest_xml network_info=[{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:06:16.707998 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:06:16.709779 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='512a75c8-713d-418b-adc8-07b2bf513923'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977176.7092118) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:06:16.715965 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:06:16.715965 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:06:16.724168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:06:16.724168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:06:16.724168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:06:16.724168 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:06:16.727299 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:06:16.753643 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=31,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-t5gyv8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=512a75c8-713d-418b-adc8-07b2bf513923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:16.754710 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:16.754856 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:16.758660 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'pci_devices' on Instance uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:16.760998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555 --force-share --output=json" returned: 0 in 0.142s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:16.762422 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:06:16.762422 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:16.885228 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:16.889775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:16.893211 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Cannot resize image /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:06:16.893211 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:06:16.893211 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Ensure instance console log exists: /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:06:16.893211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:16.893211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:16.893211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:16.893722 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Start _get_guest_xml network_info=[{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T13:58:38Z,direct_url=<?>,disk_format='qcow2',id=1b08055e-7d23-4643-8d4a-4349e3da4086,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T13:58:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'f233c572-6a0f-41f5-ae6c-b621019628ec', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b8315b4c-90be-498b-bdc8-1a775a1480bc', 'attached_at': '', 'detached_at': '', 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'serial': '83919653-256c-49d2-bfc5-5d52203ab840'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:06:16.903781 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 14:06:16.905665 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1b08055e-7d23-4643-8d4a-4349e3da4086', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-20810810', uuid='b8315b4c-90be-498b-bdc8-1a775a1480bc'), owner=OwnerMeta(userid='357253ac91f34daeb60ae1dfd3e4a86f', username='tempest-ServerActionsTestOtherA-354716614-project-member', projectid='6a74849f3fb24097a5a42457746f02d2', projectname='tempest-ServerActionsTestOtherA-354716614'), image=ImageMeta(id='1b08055e-7d23-4643-8d4a-4349e3da4086', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977176.905064) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:06:16.910773 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:06:16.911436 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:06:16.916781 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:06:16.917182 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T13:58:38Z,direct_url=<?>,disk_format='qcow2',id=1b08055e-7d23-4643-8d4a-4349e3da4086,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T13:58:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:06:16.922021 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:06:16.923370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:06:16.923370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:06:16.923591 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:06:16.923848 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:17.084359 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully updated port: 89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:17.103214 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updated VIF entry in instance network info cache for port cb4e4b15-723c-469c-b5f8-53863c6ac3d6. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:17.103825 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [{"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:17.106999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.147402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.160459 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:17.161289 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-ac3a901d-4ef1-4379-974d-324dded4930d. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:17.162600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:17.162743 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:17.162986 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:17.196642 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:17.304469 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] End _get_guest_xml xml=<domain type="qemu">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <uuid>512a75c8-713d-418b-adc8-07b2bf513923</uuid>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <name>instance-0000001f</name>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:name>multiattach-server-0</nova:name>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:06:16</nova:creationTime>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         <nova:port uuid="027666be-2507-4940-ae85-8c79ccf188b7">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <system>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <entry name="serial">512a75c8-713d-418b-adc8-07b2bf513923</entry>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <entry name="uuid">512a75c8-713d-418b-adc8-07b2bf513923</entry>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </system>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <os>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   </os>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <features>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   </features>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   <devices>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ad:d3:ed"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <target dev="tap027666be-25"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/console.log" append="off"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </serial>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <video>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </video>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </rng>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:   </devices>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]: </domain>
May 28 14:06:17.304469 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:06:17.304469 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Preparing to wait for external event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:17.304469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:17.304469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:17.304469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:17.307239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=31,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-t5gyv8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=512a75c8-713d-418b-adc8-07b2bf513923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:17.307239 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:17.307239 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:17.307239 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:17.307239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.307239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:17.307239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:17.309813 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.309918 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '696e0eab-508f-55e5-8851-def37590a41a', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:17.310820 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.313407 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:17.318375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.318658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap027666be-25, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:17.319136 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap027666be-25, col_values=(('qos', UUID('c67cdf84-53ed-4369-a01c-5bc50bc6a849')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:17.319407 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap027666be-25, col_values=(('external_ids', {'iface-id': '027666be-2507-4940-ae85-8c79ccf188b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:d3:ed', 'vm-uuid': '512a75c8-713d-418b-adc8-07b2bf513923'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:17.320471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.322040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:17.329394 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:17.330396 np0000001643 nova-compute[98269]: INFO os_vif [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25')
May 28 14:06:17.356944 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977177.3565407, cab3ed09-e0a5-4e51-b159-65f9f38398d0 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:17.357185 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] VM Started (Lifecycle Event)
May 28 14:06:17.362470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:06:17.365514 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5441f4cd-0e7e-4480-a31b-dd87539cd79a tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:17.372915 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:06:17.380428 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Instance spawned successfully.
May 28 14:06:17.380912 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:06:17.444804 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:06:17.444804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:17.444804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:17.444804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:17.444804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:06:17.461743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:17.462336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:17.464275 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:17.464728 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:17.465428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:17.465687 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:17.486318 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:17.486318 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:17.492960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:17.492960 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:17.502614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840] added
May 28 14:06:17.502614 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:17.502614 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:17.502614 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:17.502614 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:17.502614 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:17.502614 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:17.502908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:17.503111 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0393(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:17.503305 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:17.508852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840] added
May 28 14:06:17.508852 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:17.508852 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:17.508852 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:17.508852 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:17.508852 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:17.508852 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:17.509353 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:17.509353 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0436(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:17.509562 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:17.618028 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de5a8f0a-356b-4304-8438-74b1702179fe req-566f36b9-dc0a-4ab5-9fc2-6f4c64d5abaf service nova] Releasing lock "refresh_cache-8584659f-147f-4b78-ad59-e0eebdb9aaf3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:17.645522 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:17.665865 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:17.782766 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:17.826868 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updated VIF entry in instance network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:17.827826 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:17.862743 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:17.868663 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:17.896646 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:17.896790 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:17.897272 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:17.897921 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:17.898253 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:17.898663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:18.036386 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:18.276074 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully updated port: 28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:18.331061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e2efd696-61b5-4abe-aad5-5c13c88880a3 req-61a67ba7-086d-443d-b398-eb4e3d1a568c service nova] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:18.371747 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:06:18.372024 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977178.3717465, cab3ed09-e0a5-4e51-b159-65f9f38398d0 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:18.372228 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] VM Paused (Lifecycle Event)
May 28 14:06:18.410221 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Took 9.22 seconds to spawn the instance on the hypervisor.
May 28 14:06:18.410221 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:18.505732 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:18.510500 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:18.523086 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:18.523086 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:18.528602 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:18.528602 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.538717 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.539921 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-82b97b83-3ec2-41f7-b129-39cbd9a60983 req-8f9564c6-e87f-4caf-a616-a1b83e6ba0da service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:18.547483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.558338 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.558338 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.558338 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.558338 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.558338 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:18.558611 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.558611 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.558611 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.558611 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.558611 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.571428 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:18.612664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260]
May 28 14:06:18.612664 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260] successful.
May 28 14:06:18.612664 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.613889 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260]
May 28 14:06:18.613889 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260] successful.
May 28 14:06:18.613889 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.619602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:18.619854 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:18.629841 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.637051 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.648220 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:18.648837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:18.648837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:18.650253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('8', '-', '-', 0) found on session 50 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:18.651071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:18.661667 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:18.661667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:18.662281 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:18.662747 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('7', '-', '-', 0) found on session 49 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:18.662934 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Creating image(s)
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Ensure instance console log exists: /opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 50 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 49 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:18.709058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:18.826717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:18.827927 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state active and task_state None.
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:18.829623 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-0938f958-2c24-4b3c-8697-819317d9b09a req-6424c38d-4b19-49ee-9acd-6efb11e1ee46 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received unexpected event network-vif-plugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with vm_state active and task_state None.
May 28 14:06:18.859419 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-vif-plugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:18.860676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:18.861052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:18.864588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:18.864700 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] No waiting events found dispatching network-vif-plugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:18.865126 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received unexpected event network-vif-plugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 for instance with vm_state active and task_state None.
May 28 14:06:18.865564 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:18.866881 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:18.867118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:18.867263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:18.867430 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port 89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:18.871575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:18.871575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:18.871728 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:ad:d3:ed, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:18.872553 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Using config drive
May 28 14:06:18.877469 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:18.880658 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 8584659f-147f-4b78-ad59-e0eebdb9aaf3 due to new event <LifecycleEvent: 1779977178.8802536, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:06:18.881155 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977178.8802536, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:18.881328 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Resumed (Lifecycle Event)
May 28 14:06:18.921222 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Took 15.01 seconds to build instance.
May 28 14:06:19.126036 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid 67d9145b-f424-411a-b3aa-f1b56dc42f2b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:19.261206 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:19.261206 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-28ebef22-93cd-4d32-90a8-9511a7ed313a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:19.261377 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:19.371666 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:19.386035 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:19.389158 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:19.392901 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:19.423391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.514s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:19.426841 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:19.465168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:06:19.529843 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:19.598017 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully updated port: 9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:19.621973 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Creating config drive at /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config
May 28 14:06:19.633978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp74wf0jxr {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:19.705476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp74wf0jxr" returned: 0 in 0.070s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:19.806099 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:19.895897 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977179.8954847, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:19.896151 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Started (Lifecycle Event)
May 28 14:06:20.136364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:20.288179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:20.307789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded8f714-af9f-4629-a512-be0e328a2994 req-a442237a-49ff-42a9-bcaa-ee26facecced service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:20.311541 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:20.311541 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port 28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:20.323334 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:20.401468 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:20.409918 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:20.424489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:20.487259 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Found WWN 330000000179b7052 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:20.488252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:20.488252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000179b7052', 'path': '/dev/dm-0', 'multipath_id': '330000000179b7052'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:20.488407 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000179b7052', 'path': '/dev/dm-0', 'multipath_id': '330000000179b7052'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:20.513385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:20.516646 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:20.817481 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:20.914361 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977180.9138036, cab3ed09-e0a5-4e51-b159-65f9f38398d0 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:20.914361 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] VM Resumed (Lifecycle Event)
May 28 14:06:20.933638 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully updated port: 9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:20.970048 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:20.999680 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1187018804',display_name='tempest-ServerActionsTestOtherA-server-20810810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-tempest-common-compute-instance-1187018804',id=25,image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjudjxGx9MLYUVvFGlZfcC71jfy/sR8oZUcTCdliwi/R7kQu6rBd56Xf/TSYh/iBZLjjnI4has/s0nB3GdSPd4bXfjOiBefr+Yd6Vvfl1uwmkrcaxbNjs9Ha5YmPEohA==',key_name='tempest-keypair-1270102767',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:05:17Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-04k7gxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=b8315b4c-90be-498b-bdc8-1a775a1480bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:21.000772 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:21.002723 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:21.005196 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] End _get_guest_xml xml=<domain type="qemu">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <uuid>b8315b4c-90be-498b-bdc8-1a775a1480bc</uuid>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <name>instance-00000019</name>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsTestOtherA-server-20810810</nova:name>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:06:16</nova:creationTime>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:image uuid="1b08055e-7d23-4643-8d4a-4349e3da4086">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:user uuid="357253ac91f34daeb60ae1dfd3e4a86f">tempest-ServerActionsTestOtherA-354716614-project-member</nova:user>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:project uuid="6a74849f3fb24097a5a42457746f02d2">tempest-ServerActionsTestOtherA-354716614</nova:project>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="1b08055e-7d23-4643-8d4a-4349e3da4086"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         <nova:port uuid="61ba7305-7cba-43a7-933f-1bb3fb5e7377">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <system>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <entry name="serial">b8315b4c-90be-498b-bdc8-1a775a1480bc</entry>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <entry name="uuid">b8315b4c-90be-498b-bdc8-1a775a1480bc</entry>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </system>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <os>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   </os>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <features>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   </features>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   <devices>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <alias name="ua-83919653-256c-49d2-bfc5-5d52203ab840"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <serial>83919653-256c-49d2-bfc5-5d52203ab840</serial>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ab:25:f1"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <target dev="tap61ba7305-7c"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/console.log" append="off"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </serial>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <video>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </video>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </rng>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:   </devices>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]: </domain>
May 28 14:06:21.005196 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:06:21.010059 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1187018804',display_name='tempest-ServerActionsTestOtherA-server-20810810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-tempest-common-compute-instance-1187018804',id=25,image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjudjxGx9MLYUVvFGlZfcC71jfy/sR8oZUcTCdliwi/R7kQu6rBd56Xf/TSYh/iBZLjjnI4has/s0nB3GdSPd4bXfjOiBefr+Yd6Vvfl1uwmkrcaxbNjs9Ha5YmPEohA==',key_name='tempest-keypair-1270102767',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:05:17Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-04k7gxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=b8315b4c-90be-498b-bdc8-1a775a1480bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:21.010059 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:21.010059 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:21.010885 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:21.011194 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:21.012340 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:21.012763 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:21.014663 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:21.016178 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:21.016381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-9b97fba0-f944-4595-8a3b-127f5cc7d846. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:21.016578 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:21.017567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '350ba440-cdd3-5048-bd6f-1440f9ede4c7', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:21.018221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:21.019818 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:21.021111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:21.024322 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:21.024670 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61ba7305-7c, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:21.025423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61ba7305-7c, col_values=(('qos', UUID('649ea3b1-0958-4bee-ac16-aac37e1c7aea')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:21.025877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61ba7305-7c, col_values=(('external_ids', {'iface-id': '61ba7305-7cba-43a7-933f-1bb3fb5e7377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:25:f1', 'vm-uuid': 'b8315b4c-90be-498b-bdc8-1a775a1480bc'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:21.027412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:21.031510 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:21.036435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:21.037921 np0000001643 nova-compute[98269]: INFO os_vif [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c')
May 28 14:06:21.262565 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:21.278204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:21.278204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:21.278204 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Attaching volume 95ea995f-e935-4d7f-970f-b95b506c863b to /dev/vdb
May 28 14:06:21.350263 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:21.369972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:06:21.385283 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:21.385283 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-9d834084-9ddc-48db-9f45-8d878ab91ac5. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:21.385743 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:21.407289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:21.432245 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:21.453801 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:21.462669 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:06:21.462982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:06:21.476385 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:06:21.478908 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fea7:94cb', 'fe80::24cd:66ff:feb1:6a60', 'fe80::fc16:3eff:fe16:4516', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:fe73:108a', 'fe80::fc16:3eff:fe5f:8950', 'fe80::dc20:e6ff:feaf:6b56', 'fe80::50f6:c5ff:fe8f:5164', 'fe80::fc16:3eff:fead:d3ed'] 
May 28 14:06:21.479117 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:06:21.479312 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:06:21.479688 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:21.479967 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Updating existing volume attachment record: 77d4cfbd-6619-4d2a-b145-35576cd37d26 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:06:21.766420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2af5269b-3026-4788-b83b-5020a4bb7ea4 req-5d8507ff-36a0-40a9-b9d1-bd0b7d4f46a0 service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:21.767009 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:21.767212 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port 9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:21.958014 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977181.9575634, 512a75c8-713d-418b-adc8-07b2bf513923 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:21.958561 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] VM Started (Lifecycle Event)
May 28 14:06:22.045478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:06:22.045834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95ea995f-e935-4d7f-970f-b95b506c863b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:22.048041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:22.048610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:22.048854 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95ea995f-e935-4d7f-970f-b95b506c863b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:06:22.062252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:22.062658 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:22.062880 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:22.064202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:22.064455 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:22.064991 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:22.068033 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:22.068277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:22.068521 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:22.068661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:22.068803 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:22.076532 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Terminating instance
May 28 14:06:22.080726 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:22.080726 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:22.082860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:22.082860 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:22.097442 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b] added
May 28 14:06:22.097442 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:22.097442 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:22.097442 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:22.097442 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:22.097442 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:22.097442 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:22.097766 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:22.097803 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:22.098213 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:22.102947 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b] added
May 28 14:06:22.102947 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:22.102947 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:22.102947 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:22.102947 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:22.102947 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:22.102947 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:22.103693 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:22.103870 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:22.104167 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:22.133493 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Successfully updated port: c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:22.269596 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:22.365428 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:22.463428 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:22.464379 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977182.4640245, 512a75c8-713d-418b-adc8-07b2bf513923 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:22.464601 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] VM Paused (Lifecycle Event)
May 28 14:06:22.583714 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:22.583714 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:22.583714 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:22.583714 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No VIF found with MAC fa:16:3e:ab:25:f1, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:22.584863 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Using config drive
May 28 14:06:22.592793 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:22.594406 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:06:22.631974 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:22.634581 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:22.637323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:22.662385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:22.695314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:22.695970 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:22.959489 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Instance destroyed successfully.
May 28 14:06:22.960184 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lazy-loading 'resources' on Instance uuid cab3ed09-e0a5-4e51-b159-65f9f38398d0 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:22.966981 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:22.970360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:23.080164 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-vif-unplugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:23.080821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:23.080821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:23.081773 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:23.081773 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] No waiting events found dispatching network-vif-unplugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:23.081773 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-vif-unplugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:23.081773 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-vif-unplugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:23.081773 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] Acquiring lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:23.082041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:23.082041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:23.082122 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] No waiting events found dispatching network-vif-unplugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:23.084475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5428d8c7-2b65-4598-93b3-3045669efcf9 req-175a0721-be35-4884-8df0-deb86068b593 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-vif-unplugged-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:23.091489 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'ec2_ids' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:23.095524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fb3458ed-e72b-4600-ba38-559a5dcf2bc7 req-571aa80c-49c4-4841-aa2a-6ca3fbd0afa8 service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:23.096046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:23.096225 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port 9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:23.100081 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:23.104663 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:23.116705 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:23.116705 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:23.124213 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:23.124213 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.132880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.139828 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.154121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.154121 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.154121 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.154121 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.154121 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.154121 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.154121 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:23.154527 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.154527 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.154527 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.154527 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.154527 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.154527 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.154527 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:23.160318 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.160318 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.160318 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.160318 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.160318 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.160318 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.160318 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:23.160714 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.160714 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.160714 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.160714 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.160714 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.160714 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.160714 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:23.206700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.40.100,3260]
May 28 14:06:23.206700 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.40.100,3260] successful.
May 28 14:06:23.206700 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.219336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.224596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.50.100,3260]
May 28 14:06:23.224596 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.50.100,3260] successful.
May 28 14:06:23.224596 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.237628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.243330 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:23.243924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:23.243924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:23.244999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] HCTL ('13', '-', '-', 0) found on session 51 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:23.245179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.255649 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:23.256071 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:23.256605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:23.256741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:23.258069 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] HCTL ('14', '-', '-', 0) found on session 52 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:23.258251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:23.264545 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching for a device in session 51 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:23.264725 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95ea995f-e935-4d7f-970f-b95b506c863b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:23.276534 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Searching for a device in session 52 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:23.276747 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '95ea995f-e935-4d7f-970f-b95b506c863b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:23.470802 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2043744317',display_name='tempest-VolumesActionsTest-instance-2043744317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-2043744317',id=29,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:18Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55f216176f6d4f43b4d9b887d97b5c16',ramdisk_id='',reservation_id='r-8apxy6h4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-95313981',owner_user_name='tempest-VolumesActionsTest-95313981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:18Z,user_data=None,user_id='5cd63519537b49cc88a46117da664f6a',uuid=cab3ed09-e0a5-4e51-b159-65f9f38398d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:06:23.470802 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converting VIF {"id": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "address": "fa:16:3e:73:10:8a", "network": {"id": "fd61d141-fa6f-4a83-9764-2a6426b3aa9a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1435686170-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55f216176f6d4f43b4d9b887d97b5c16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap600c6c7f-5b", "ovs_interfaceid": "600c6c7f-5bc9-487a-9e11-8cd545ef22f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:23.470802 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:10:8a,bridge_name='br-int',has_traffic_filtering=True,id=600c6c7f-5bc9-487a-9e11-8cd545ef22f7,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600c6c7f-5b') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:23.470802 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:10:8a,bridge_name='br-int',has_traffic_filtering=True,id=600c6c7f-5bc9-487a-9e11-8cd545ef22f7,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600c6c7f-5b') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:06:23.471397 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:23.471669 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap600c6c7f-5b, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:23.472761 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:06:23.473521 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:23.474164 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99975220500005 future=<Future at 0x71a78018ffe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:23.475786 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:23.483178 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:23.486711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:23.486711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a337bbf-03d3-4f91-867f-55c5b28f2855) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:23.486711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:23.487201 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:23.492230 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:23.492230 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-c2c95821-5913-43a4-868b-7c483f5a2ed1. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:23.492410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:23.494112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:23.496553 np0000001643 nova-compute[98269]: INFO os_vif [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:10:8a,bridge_name='br-int',has_traffic_filtering=True,id=600c6c7f-5bc9-487a-9e11-8cd545ef22f7,network=Network(fd61d141-fa6f-4a83-9764-2a6426b3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600c6c7f-5b')
May 28 14:06:23.496553 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Deleting instance files /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0_del
May 28 14:06:23.497245 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Deletion of /opt/stack/data/nova/instances/cab3ed09-e0a5-4e51-b159-65f9f38398d0_del complete
May 28 14:06:23.594100 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Object Instance<b8315b4c-90be-498b-bdc8-1a775a1480bc> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:06:23.595652 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'keypairs' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:23.598677 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:23.723085 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:23.925885 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:24.003236 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 14:06:24.004235 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:06:24.004790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:06:24.004925 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:06:24.005160 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:24.064734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:06:24.099859 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Object Instance<b8315b4c-90be-498b-bdc8-1a775a1480bc> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:06:24.101639 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 14:06:24.121304 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:24.259437 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Creating config drive at /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config
May 28 14:06:24.264097 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuhepor7e {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:24.321238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuhepor7e" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:24.428994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:24.429301 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:24.429636 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:24.429899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:24.430132 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:24.431278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:24.431543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:24.433529 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Processing event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:24.433895 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:06:24.435549 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:24.435859 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:24.436547 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:06:24.437267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:24.438889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:24.439287 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] No waiting events found dispatching network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:24.439429 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6ae694b4-16ef-4464-b261-99bb0bd52a5a req-8e1f82fc-6a85-45e3-8d24-1ba357df6e88 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received unexpected event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 for instance with vm_state building and task_state spawning.
May 28 14:06:24.442051 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977184.4403987, 512a75c8-713d-418b-adc8-07b2bf513923 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:24.442051 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] VM Resumed (Lifecycle Event)
May 28 14:06:24.443524 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:06:24.446361 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance spawned successfully.
May 28 14:06:24.446758 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:06:24.728602 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0006158159999358759 future=<Future at 0x71a7781f6ff0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:24.729348 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Emitting event <LifecycleEvent: 1779977169.7278237, b8315b4c-90be-498b-bdc8-1a775a1480bc => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:24.729666 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:24.729883 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.728542726999876 future=<Future at 0x71a75c29e540 state=cancelled>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:24.730016 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.728381743999989 future=<Future at 0x71a75c29e540 state=cancelled>) was cancelled while queued, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:24.730269 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] VM Stopped (Lifecycle Event)
May 28 14:06:24.730345 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:24.731114 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=13.743307425000012 future=<Future at 0x71a78018ffe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:24.732417 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=13.741909660999909 future=<Future at 0x71a78018ffe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:24.803377 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:24.835130 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:24.839990 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:24.867933 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:24.944144 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:24.954206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:24.956075 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:24.963340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:24.963340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:24.963340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:24.963340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:24.963340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:24.963763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:25.032807 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:25.034034 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:25.065885 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:25.091801 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found WWN 330000000e32907d0 for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:25.092181 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:25.092626 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000e32907d0', 'path': '/dev/dm-5', 'multipath_id': '330000000e32907d0'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:25.092721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e32907d0', 'path': '/dev/dm-5', 'multipath_id': '330000000e32907d0'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:25.097216 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid 67d9145b-f424-411a-b3aa-f1b56dc42f2b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:25.163863 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aee2083d-e87e-4aaa-a446-f784ccea0d01 req-95411d1b-d187-47f0-bab1-cc7456fc33d2 service nova] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Received event network-vif-deleted-600c6c7f-5bc9-487a-9e11-8cd545ef22f7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:25.233821 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4496f6cd-b93a-4298-a116-562b4723229a tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:25.305000 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:25.372483 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Took 1.37 seconds to deallocate network for instance.
May 28 14:06:25.459967 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:06:25.469286 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Took 10.55 seconds to spawn the instance on the hypervisor.
May 28 14:06:25.469547 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:25.599984 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Attempting to attach volume 95ea995f-e935-4d7f-970f-b95b506c863b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:06:25.601261 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:06:25.601261 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:25.601261 np0000001643 nova-compute[98269]:   <alias name="ua-95ea995f-e935-4d7f-970f-b95b506c863b"/>
May 28 14:06:25.601261 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:06:25.601261 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:25.601261 np0000001643 nova-compute[98269]:   <serial>95ea995f-e935-4d7f-970f-b95b506c863b</serial>
May 28 14:06:25.601261 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:25.601261 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:06:25.662257 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:25.662460 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:25.662622 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:25.662768 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:25.662839 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] No waiting events found dispatching network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:25.662950 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received unexpected event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 for instance with vm_state active and task_state rebuild_spawning.
May 28 14:06:25.663044 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:25.663179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:25.663295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:25.663404 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:25.663561 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] No waiting events found dispatching network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:25.663673 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-4fc8b572-e253-4a26-835a-cac648624241 req-030e8939-c374-4956-933a-cdc23762e6f4 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received unexpected event network-vif-plugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 for instance with vm_state active and task_state rebuild_spawning.
May 28 14:06:25.776151 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:25.813908 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977185.8133152, b8315b4c-90be-498b-bdc8-1a775a1480bc => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:25.814425 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:06:25.814664 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] VM Resumed (Lifecycle Event)
May 28 14:06:25.816165 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:06:25.818930 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance spawned successfully.
May 28 14:06:25.819385 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:06:25.888824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:25.888986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:25.980031 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Took 17.11 seconds to build instance.
May 28 14:06:26.168782 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:26.317780 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:26.321153 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:26.330045 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:26.330242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:26.333478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:26.333478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:26.333478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:26.333478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:26.481728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ea9b58fa-2e15-4885-a91d-580ac7956f1a tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.622s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:26.553485 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:26.628987 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:26.629328 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:26.826696 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 14:06:26.827116 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977186.8268192, b8315b4c-90be-498b-bdc8-1a775a1480bc => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:26.827322 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] VM Started (Lifecycle Event)
May 28 14:06:26.836203 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:26.956631 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:26.965625 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.966110 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.966245 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.966469 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.966601 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.966870 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.967064 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.967336 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:26.967388 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:06:26.967546 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:06:27.133486 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:27.279711 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:27.280165 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:27.280165 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:27.280165 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] No VIF found with MAC fa:16:3e:a7:94:cb, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:27.321671 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:27.331659 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:27.337809 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:27.350233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:27.357843 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-changed-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:27.357981 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Refreshing instance network info cache due to event network-changed-a6d11da0-3e5d-4d81-890b-33bfa2b1583d. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:27.358132 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] Acquiring lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:27.358229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] Acquired lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:27.358371 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Refreshing network info cache for port a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:27.473345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:27.646312 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.757s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:27.648968 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.299s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:27.649099 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98269) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 14:06:27.731936 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Deleted allocations for instance cab3ed09-e0a5-4e51-b159-65f9f38398d0
May 28 14:06:27.739160 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:27.861507 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:27.916010 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [{"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:27.929701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:27.929934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:27.930178 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:27.930359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:27.931929 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:27.932960 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Terminating instance
May 28 14:06:28.271584 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:28.418802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:28.419261 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance network_info: |[{"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:06:28.419401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:28.421923 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:28.422105 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Start _get_guest_xml network_info=[{"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '0d3c19cb-5e22-4884-a97e-4163809df50f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '409cb876-fbae-4f7d-8e80-544174cb94b6', 'attached_at': '', 'detached_at': '', 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'serial': '0bb48f61-5540-460d-95d2-f0ef27a59003'}, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'cb130a3b-17b6-4217-8509-a8c8c74f854d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '409cb876-fbae-4f7d-8e80-544174cb94b6', 'attached_at': '', 'detached_at': '', 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'serial': '1f783b53-ba58-4c15-95ee-2b30fb9c5957'}, 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '03dda205-61fc-4db1-8c5b-b11f8ac65654', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '409cb876-fbae-4f7d-8e80-544174cb94b6', 'attached_at': '', 'detached_at': '', 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'serial': '7f27c099-929f-4674-ac6f-7f8e770116d8'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:06:28.425422 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:06:28.428876 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-702030566', uuid='409cb876-fbae-4f7d-8e80-544174cb94b6'), owner=OwnerMeta(userid='1a28d8974a9141cb8333d6ae154e7387', username='tempest-TaggedBootDevicesTest-1877897096-project-member', projectid='9378d3afdd7e4c58bb7884c3cdea9056', projectname='tempest-TaggedBootDevicesTest-1877897096'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977188.4264941) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:06:28.429140 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:06:28.429654 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:06:28.431012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:06:28.431296 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:06:28.432579 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:06:28.433086 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:06:28.433360 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:06:28.433587 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:06:28.435148 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:06:28.435431 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:06:28.435745 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:06:28.435979 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:06:28.436164 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:06:28.436332 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:06:28.436519 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:06:28.436716 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:06:28.443812 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:06:28.453357 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:06:28.453713 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:28.453880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:28.454646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:28.454950 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:06:28.476841 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:28.482499 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updated VIF entry in instance network info cache for port a6d11da0-3e5d-4d81-890b-33bfa2b1583d. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:28.482822 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updating instance_info_cache with network_info: [{"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:28.487009 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:28.489202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:28.498638 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:28.498638 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:28.499666 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:28.500370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.011s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:28.500908 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:28.509024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:28.509347 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:28.515194 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:28.515194 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:28.521747 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:28.521747 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003] added
May 28 14:06:28.533957 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:28.533957 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:28.533957 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:28.538811 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003] added
May 28 14:06:28.538811 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:28.538811 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:28.538811 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:28.538811 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:28.538811 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:28.538811 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:28.539126 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:28.539255 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:28.539393 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:28.542847 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:28.662712 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-846fadd5-3871-4c1a-b904-675bc0009500 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.014s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:28.663728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.190s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:28.663969 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:28.665403 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:06:28.676821 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eced8bf1-ed37-496d-94d2-924dce050834 req-c680061b-1bbd-41d4-8d7d-e2240f8c04af service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:28.677790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-eced8bf1-ed37-496d-94d2-924dce050834 req-c680061b-1bbd-41d4-8d7d-e2240f8c04af service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:28.677790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-eced8bf1-ed37-496d-94d2-924dce050834 req-c680061b-1bbd-41d4-8d7d-e2240f8c04af service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:28.677790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-eced8bf1-ed37-496d-94d2-924dce050834 req-c680061b-1bbd-41d4-8d7d-e2240f8c04af service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:28.677790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eced8bf1-ed37-496d-94d2-924dce050834 req-c680061b-1bbd-41d4-8d7d-e2240f8c04af service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:28.677790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eced8bf1-ed37-496d-94d2-924dce050834 req-c680061b-1bbd-41d4-8d7d-e2240f8c04af service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:28.748344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fc212589-e187-4996-a7ab-b913246e22d0 tempest-VolumesActionsTest-95313981 tempest-VolumesActionsTest-95313981-project-member] Lock "cab3ed09-e0a5-4e51-b159-65f9f38398d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.680s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:28.769433 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:28.778908 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:28.811583 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99902661300007 future=<Future at 0x71a77818c260 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:28.821205 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Instance destroyed successfully.
May 28 14:06:28.822960 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'resources' on Instance uuid 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:28.846036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:28.846242 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:28.880409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-41ce16f4-90a3-4c2b-95d1-3abaa608517e tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.603s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:28.924642 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:29.000384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2cc84cb3-b5f1-4aea-8bbd-f95cedcd85dc req-86a89440-d391-41ed-933e-15d678293daf service nova] Releasing lock "refresh_cache-0cb5afe2-5125-4261-b2f3-f0431bc65134" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:29.332716 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1095431235',display_name='tempest-AttachVolumeTestJSON-server-1095431235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-1095431235',id=15,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjV16J4NTxbu3xImz3Csr48OJOZhD0PrmLqZ2N1z3rSn9YNqcTWTTWxLbWpSEwjyyl7QajtG8wUyPByB+y/4r/tKjr+z1KKnkncuOYS4i8hC+ehLOmvhEjr5gW/aGwZyQ==',key_name='tempest-keypair-1411759417',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:03:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ot4tdg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:05:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:06:29.332716 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "address": "fa:16:3e:16:45:16", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd542e8b-1f", "ovs_interfaceid": "bd542e8b-1f1b-4e59-8c1b-fe44bfd93140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:29.332716 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:29.332716 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:06:29.333187 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:29.333465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd542e8b-1f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:29.335600 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:29.337329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:29.338093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:29.338244 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09b6ad14-9527-4452-9fc9-5cfaf437d958) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:29.342156 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:29.342156 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:29.347011 np0000001643 nova-compute[98269]: INFO os_vif [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:45:16,bridge_name='br-int',has_traffic_filtering=True,id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd542e8b-1f')
May 28 14:06:29.347011 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Deleting instance files /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc_del
May 28 14:06:29.347011 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Deletion of /opt/stack/data/nova/instances/0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc_del complete
May 28 14:06:29.348958 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:06:29.378285 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:29.379099 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:29.383136 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:29.435086 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:29.467378 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-changed-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:29.467690 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing instance network info cache due to event network-changed-027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:29.468318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:29.468470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:29.468671 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:29.534058 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:29.542475 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:29.548749 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:29.548749 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:29.557479 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:29.557479 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.569632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.574671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.588311 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updated VIF entry in instance network info cache for port c2c95821-5913-43a4-868b-7c483f5a2ed1. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:29.591149 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [{"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.591866 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.592251 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.595532 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:29.645783 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.40.100,3260]
May 28 14:06:29.645783 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.40.100,3260] successful.
May 28 14:06:29.645783 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.657898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.50.100,3260]
May 28 14:06:29.657898 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.50.100,3260] successful.
May 28 14:06:29.657898 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.664506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.672562 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.688472 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] HCTL ('15', '-', '-', 0) found on session 53 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:29.688472 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.693933 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:29.694266 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:29.694624 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:29.694716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:29.695917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] HCTL ('16', '-', '-', 0) found on session 54 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:29.696064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:29.710491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching for a device in session 53 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:29.710491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:29.718756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching for a device in session 54 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:29.718893 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:29.851486 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 14:06:29.852208 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:06:29.852406 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:06:29.852557 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:06:29.852788 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:29.895883 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Detaching volume 95ea995f-e935-4d7f-970f-b95b506c863b
May 28 14:06:29.910052 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid '0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid '0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc' (instance-0000000f)
May 28 14:06:29.917974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:29.962675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:29.964045 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:29.975853 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:29.981476 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:06:29.990285 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:29.993509 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Claim successful on node np0000001643
May 28 14:06:30.031004 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.032424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:30.058360 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Attempting to driver detach volume 95ea995f-e935-4d7f-970f-b95b506c863b from mountpoint /dev/vdb
May 28 14:06:30.072359 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found disk vdb by alias ua-95ea995f-e935-4d7f-970f-b95b506c863b {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:06:30.073823 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Found disk vdb by alias ua-95ea995f-e935-4d7f-970f-b95b506c863b {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:06:30.074996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Attempting to detach device vdb from instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:06:30.076882 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:06:30.076882 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:30.076882 np0000001643 nova-compute[98269]:   <alias name="ua-95ea995f-e935-4d7f-970f-b95b506c863b"/>
May 28 14:06:30.076882 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:06:30.076882 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:30.076882 np0000001643 nova-compute[98269]:   <serial>95ea995f-e935-4d7f-970f-b95b506c863b</serial>
May 28 14:06:30.076882 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:06:30.076882 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:30.076882 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:06:30.090000 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully detached device vdb from instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b from the persistent domain config.
May 28 14:06:30.090297 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] (1/8): Attempting to detach device vdb with device alias ua-95ea995f-e935-4d7f-970f-b95b506c863b from instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:06:30.091844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:06:30.091844 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:30.091844 np0000001643 nova-compute[98269]:   <alias name="ua-95ea995f-e935-4d7f-970f-b95b506c863b"/>
May 28 14:06:30.091844 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:06:30.091844 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:30.091844 np0000001643 nova-compute[98269]:   <serial>95ea995f-e935-4d7f-970f-b95b506c863b</serial>
May 28 14:06:30.091844 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:06:30.091844 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:30.091844 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:06:30.094733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1eae1793-668a-4cf4-85b2-7e39ad2cbfe7 req-d0c3f4d4-947c-4200-91c6-41b917378236 service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:30.136171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.140166 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:30.245343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.250686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:30.375017 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.377214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:06:30.382995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:30.499009 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:06:30.509416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.510186 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:30.621958 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.643771 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:30.715763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-95ea995f-e935-4d7f-970f-b95b506c863b for instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:06:30.716399 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977190.7158933, 67d9145b-f424-411a-b3aa-f1b56dc42f2b => ua-95ea995f-e935-4d7f-970f-b95b506c863b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:06:30.718915 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:30.767040 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:30.767384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] Acquiring lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:30.767947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:30.769863 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:30.770063 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] No waiting events found dispatching network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:30.770258 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-unplugged-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:30.770496 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Received event network-vif-deleted-bd542e8b-1f1b-4e59-8c1b-fe44bfd93140 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:30.770755 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Neutron deleted interface bd542e8b-1f1b-4e59-8c1b-fe44bfd93140; detaching it from the instance and deleting it from the info cache
May 28 14:06:30.778581 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully detached device vdb from instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b from the live domain config.
May 28 14:06:30.779704 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7080cfe2-aa2b-419f-bce7-554554417686 req-29c629c7-fae9-4c02-bf5e-5a1b1ae856d1 service nova] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Detach interface failed, port_id=bd542e8b-1f1b-4e59-8c1b-fe44bfd93140, reason: Instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:06:30.781620 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:06:30.781620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95ea995f-e935-4d7f-970f-b95b506c863b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:30.781620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:30.832635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.833100 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:30.868707 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updated VIF entry in instance network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:30.869295 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:30.926193 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:30.935755 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:31.046886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:31.047366 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:31.064045 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:31.142150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:31.145356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:31.230578 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:31.231312 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:31.323207 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:31.328522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:06:31.333916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:31.372251 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:31.372607 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:31.378862 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30d7529d-a3e0-43b5-be68-7aa649431933 req-fad2eb33-fd64-4f21-8414-cf6ecbb463c3 service nova] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:31.453939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:31.454365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:31.514940 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Found WWN 330000000cc91dec2 for multipath device dm-6 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:31.515535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.061s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:31.515857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== connect_volume: return (3061ms) {'type': 'block', 'scsi_wwn': '330000000cc91dec2', 'path': '/dev/dm-6', 'multipath_id': '330000000cc91dec2'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:31.515857 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc91dec2', 'path': '/dev/dm-6', 'multipath_id': '330000000cc91dec2'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:31.523533 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.742s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:31.527932 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95ea995f-e935-4d7f-970f-b95b506c863b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:06:31.528157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:31.562465 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:31.563025 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:31.563384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '54')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:06:31.563384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', '51')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:31.564727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b', '52')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:31.565873 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c7644a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:06:31.566316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:06:31.566533 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Flush multipath device 330000000e32907d0 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:06:31.567473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:31.568013 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:06:31.570089 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:06:31.571259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:31.586858 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Took 1.73 seconds to deallocate network for instance.
May 28 14:06:31.607042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:31.618849 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:31.619634 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=11819MB free_disk=74.12810134887695GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:06:31.619799 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:31.656700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:31.722197 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:06:31.722462 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:06:31.726195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:06:31.739851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:06:31.740276 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:06:31.757697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:31.789341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.40.100,3260]
May 28 14:06:31.789341 np0000001643 nova-compute[98269]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.40.100,3260] successful.
May 28 14:06:31.789341 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:31.813024 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:31.825933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:31.861929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.50.100,3260]
May 28 14:06:31.861929 np0000001643 nova-compute[98269]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-95ea995f-e935-4d7f-970f-b95b506c863b, portal: 192.168.50.100,3260] successful.
May 28 14:06:31.861929 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:31.878702 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:31.885842 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:31.886214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:31.886404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] <== disconnect_volume: return (1104ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:31.886589 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:06:32.033284 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:06:32.033284 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:32.033284 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:32.102522 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:32.390409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.427s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:32.391974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.771s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:32.392660 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:06:32.474759 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'flavor' on Instance uuid 67d9145b-f424-411a-b3aa-f1b56dc42f2b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:32.899220 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:06:32.899220 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:06:32.899789 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:32.899789 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:32.998782 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81cf50caaafd43ffae63aff9c9258528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4618bb9b554fb8af8f26aae95c016a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:06:33.414422 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:06:33.483626 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5739fc64-c907-4bf4-8049-748d5e2ee6c8 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.104s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:33.493988 np0000001643 nova-compute[98269]: WARNING nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 28 14:06:33.494164 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 90b0ea10-2b38-4907-aa11-02454a817a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.494359 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 27823c45-9fce-41b2-923b-a5a907ef029c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.494425 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.495927 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.496141 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance b8315b4c-90be-498b-bdc8-1a775a1480bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.496247 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.497230 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.497713 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 409cb876-fbae-4f7d-8e80-544174cb94b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.497713 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 512a75c8-713d-418b-adc8-07b2bf513923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.497713 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d6202b83-7043-4c19-81b6-13f2e5c64fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:06:33.497713 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:06:33.498073 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:06:31 up 33 min,  2 users,  load average: 9.85, 7.32, 3.70\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_6a74849f3fb24097a5a42457746f02d2': '2', 'io_workload': '2', 'num_proj_ac4618bb9b554fb8af8f26aae95c016a': '5', 'num_proj_38e8657cdaa8482182b12ae39785f074': '1', 'num_proj_a792bdb63c954739ad33cb2fedeedee4': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_9378d3afdd7e4c58bb7884c3cdea9056': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:06:33.716871 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Successfully created port: 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:33.809276 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:33.809476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:33.810786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:33.810786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:33.810786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:33.816032 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Terminating instance
May 28 14:06:33.927635 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:06:34.160627 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:34.160945 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:34.321319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:06:34.343642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:34.352691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:34.374439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:34.390281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:34.413526 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Successfully updated port: 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:34.416742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:34.441251 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:34.488021 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:34.488021 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing instance network info cache due to event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:34.488021 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:34.492310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:34.493390 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing network info cache for port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:34.574192 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5de42c8a-b6d2-43df-8602-f3d722eda976 req-419d7a7f-7cf8-4cc3-b433-73caa329488d service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-vif-unplugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:34.574657 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5de42c8a-b6d2-43df-8602-f3d722eda976 req-419d7a7f-7cf8-4cc3-b433-73caa329488d service nova] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:34.575689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5de42c8a-b6d2-43df-8602-f3d722eda976 req-419d7a7f-7cf8-4cc3-b433-73caa329488d service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:34.575689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5de42c8a-b6d2-43df-8602-f3d722eda976 req-419d7a7f-7cf8-4cc3-b433-73caa329488d service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:34.576025 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5de42c8a-b6d2-43df-8602-f3d722eda976 req-419d7a7f-7cf8-4cc3-b433-73caa329488d service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] No waiting events found dispatching network-vif-unplugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:34.576299 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5de42c8a-b6d2-43df-8602-f3d722eda976 req-419d7a7f-7cf8-4cc3-b433-73caa329488d service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-vif-unplugged-cfb057e3-cb74-4043-93db-9aad57a412dc for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:34.664312 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:34.672598 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99965402099997 future=<Future at 0x71a75c2f0770 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:34.681960 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Instance destroyed successfully.
May 28 14:06:34.681960 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lazy-loading 'resources' on Instance uuid 67d9145b-f424-411a-b3aa-f1b56dc42f2b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:34.915806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:34.940021 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:06:34.942318 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:06:34.943860 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Creating image(s)
May 28 14:06:34.944377 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:34.944559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:34.945345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:34.945815 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:34.948831 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:34.950586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:34.999519 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:35.047133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:35.047742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:35.048419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:35.049126 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:35.053237 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:35.053761 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:35.095367 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:35.106155 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.073s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:35.106612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:06:35.121596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:35.122411 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:35.122975 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:35.125362 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:35.125778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:35.126231 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:35.139795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:35.139795 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:35.148896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:35.148896 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:35.152626 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:35.153099 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:35.178653 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:06:35.182402 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957] added
May 28 14:06:35.182402 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:35.182402 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:35.182402 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:35.182402 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:35.182402 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:35.182402 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:35.183296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957] added
May 28 14:06:35.183296 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:35.183296 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:35.183296 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:35.183296 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:35.183296 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:35.183296 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:35.183671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.791s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:35.184037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:35.187723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.080s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:35.189077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:35.190613 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:06:35.192991 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.010s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:35.195428 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0644(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:35.197689 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:35.198335 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-192110835',display_name='tempest-AttachVolumeNegativeTest-server-192110835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumenegativetest-server-192110835',id=27,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmnR26C+q4jGYK/NvoqlfxDAZ+EOhgWBERdz2lr7ZENLnNW2f3eKhbOU7gPWTDZw4e/InB0eP/MKvUa1WjZcgOIBW2Moe8Ff3/O6GI6QXBBw8+n33dtknD8E2Oy9R3wBA==',key_name='tempest-keypair-2033227267',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:05:39Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a792bdb63c954739ad33cb2fedeedee4',ramdisk_id='',reservation_id='r-60tvowlh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-703881462',owner_user_name='tempest-AttachVolumeNegativeTest-703881462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:05:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d135543093d4ca0849ab043df8e19ca',uuid=67d9145b-f424-411a-b3aa-f1b56dc42f2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:06:35.199665 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.064(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:35.201098 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converting VIF {"id": "cfb057e3-cb74-4043-93db-9aad57a412dc", "address": "fa:16:3e:a7:94:cb", "network": {"id": "414e52fb-e62d-40a2-952d-1c9ddfc7f2af", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1400472804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a792bdb63c954739ad33cb2fedeedee4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb057e3-cb", "ovs_interfaceid": "cfb057e3-cb74-4043-93db-9aad57a412dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:35.203176 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:35.203592 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:94:cb,bridge_name='br-int',has_traffic_filtering=True,id=cfb057e3-cb74-4043-93db-9aad57a412dc,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb057e3-cb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:35.204134 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:94:cb,bridge_name='br-int',has_traffic_filtering=True,id=cfb057e3-cb74-4043-93db-9aad57a412dc,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb057e3-cb') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:06:35.209315 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:35.209696 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfb057e3-cb, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:35.212277 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:35.214742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:35.221901 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:35.222927 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f26ef40-8af2-4ae6-87c4-d79092011063) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:35.224226 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:35.226113 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:35.230550 np0000001643 nova-compute[98269]: INFO os_vif [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:94:cb,bridge_name='br-int',has_traffic_filtering=True,id=cfb057e3-cb74-4043-93db-9aad57a412dc,network=Network(414e52fb-e62d-40a2-952d-1c9ddfc7f2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb057e3-cb')
May 28 14:06:35.230945 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Deleting instance files /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b_del
May 28 14:06:35.231852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk 1073741824" returned: 0 in 0.078s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:35.233034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:35.233034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:35.252806 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Deletion of /opt/stack/data/nova/instances/67d9145b-f424-411a-b3aa-f1b56dc42f2b_del complete
May 28 14:06:35.315305 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Deleted allocations for instance 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc
May 28 14:06:35.357723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.124s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:35.361658 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:06:35.361658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:35.381271 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:35.469055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:35.470737 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Cannot resize image /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:06:35.471713 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:06:35.472494 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Ensure instance console log exists: /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:06:35.472768 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:35.472969 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:35.473109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:35.771257 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 14:06:35.771992 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:06:35.772170 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:06:35.772298 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:06:35.772622 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:35.877860 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:35.888731 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-00d70944-7b61-443a-9538-064a1e41f9ef req-6e60a07c-01cc-423b-afe5-8ea03ad9939b service nova] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:35.891738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:35.892006 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:06:36.198909 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:36.204542 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:36.217198 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:36.217198 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:36.227869 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:36.227869 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.237001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.245041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.263967 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.264482 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.265484 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:36.331578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.40.100,3260]
May 28 14:06:36.331578 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.40.100,3260] successful.
May 28 14:06:36.331578 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.332888 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-146e68dc-4681-46c4-9d64-a99d19c00bb5 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.403s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:36.337396 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.50.100,3260]
May 28 14:06:36.337396 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.50.100,3260] successful.
May 28 14:06:36.337396 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.349001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.359036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.385191 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:36.386313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:36.386519 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:36.388736 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] HCTL ('17', '-', '-', 0) found on session 57 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:36.388914 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.401220 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:36.402617 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:36.403818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.278s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:36.403818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:36.405836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] HCTL ('18', '-', '-', 0) found on session 58 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:36.405836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:36.416962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching for a device in session 57 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:36.417243 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:36.426070 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching for a device in session 58 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:36.426070 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:36.458467 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5da15067-a526-41ee-ade4-73a559948960 req-d00c4c78-3db8-496c-8958-babff328eb8b service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-vif-deleted-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:36.458724 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-5da15067-a526-41ee-ade4-73a559948960 req-d00c4c78-3db8-496c-8958-babff328eb8b service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Neutron deleted interface cfb057e3-cb74-4043-93db-9aad57a412dc; detaching it from the instance and deleting it from the info cache
May 28 14:06:36.463912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5da15067-a526-41ee-ade4-73a559948960 req-d00c4c78-3db8-496c-8958-babff328eb8b service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Detach interface failed, port_id=cfb057e3-cb74-4043-93db-9aad57a412dc, reason: Instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:06:36.524259 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:36.668608 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3be4e370-2c3a-4ca4-a10e-a557b3f07da2 req-9b833b8a-e0b9-4001-a8ce-6d686df056e1 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-vif-unplugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:36.668978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3be4e370-2c3a-4ca4-a10e-a557b3f07da2 req-9b833b8a-e0b9-4001-a8ce-6d686df056e1 service nova] Acquiring lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:36.669204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3be4e370-2c3a-4ca4-a10e-a557b3f07da2 req-9b833b8a-e0b9-4001-a8ce-6d686df056e1 service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:36.669341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3be4e370-2c3a-4ca4-a10e-a557b3f07da2 req-9b833b8a-e0b9-4001-a8ce-6d686df056e1 service nova] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:36.669564 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3be4e370-2c3a-4ca4-a10e-a557b3f07da2 req-9b833b8a-e0b9-4001-a8ce-6d686df056e1 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] No waiting events found dispatching network-vif-unplugged-cfb057e3-cb74-4043-93db-9aad57a412dc {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:36.670048 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3be4e370-2c3a-4ca4-a10e-a557b3f07da2 req-9b833b8a-e0b9-4001-a8ce-6d686df056e1 service nova] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Received event network-vif-unplugged-cfb057e3-cb74-4043-93db-9aad57a412dc for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:36.750957 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:36.902107 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:36.942433 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:37.126347 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:06:37.405802 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Took 1.63 seconds to deallocate network for instance.
May 28 14:06:37.447341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:37.447341 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance network_info: |[{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:06:37.448084 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Start _get_guest_xml network_info=[{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:06:37.452758 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:06:37.456389 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='d6202b83-7043-4c19-81b6-13f2e5c64fef'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977197.4549787) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:06:37.461694 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:06:37.461694 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:06:37.463698 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:06:37.464001 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:06:37.469473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:06:37.472090 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:06:37.501201 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=32,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-zh8rv90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=d6202b83-7043-4c19-81b6-13f2e5c64fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:37.501201 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:37.503637 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:37.505633 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'pci_devices' on Instance uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:37.924067 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:37.924067 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:38.016147 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] End _get_guest_xml xml=<domain type="qemu">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <uuid>d6202b83-7043-4c19-81b6-13f2e5c64fef</uuid>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <name>instance-00000020</name>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:name>multiattach-server-1</nova:name>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:06:37</nova:creationTime>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         <nova:port uuid="8e595d6c-8803-4a5b-9a05-b21d4c21b3d2">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <system>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <entry name="serial">d6202b83-7043-4c19-81b6-13f2e5c64fef</entry>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <entry name="uuid">d6202b83-7043-4c19-81b6-13f2e5c64fef</entry>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </system>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <os>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   </os>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <features>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   </features>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   <devices>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:be:b0:8b"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <target dev="tap8e595d6c-88"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/console.log" append="off"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </serial>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <video>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </video>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </rng>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:   </devices>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]: </domain>
May 28 14:06:38.016147 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:06:38.023368 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Preparing to wait for external event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:38.023368 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:38.023368 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:38.023368 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:38.030567 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=32,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-zh8rv90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=d6202b83-7043-4c19-81b6-13f2e5c64fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:38.030567 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:38.031426 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:38.031687 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:38.032375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:38.033471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:38.033471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:38.039812 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:38.040040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3b14d3b-9a5a-5703-8292-986cc4a7ef0d', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:38.042928 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:38.043702 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:38.050053 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:38.050651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e595d6c-88, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:38.050904 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e595d6c-88, col_values=(('qos', UUID('b1718ffd-1bc9-4fd9-97bb-203575773a42')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:38.052689 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e595d6c-88, col_values=(('external_ids', {'iface-id': '8e595d6c-8803-4a5b-9a05-b21d4c21b3d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:b0:8b', 'vm-uuid': 'd6202b83-7043-4c19-81b6-13f2e5c64fef'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:38.052689 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:38.054282 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:38.067504 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:38.067651 np0000001643 nova-compute[98269]: INFO os_vif [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88')
May 28 14:06:38.145714 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Found WWN 330000000d2207249 for multipath device dm-9 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:38.145714 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:38.145714 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== connect_volume: return (6112ms) {'type': 'block', 'scsi_wwn': '330000000d2207249', 'path': '/dev/dm-9', 'multipath_id': '330000000d2207249'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:38.145714 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d2207249', 'path': '/dev/dm-9', 'multipath_id': '330000000d2207249'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:38.474529 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004931260000375914 future=<Future at 0x71a78018ffe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:38.474529 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:38.475077 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.335909277999917 future=<Future at 0x71a77818c260 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:38.475077 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.335831783000003 future=<Future at 0x71a77818c260 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:38.475077 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Emitting event <LifecycleEvent: 1779977183.473755, cab3ed09-e0a5-4e51-b159-65f9f38398d0 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:38.475205 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] VM Stopped (Lifecycle Event)
May 28 14:06:38.654033 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:06:38.655493 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:38.655493 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:38.656102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:38.656539 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:06:38.673553 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:38.674232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:38.674750 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:38.674973 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:38.675404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:38.676253 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:38.691849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:38.691849 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:38.705316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:38.705316 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8] added
May 28 14:06:38.708252 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:38.708252 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:38.708252 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:38.716943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8] added
May 28 14:06:38.716943 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:38.716943 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:38.716943 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:38.716943 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:38.716943 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:38.716943 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:38.716943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:38.717301 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:38.717301 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:38.720601 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:38.720910 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:38.985932 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: cab3ed09-e0a5-4e51-b159-65f9f38398d0] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:39.226665 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:39.446590 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:39.602272 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:39.602770 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:39.602770 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:be:b0:8b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:39.603344 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Using config drive
May 28 14:06:39.706561 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:39.717718 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:39.729618 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:39.729618 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.735700 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.812s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:39.740041 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:39.740041 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.749629 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.761489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.773479 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.773822 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.791236 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.791558 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:39.836354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.40.100,3260]
May 28 14:06:39.836354 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.40.100,3260] successful.
May 28 14:06:39.836354 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.837309 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Deleted allocations for instance 67d9145b-f424-411a-b3aa-f1b56dc42f2b
May 28 14:06:39.855920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.869887 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.50.100,3260]
May 28 14:06:39.869887 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.50.100,3260] successful.
May 28 14:06:39.869887 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.888979 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:39.888979 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:39.891665 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] HCTL ('19', '-', '-', 0) found on session 59 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:39.891665 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:39.892425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:39.925091 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching for a device in session 59 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:39.925311 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:39.935481 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.258s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] HCTL ('20', '-', '-', 0) found on session 60 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:39.935481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:39.958823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Searching for a device in session 60 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:39.958823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:40.117938 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:40.165205 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:40.165914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:40.343880 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Creating config drive at /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config
May 28 14:06:40.357553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqjoknggy {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:40.431908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqjoknggy" returned: 0 in 0.074s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:40.674859 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:06:40.679289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:06:40.858722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bae05f2-ce95-48ca-b89e-2959878b1e31 tempest-AttachVolumeNegativeTest-703881462 tempest-AttachVolumeNegativeTest-703881462-project-member] Lock "67d9145b-f424-411a-b3aa-f1b56dc42f2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.049s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:41.024116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:41.059743 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:41.061305 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:41.161018 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:41.280384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:41.280933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:41.291968 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:06:41.293152 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Claim successful on node np0000001643
May 28 14:06:41.296163 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:41.298228 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:41.298947 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-547e7e1a-bed2-4c48-9720-4acb4de50eb0 req-9b02bd80-1b8e-4767-9357-1c4ab016acb2 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:41.299201 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-547e7e1a-bed2-4c48-9720-4acb4de50eb0 req-9b02bd80-1b8e-4767-9357-1c4ab016acb2 service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:41.299405 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-547e7e1a-bed2-4c48-9720-4acb4de50eb0 req-9b02bd80-1b8e-4767-9357-1c4ab016acb2 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:41.300211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-547e7e1a-bed2-4c48-9720-4acb4de50eb0 req-9b02bd80-1b8e-4767-9357-1c4ab016acb2 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:41.300417 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-547e7e1a-bed2-4c48-9720-4acb4de50eb0 req-9b02bd80-1b8e-4767-9357-1c4ab016acb2 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Processing event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:41.706715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Found WWN 330000000eb13186c for multipath device dm-10 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:41.707247 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:41.709267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '330000000eb13186c', 'path': '/dev/dm-10', 'multipath_id': '330000000eb13186c'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:41.709493 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eb13186c', 'path': '/dev/dm-10', 'multipath_id': '330000000eb13186c'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:42.030178 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:06:42.219209 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:42.220192 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.223089 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:68:ea,bridge_name='br-int',has_traffic_filtering=True,id=300da7b6-2392-463e-9abf-448f59da647d,network=Network(f33b58c7-1a00-462b-bcf5-d5bbf59254fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300da7b6-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.224309 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:42.225136 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.225136 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:cb:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac3a901d-4ef1-4379-974d-324dded4930d,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac3a901d-4e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.226655 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:42.228187 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.229646 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:2e:40,bridge_name='br-int',has_traffic_filtering=True,id=89ddc5d3-9aaa-4728-a54a-054a2d23b0e3,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89ddc5d3-9a') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.230739 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:42.230967 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.234117 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e1:ff,bridge_name='br-int',has_traffic_filtering=True,id=28ebef22-93cd-4d32-90a8-9511a7ed313a,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ebef22-93') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.235273 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:42.236079 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.236079 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1b:8e,bridge_name='br-int',has_traffic_filtering=True,id=9d834084-9ddc-48db-9f45-8d878ab91ac5,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d834084-9d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.237049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:42.237049 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.237931 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=9b97fba0-f944-4595-8a3b-127f5cc7d846,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b97fba0-f9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.238558 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:42.238558 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.239131 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0f:2b,bridge_name='br-int',has_traffic_filtering=True,id=c2c95821-5913-43a4-868b-7c483f5a2ed1,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c95821-59') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.239683 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lazy-loading 'pci_devices' on Instance uuid 409cb876-fbae-4f7d-8e80-544174cb94b6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:42.242956 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:06:42.244416 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977202.24372, d6202b83-7043-4c19-81b6-13f2e5c64fef => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:42.244416 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] VM Started (Lifecycle Event)
May 28 14:06:42.250039 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:06:42.254888 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance spawned successfully.
May 28 14:06:42.256123 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:06:42.746393 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] End _get_guest_xml xml=<domain type="qemu">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <uuid>409cb876-fbae-4f7d-8e80-544174cb94b6</uuid>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <name>instance-0000001e</name>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:name>tempest-device-tagging-server-702030566</nova:name>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:06:28</nova:creationTime>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:user uuid="1a28d8974a9141cb8333d6ae154e7387">tempest-TaggedBootDevicesTest-1877897096-project-member</nova:user>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:project uuid="9378d3afdd7e4c58bb7884c3cdea9056">tempest-TaggedBootDevicesTest-1877897096</nova:project>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:port uuid="300da7b6-2392-463e-9abf-448f59da647d">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:port uuid="ac3a901d-4ef1-4379-974d-324dded4930d">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:port uuid="89ddc5d3-9aaa-4728-a54a-054a2d23b0e3">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.192" ipVersion="4"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:port uuid="28ebef22-93cd-4d32-90a8-9511a7ed313a">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:port uuid="9d834084-9ddc-48db-9f45-8d878ab91ac5">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.1.67" ipVersion="4"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:port uuid="9b97fba0-f944-4595-8a3b-127f5cc7d846">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         <nova:port uuid="c2c95821-5913-43a4-868b-7c483f5a2ed1">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <system>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <entry name="serial">409cb876-fbae-4f7d-8e80-544174cb94b6</entry>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <entry name="uuid">409cb876-fbae-4f7d-8e80-544174cb94b6</entry>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </system>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <os>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   </os>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <features>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   </features>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   <devices>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6/disk.config"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <alias name="ua-0bb48f61-5540-460d-95d2-f0ef27a59003"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-6"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <serial>0bb48f61-5540-460d-95d2-f0ef27a59003</serial>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <alias name="ua-1f783b53-ba58-4c15-95ee-2b30fb9c5957"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-9"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <serial>1f783b53-ba58-4c15-95ee-2b30fb9c5957</serial>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <alias name="ua-7f27c099-929f-4674-ac6f-7f8e770116d8"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-10"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="vdc" bus="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <serial>7f27c099-929f-4674-ac6f-7f8e770116d8</serial>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:d2:68:ea"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="tap300da7b6-23"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:46:cb:5b"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="tapac3a901d-4e"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:49:2e:40"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="tap89ddc5d3-9a"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:c7:e1:ff"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="tap28ebef22-93"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:af:1b:8e"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="tap9d834084-9d"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:dd:75:a0"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="tap9b97fba0-f9"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:6c:0f:2b"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <target dev="tapc2c95821-59"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6/console.log" append="off"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </serial>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <video>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </video>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </rng>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:   </devices>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]: </domain>
May 28 14:06:42.746393 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Preparing to wait for external event network-vif-plugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Preparing to wait for external event network-vif-plugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Preparing to wait for external event network-vif-plugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Preparing to wait for external event network-vif-plugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Preparing to wait for external event network-vif-plugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Preparing to wait for external event network-vif-plugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Preparing to wait for external event network-vif-plugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:42.757676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:68:ea,bridge_name='br-int',has_traffic_filtering=True,id=300da7b6-2392-463e-9abf-448f59da647d,network=Network(f33b58c7-1a00-462b-bcf5-d5bbf59254fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300da7b6-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:68:ea,bridge_name='br-int',has_traffic_filtering=True,id=300da7b6-2392-463e-9abf-448f59da647d,network=Network(f33b58c7-1a00-462b-bcf5-d5bbf59254fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300da7b6-23') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.764481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09e9d036-1246-5d4d-b903-7a4ff29d06fd', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.767517 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.768287 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.775510 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:42.780812 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.782175 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap300da7b6-23, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.782175 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap300da7b6-23, col_values=(('qos', UUID('c99b4db3-45c9-41ec-a23b-9f1b28b4d5b0')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.782175 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap300da7b6-23, col_values=(('external_ids', {'iface-id': '300da7b6-2392-463e-9abf-448f59da647d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:68:ea', 'vm-uuid': '409cb876-fbae-4f7d-8e80-544174cb94b6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.784244 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:42.784547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.784770 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:42.785690 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:42.787152 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:42.790636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.792146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:42.792146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:42.801282 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.812778 np0000001643 nova-compute[98269]: INFO os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:68:ea,bridge_name='br-int',has_traffic_filtering=True,id=300da7b6-2392-463e-9abf-448f59da647d,network=Network(f33b58c7-1a00-462b-bcf5-d5bbf59254fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300da7b6-23')
May 28 14:06:42.814200 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:42.814433 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.815100 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:cb:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac3a901d-4ef1-4379-974d-324dded4930d,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac3a901d-4e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.816205 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cb:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac3a901d-4ef1-4379-974d-324dded4930d,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac3a901d-4e') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:42.816205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.816205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.818475 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:42.819692 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.820020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '337a366f-0f9f-5310-b4de-356f134ab8b6', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.821433 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.822955 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.832213 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.836036 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.837362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac3a901d-4e, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.837362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac3a901d-4e, col_values=(('qos', UUID('3b9cf073-29a8-4a49-a344-e70e0b885730')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.837362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac3a901d-4e, col_values=(('external_ids', {'iface-id': 'ac3a901d-4ef1-4379-974d-324dded4930d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:cb:5b', 'vm-uuid': '409cb876-fbae-4f7d-8e80-544174cb94b6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.839877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.842518 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.855515 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.857253 np0000001643 nova-compute[98269]: INFO os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cb:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac3a901d-4ef1-4379-974d-324dded4930d,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac3a901d-4e')
May 28 14:06:42.858537 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:42.858826 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.859602 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:2e:40,bridge_name='br-int',has_traffic_filtering=True,id=89ddc5d3-9aaa-4728-a54a-054a2d23b0e3,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89ddc5d3-9a') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.859898 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2e:40,bridge_name='br-int',has_traffic_filtering=True,id=89ddc5d3-9aaa-4728-a54a-054a2d23b0e3,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89ddc5d3-9a') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:42.860975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.861567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.861567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:42.862591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.863686 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51e9291d-564e-5e25-937d-73001bc383bb', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.865816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.865816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.880083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.882320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.882320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89ddc5d3-9a, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.882320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89ddc5d3-9a, col_values=(('qos', UUID('0665ed44-c923-462f-a213-53c09e14cb49')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.882320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89ddc5d3-9a, col_values=(('external_ids', {'iface-id': '89ddc5d3-9aaa-4728-a54a-054a2d23b0e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:2e:40', 'vm-uuid': '409cb876-fbae-4f7d-8e80-544174cb94b6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.884342 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.886489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.907293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.908573 np0000001643 nova-compute[98269]: INFO os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2e:40,bridge_name='br-int',has_traffic_filtering=True,id=89ddc5d3-9aaa-4728-a54a-054a2d23b0e3,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89ddc5d3-9a')
May 28 14:06:42.909181 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:42.909564 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.918650 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e1:ff,bridge_name='br-int',has_traffic_filtering=True,id=28ebef22-93cd-4d32-90a8-9511a7ed313a,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ebef22-93') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.920716 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e1:ff,bridge_name='br-int',has_traffic_filtering=True,id=28ebef22-93cd-4d32-90a8-9511a7ed313a,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ebef22-93') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:42.920716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.920716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.920716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:42.924263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.924263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa52f2a3-f3cc-5b68-8254-5db1b46e59a7', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.926238 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.927146 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.948673 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.952676 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.952676 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28ebef22-93, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.952864 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28ebef22-93, col_values=(('qos', UUID('60cc60b9-08ed-4fd1-ae6a-b3ad18960a7a')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.953051 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28ebef22-93, col_values=(('external_ids', {'iface-id': '28ebef22-93cd-4d32-90a8-9511a7ed313a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:e1:ff', 'vm-uuid': '409cb876-fbae-4f7d-8e80-544174cb94b6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.956792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.958428 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:42.977775 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.979262 np0000001643 nova-compute[98269]: INFO os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e1:ff,bridge_name='br-int',has_traffic_filtering=True,id=28ebef22-93cd-4d32-90a8-9511a7ed313a,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ebef22-93')
May 28 14:06:42.981060 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:42.981235 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:42.981729 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1b:8e,bridge_name='br-int',has_traffic_filtering=True,id=9d834084-9ddc-48db-9f45-8d878ab91ac5,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d834084-9d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:42.981943 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1b:8e,bridge_name='br-int',has_traffic_filtering=True,id=9d834084-9ddc-48db-9f45-8d878ab91ac5,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d834084-9d') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:42.983728 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.983728 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.983728 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:42.984237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.984506 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b813959-cb66-587d-8007-8752fdde1cd5', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:42.985616 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:42.986570 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:43.015859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.019514 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.020062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d834084-9d, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.020599 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d834084-9d, col_values=(('qos', UUID('d47a7c34-281d-47c7-98aa-b52ba460bb67')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.020599 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d834084-9d, col_values=(('external_ids', {'iface-id': '9d834084-9ddc-48db-9f45-8d878ab91ac5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:1b:8e', 'vm-uuid': '409cb876-fbae-4f7d-8e80-544174cb94b6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.025465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:43.056657 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.058771 np0000001643 nova-compute[98269]: INFO os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1b:8e,bridge_name='br-int',has_traffic_filtering=True,id=9d834084-9ddc-48db-9f45-8d878ab91ac5,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d834084-9d')
May 28 14:06:43.059987 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:43.061323 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:43.061323 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=9b97fba0-f944-4595-8a3b-127f5cc7d846,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b97fba0-f9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:43.062004 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=9b97fba0-f944-4595-8a3b-127f5cc7d846,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b97fba0-f9') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:43.062481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.062959 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.063281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:43.065513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.065513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9149ba84-9f4a-5c2f-86d1-ec44b1144fc8', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.069063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:43.105581 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.109000 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.109178 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b97fba0-f9, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.109763 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b97fba0-f9, col_values=(('qos', UUID('74d41479-0c3e-4b00-9217-6463adbe9c28')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.109953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b97fba0-f9, col_values=(('external_ids', {'iface-id': '9b97fba0-f944-4595-8a3b-127f5cc7d846', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:75:a0', 'vm-uuid': '409cb876-fbae-4f7d-8e80-544174cb94b6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.112576 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.114366 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:43.155214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.156511 np0000001643 nova-compute[98269]: INFO os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=9b97fba0-f944-4595-8a3b-127f5cc7d846,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b97fba0-f9')
May 28 14:06:43.157478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:43.157736 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:43.159143 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0f:2b,bridge_name='br-int',has_traffic_filtering=True,id=c2c95821-5913-43a4-868b-7c483f5a2ed1,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c95821-59') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:43.159143 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0f:2b,bridge_name='br-int',has_traffic_filtering=True,id=c2c95821-5913-43a4-868b-7c483f5a2ed1,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c95821-59') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:43.159143 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.159143 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.159414 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:43.160394 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.160596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '877a7f59-42cf-53ac-b5fe-1886a6018110', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.161725 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.162677 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:43.170621 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:43.171028 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:06:43.197700 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.199659 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.199899 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2c95821-59, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.200293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2c95821-59, col_values=(('qos', UUID('d3ad94ec-696c-4032-99ba-ca02dab15a8b')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.200507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2c95821-59, col_values=(('external_ids', {'iface-id': 'c2c95821-5913-43a4-868b-7c483f5a2ed1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:0f:2b', 'vm-uuid': '409cb876-fbae-4f7d-8e80-544174cb94b6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:43.202966 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.204605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:43.242674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:43.244787 np0000001643 nova-compute[98269]: INFO os_vif [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0f:2b,bridge_name='br-int',has_traffic_filtering=True,id=c2c95821-5913-43a4-868b-7c483f5a2ed1,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c95821-59')
May 28 14:06:43.288887 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:06:43.288887 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977203.2877386, d6202b83-7043-4c19-81b6-13f2e5c64fef => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:43.288887 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] VM Paused (Lifecycle Event)
May 28 14:06:43.322221 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Took 8.38 seconds to spawn the instance on the hypervisor.
May 28 14:06:43.323712 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:43.383961 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b0ad968d-06d8-44ab-82a8-80a5e4651cd1 req-99d5cba3-e48a-4346-9b86-2b7d27e74de8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:43.383961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b0ad968d-06d8-44ab-82a8-80a5e4651cd1 req-99d5cba3-e48a-4346-9b86-2b7d27e74de8 service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:43.383961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b0ad968d-06d8-44ab-82a8-80a5e4651cd1 req-99d5cba3-e48a-4346-9b86-2b7d27e74de8 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:43.383961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b0ad968d-06d8-44ab-82a8-80a5e4651cd1 req-99d5cba3-e48a-4346-9b86-2b7d27e74de8 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:43.383961 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b0ad968d-06d8-44ab-82a8-80a5e4651cd1 req-99d5cba3-e48a-4346-9b86-2b7d27e74de8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] No waiting events found dispatching network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:43.383961 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b0ad968d-06d8-44ab-82a8-80a5e4651cd1 req-99d5cba3-e48a-4346-9b86-2b7d27e74de8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received unexpected event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 for instance with vm_state building and task_state spawning.
May 28 14:06:43.674096 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:06:43.790734 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:43.798136 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977203.7977774, d6202b83-7043-4c19-81b6-13f2e5c64fef => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:43.798370 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] VM Resumed (Lifecycle Event)
May 28 14:06:43.810992 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004175389999545587 future=<Future at 0x71a77818c260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:43.811126 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:43.816896 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.860954459000141 future=<Future at 0x71a75c2f0770 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:43.816896 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.8608677879999505 future=<Future at 0x71a75c2f0770 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:43.816896 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] Emitting event <LifecycleEvent: 1779977188.8104758, 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:43.816896 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] VM Stopped (Lifecycle Event)
May 28 14:06:43.847231 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Took 13.99 seconds to build instance.
May 28 14:06:44.185745 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.905s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:44.186524 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:06:44.302937 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:44.304691 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:44.316279 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6c2731e8-9838-4686-83eb-d5c8e33a6927 tempest-VolumesAdminNegativeTest-1757520100 tempest-VolumesAdminNegativeTest-1757520100-project-member] [instance: 0ed1057f-1a4c-46a8-a819-7b9b7dc0b9cc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:44.350457 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.504s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:44.451550 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:44.695584 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:06:44.695790 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:06:44.696072 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:44.696373 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:44.771231 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:44.772192 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:44.772192 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] No VIF found with MAC fa:16:3e:d2:68:ea, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:44.772192 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] No VIF found with MAC fa:16:3e:af:1b:8e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:44.772871 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Using config drive
May 28 14:06:44.799509 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2ab771f08c245c7a7dffca595835dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706c08c92c6844b3ab7b4019269eabad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:06:45.213586 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:06:45.313326 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:45.532965 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Successfully created port: cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:06:45.725646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:06:46.047173 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:46.148010 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Creating config drive at /opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6/disk.config
May 28 14:06:46.153054 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphm_lezsg {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:46.179519 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-changed-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:46.179519 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing instance network info cache due to event network-changed-027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:46.186319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:46.187284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:46.187565 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:46.242432 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphm_lezsg" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:46.480015 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Successfully updated port: cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:06:46.697502 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:46.744032 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:06:46.745930 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:06:46.747698 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Creating image(s)
May 28 14:06:46.747873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:46.748267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "/opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:46.749039 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "/opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:46.750150 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:46.755065 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:46.756414 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:46.864221 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:46.866519 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:46.867586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:46.867586 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:46.879269 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:06:46.889629 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:46.889629 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:46.961064 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:46.986331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:46.986331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquired lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:46.986331 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:06:47.042774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.064811 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.185s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:47.065737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:47.190061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk 1073741824" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:47.193063 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:47.193532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:47.232797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.254209 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.279488 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.351481 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.158s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:47.354491 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:06:47.354491 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:47.432629 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.448353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f3cba06-df19-4d01-8ad3-a682e1338848 req-ec36a5c0-0adb-49ac-bf89-0306312e8b86 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:47.448353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f3cba06-df19-4d01-8ad3-a682e1338848 req-ec36a5c0-0adb-49ac-bf89-0306312e8b86 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:47.450094 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f3cba06-df19-4d01-8ad3-a682e1338848 req-ec36a5c0-0adb-49ac-bf89-0306312e8b86 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:47.451139 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f3cba06-df19-4d01-8ad3-a682e1338848 req-ec36a5c0-0adb-49ac-bf89-0306312e8b86 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:47.451695 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f3cba06-df19-4d01-8ad3-a682e1338848 req-ec36a5c0-0adb-49ac-bf89-0306312e8b86 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Processing event network-vif-plugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:47.456999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.499329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:47.499908 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Cannot resize image /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:06:47.500343 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:06:47.500595 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Ensure instance console log exists: /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:06:47.500916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:47.501129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:47.501322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:47.513811 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.579491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.617579 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.629999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.652739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.658836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.677591 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:47.684955 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.696221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.738662 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:06:47.756288 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.844494 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:47.844494 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.040371 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.049239 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updated VIF entry in instance network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:48.050230 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:48.065467 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.174473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.201653 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.237876 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:48.290388 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:48.291507 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing instance network info cache due to event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:48.291507 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:48.293111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:48.293111 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing network info cache for port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:48.395147 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.400350 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.404479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.429458 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.435221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.553297 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updating instance_info_cache with network_info: [{"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:48.555916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-10224da5-e297-4070-ab31-d126962cec07 req-fd1b5446-ac16-4ffc-be1e-b3eeeb701d5e service nova] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:48.563342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:48.563342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:48.799801 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:48.888146 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.905950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:48.907565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.059126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Releasing lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:49.063362 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Instance network_info: |[{"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:06:49.065895 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Start _get_guest_xml network_info=[{"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:06:49.071906 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:49.075203 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:06:49.077396 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-303708888', uuid='7c25a8ba-cc94-4ac1-be8f-f7e32850f46b'), owner=OwnerMeta(userid='d2ab771f08c245c7a7dffca595835dba', username='tempest-AttachVolumeTestJSON-1658324310-project-member', projectid='706c08c92c6844b3ab7b4019269eabad', projectname='tempest-AttachVolumeTestJSON-1658324310'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977209.0761352) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:06:49.082468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:06:49.082468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:06:49.082624 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:06:49.082738 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:06:49.084115 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:06:49.085668 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:06:49.086975 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:06:49.087392 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:06:49.102978 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303708888',display_name='tempest-AttachVolumeTestJSON-server-303708888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-303708888',id=33,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdXeZQJwDcBhqVR4EvXDIYIPC+YhZ/W51yfwDk2PM42wFFcfi7mDOYmmiRYxgcfVE214iy53MBq6VjEc4XyZ6zLXgKU3yLqqH8dnvuvGVmyAtKMq2TWUqYRPRqjrHsxQ==',key_name='tempest-keypair-737057592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ttb5c0l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=7c25a8ba-cc94-4ac1-be8f-f7e32850f46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:06:49.103221 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:49.104850 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:19:0c,bridge_name='br-int',has_traffic_filtering=True,id=cbffca20-9c6b-41fc-85fa-7eac464a7c06,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbffca20-9c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:49.105121 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:49.159711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.371354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.371933 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.413920 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977209.4134889, 409cb876-fbae-4f7d-8e80-544174cb94b6 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:49.414022 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] VM Started (Lifecycle Event)
May 28 14:06:49.453530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.558142 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:49.558413 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:49.595226 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:49.611480 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] End _get_guest_xml xml=<domain type="qemu">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <uuid>7c25a8ba-cc94-4ac1-be8f-f7e32850f46b</uuid>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <name>instance-00000021</name>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeTestJSON-server-303708888</nova:name>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:06:49</nova:creationTime>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:user uuid="d2ab771f08c245c7a7dffca595835dba">tempest-AttachVolumeTestJSON-1658324310-project-member</nova:user>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:project uuid="706c08c92c6844b3ab7b4019269eabad">tempest-AttachVolumeTestJSON-1658324310</nova:project>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         <nova:port uuid="cbffca20-9c6b-41fc-85fa-7eac464a7c06">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <system>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <entry name="serial">7c25a8ba-cc94-4ac1-be8f-f7e32850f46b</entry>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <entry name="uuid">7c25a8ba-cc94-4ac1-be8f-f7e32850f46b</entry>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </system>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <os>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   </os>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <features>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   </features>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   <devices>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk.config"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </disk>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:c5:19:0c"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <target dev="tapcbffca20-9c"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </interface>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/console.log" append="off"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </serial>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <video>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </video>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </rng>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:   </devices>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]: </domain>
May 28 14:06:49.611480 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:06:49.614923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Preparing to wait for external event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:06:49.614923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:49.614923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:49.614923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:49.614923 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303708888',display_name='tempest-AttachVolumeTestJSON-server-303708888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-303708888',id=33,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdXeZQJwDcBhqVR4EvXDIYIPC+YhZ/W51yfwDk2PM42wFFcfi7mDOYmmiRYxgcfVE214iy53MBq6VjEc4XyZ6zLXgKU3yLqqH8dnvuvGVmyAtKMq2TWUqYRPRqjrHsxQ==',key_name='tempest-keypair-737057592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ttb5c0l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=7c25a8ba-cc94-4ac1-be8f-f7e32850f46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:06:49.614923 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:49.614923 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:19:0c,bridge_name='br-int',has_traffic_filtering=True,id=cbffca20-9c6b-41fc-85fa-7eac464a7c06,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbffca20-9c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:49.618642 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:19:0c,bridge_name='br-int',has_traffic_filtering=True,id=cbffca20-9c6b-41fc-85fa-7eac464a7c06,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbffca20-9c') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:06:49.618642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.618642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:49.618642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:06:49.618642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.622473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2198a48-c284-5850-b25f-202f7218b960', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:49.622473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.623279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:49.628980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.629417 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbffca20-9c, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:49.631287 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbffca20-9c, col_values=(('qos', UUID('9f4a364b-ba08-4f71-8722-e9df70da43c0')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:49.631366 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbffca20-9c, col_values=(('external_ids', {'iface-id': 'cbffca20-9c6b-41fc-85fa-7eac464a7c06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:19:0c', 'vm-uuid': '7c25a8ba-cc94-4ac1-be8f-f7e32850f46b'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:49.638701 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.638701 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:49.648364 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.650229 np0000001643 nova-compute[98269]: INFO os_vif [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:19:0c,bridge_name='br-int',has_traffic_filtering=True,id=cbffca20-9c6b-41fc-85fa-7eac464a7c06,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbffca20-9c')
May 28 14:06:49.656434 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:49.656672 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:49.656917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:49.657104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:49.657295 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No event matching network-vif-plugged-300da7b6-2392-463e-9abf-448f59da647d in dict_keys([('network-vif-plugged', 'ac3a901d-4ef1-4379-974d-324dded4930d'), ('network-vif-plugged', '89ddc5d3-9aaa-4728-a54a-054a2d23b0e3'), ('network-vif-plugged', '28ebef22-93cd-4d32-90a8-9511a7ed313a'), ('network-vif-plugged', '9d834084-9ddc-48db-9f45-8d878ab91ac5'), ('network-vif-plugged', '9b97fba0-f944-4595-8a3b-127f5cc7d846'), ('network-vif-plugged', 'c2c95821-5913-43a4-868b-7c483f5a2ed1')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:06:49.657529 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received unexpected event network-vif-plugged-300da7b6-2392-463e-9abf-448f59da647d for instance with vm_state building and task_state spawning.
May 28 14:06:49.657698 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:49.658027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:49.658027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:49.658165 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:49.658310 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Processing event network-vif-plugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:49.662604 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:49.663529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:49.665797 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:49.667486 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:49.667486 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No event matching network-vif-plugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 in dict_keys([('network-vif-plugged', 'ac3a901d-4ef1-4379-974d-324dded4930d'), ('network-vif-plugged', '89ddc5d3-9aaa-4728-a54a-054a2d23b0e3'), ('network-vif-plugged', '28ebef22-93cd-4d32-90a8-9511a7ed313a'), ('network-vif-plugged', '9d834084-9ddc-48db-9f45-8d878ab91ac5'), ('network-vif-plugged', '9b97fba0-f944-4595-8a3b-127f5cc7d846')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:06:49.667486 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-272b1691-1947-437d-bd1e-f08d72035b73 req-62adce36-b0ff-4a1d-af1d-700ee1fd632c service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received unexpected event network-vif-plugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 for instance with vm_state building and task_state spawning.
May 28 14:06:49.675429 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00228537599991796 future=<Future at 0x71a75c2f0770 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:49.675429 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:49.675826 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Emitting event <LifecycleEvent: 1779977194.6720965, 67d9145b-f424-411a-b3aa-f1b56dc42f2b => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:49.675826 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] VM Stopped (Lifecycle Event)
May 28 14:06:49.825670 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updated VIF entry in instance network info cache for port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:49.825993 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:49.857354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.865146 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.867494 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.901047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:49.918519 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:49.921785 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977209.9214668, 409cb876-fbae-4f7d-8e80-544174cb94b6 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:49.922175 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] VM Paused (Lifecycle Event)
May 28 14:06:50.061994 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Detaching volume e6d17c2a-e75e-4c20-b161-33662ed99965
May 28 14:06:50.103536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.541s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.115224 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Attempting to driver detach volume e6d17c2a-e75e-4c20-b161-33662ed99965 from mountpoint /dev/vdb
May 28 14:06:50.120641 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Found disk vdb by alias ua-e6d17c2a-e75e-4c20-b161-33662ed99965 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:06:50.121909 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Found disk vdb by alias ua-e6d17c2a-e75e-4c20-b161-33662ed99965 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:06:50.121954 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Attempting to detach device vdb from instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:06:50.122260 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:06:50.122260 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:50.122260 np0000001643 nova-compute[98269]:   <alias name="ua-e6d17c2a-e75e-4c20-b161-33662ed99965"/>
May 28 14:06:50.122260 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:06:50.122260 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:50.122260 np0000001643 nova-compute[98269]:   <serial>e6d17c2a-e75e-4c20-b161-33662ed99965</serial>
May 28 14:06:50.122260 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:06:50.122260 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:50.122260 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:06:50.129759 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Successfully detached device vdb from instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 from the persistent domain config.
May 28 14:06:50.129759 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] (1/8): Attempting to detach device vdb with device alias ua-e6d17c2a-e75e-4c20-b161-33662ed99965 from instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:06:50.129759 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:06:50.129759 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:50.129759 np0000001643 nova-compute[98269]:   <alias name="ua-e6d17c2a-e75e-4c20-b161-33662ed99965"/>
May 28 14:06:50.129759 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:06:50.129759 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:50.129759 np0000001643 nova-compute[98269]:   <serial>e6d17c2a-e75e-4c20-b161-33662ed99965</serial>
May 28 14:06:50.129759 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:06:50.129759 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:50.129759 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:06:50.178800 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 67d9145b-f424-411a-b3aa-f1b56dc42f2b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:50.180757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:50.189461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:50.328378 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:50.328589 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-changed-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.328698 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Refreshing instance network info cache due to event network-changed-cbffca20-9c6b-41fc-85fa-7eac464a7c06. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:50.328893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Acquiring lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:50.328965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Acquired lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:50.329097 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Refreshing network info cache for port cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:50.375749 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.375926 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.376075 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.376187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.376324 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Processing event network-vif-plugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:50.376461 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.376586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.376697 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.376795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.376903 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Processing event network-vif-plugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:50.377035 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.377144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.377309 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.377407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.378887 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No event matching network-vif-plugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 in dict_keys([('network-vif-plugged', '28ebef22-93cd-4d32-90a8-9511a7ed313a'), ('network-vif-plugged', '9d834084-9ddc-48db-9f45-8d878ab91ac5'), ('network-vif-plugged', '9b97fba0-f944-4595-8a3b-127f5cc7d846')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:06:50.379773 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received unexpected event network-vif-plugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 for instance with vm_state building and task_state spawning.
May 28 14:06:50.381766 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.382350 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.382617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.382755 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.382863 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Processing event network-vif-plugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:50.382981 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.383105 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.383215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.383333 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.383459 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No event matching network-vif-plugged-28ebef22-93cd-4d32-90a8-9511a7ed313a in dict_keys([('network-vif-plugged', '9d834084-9ddc-48db-9f45-8d878ab91ac5'), ('network-vif-plugged', '9b97fba0-f944-4595-8a3b-127f5cc7d846')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:06:50.384943 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received unexpected event network-vif-plugged-28ebef22-93cd-4d32-90a8-9511a7ed313a for instance with vm_state building and task_state spawning.
May 28 14:06:50.385088 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.385211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.385331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.385463 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.386194 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Processing event network-vif-plugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:50.386379 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.386954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.387119 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.387228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.387425 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No event matching network-vif-plugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 in dict_keys([('network-vif-plugged', '9b97fba0-f944-4595-8a3b-127f5cc7d846')]) {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 14:06:50.387574 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received unexpected event network-vif-plugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 for instance with vm_state building and task_state spawning.
May 28 14:06:50.387674 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.387868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.388009 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.388115 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.388213 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Processing event network-vif-plugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:50.388354 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:50.388571 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:50.389382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:50.389590 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:50.390025 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-plugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:50.390668 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ec83d528-e787-48a3-99aa-96ce33c8b0cd req-33176bcf-d842-4ac7-8f6f-d64b97677736 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received unexpected event network-vif-plugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 for instance with vm_state building and task_state spawning.
May 28 14:06:50.394904 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:06:50.402882 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:06:50.412713 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance spawned successfully.
May 28 14:06:50.413161 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:06:50.427223 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:50.430308 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977210.429996, 409cb876-fbae-4f7d-8e80-544174cb94b6 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:50.430484 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] VM Resumed (Lifecycle Event)
May 28 14:06:50.834339 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:50.890593 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e6d17c2a-e75e-4c20-b161-33662ed99965 for instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:06:50.931647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:50.931647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:50.932553 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:50.936367 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:50.936367 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:50.936367 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:50.936367 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:50.946236 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:51.190685 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:51.191148 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:06:51.191148 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No VIF found with MAC fa:16:3e:c5:19:0c, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:06:51.191518 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Using config drive
May 28 14:06:51.261836 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:51.340605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:51.341081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:51.341732 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Attaching volume a7747ace-8e04-4cf1-af6d-fc077740fc9d to /dev/vdb
May 28 14:06:51.403299 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:51.422278 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:06:51.442923 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Took 32.77 seconds to spawn the instance on the hypervisor.
May 28 14:06:51.442923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:51.450514 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:06:51.451511 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977211.45059, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => ua-e6d17c2a-e75e-4c20-b161-33662ed99965> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:06:51.451511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:51.474040 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updated VIF entry in instance network info cache for port cbffca20-9c6b-41fc-85fa-7eac464a7c06. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:51.474842 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updating instance_info_cache with network_info: [{"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:51.489640 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Successfully detached device vdb from instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 from the live domain config.
May 28 14:06:51.490794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:06:51.491440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:51.492039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:51.493255 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:06:51.493674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:51.494230 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:06:51.494653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d17c2a-e75e-4c20-b161-33662ed99965', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:06:51.495251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:06:51.503837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:06:51.506069 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fe5f:8950', 'fe80::50f6:c5ff:fe8f:5164', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:feab:25f1', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fed2:68ea', 'fe80::fc16:3eff:fe46:cb5b', 'fe80::18dc:67ff:fe4a:b24d', 'fe80::fc16:3eff:fe49:2e40', 'fe80::fc16:3eff:fec7:e1ff', 'fe80::fc16:3eff:feaf:1b8e', 'fe80::fc16:3eff:fedd:75a0', 'fe80::3820:d3ff:fee1:991b', 'fe80::fc16:3eff:fe6c:f2b', 'fe80::5825:dff:fe35:f22c'] 
May 28 14:06:51.506250 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:06:51.506331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:06:51.507857 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:51.508129 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating existing volume attachment record: 5d2b0a18-3b55-4c30-9fac-1eea8d2a1dfd {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:51.535175 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:51.535175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '60')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:06:51.539316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '45')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:51.539316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965', '46')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:06:51.539787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c728ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'): ({'sdg'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:06:51.541723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:06:51.541723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Flush multipath device 3300000006b06ae27 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:06:51.576108 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:51.622768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:06:51.668806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:06:51.670788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:06:51.676115 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:06:51.690390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:06:51.690724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:06:51.704883 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:51.707222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:51.749183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.40.100,3260]
May 28 14:06:51.749183 np0000001643 nova-compute[98269]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.40.100,3260] successful.
May 28 14:06:51.749183 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:51.774954 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:51.788584 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:51.837438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.50.100,3260]
May 28 14:06:51.837438 np0000001643 nova-compute[98269]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-e6d17c2a-e75e-4c20-b161-33662ed99965, portal: 192.168.50.100,3260] successful.
May 28 14:06:51.837438 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:51.867721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:51.868195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:51.868361 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] <== disconnect_volume: return (376ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:51.868742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:06:51.875762 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Creating config drive at /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk.config
May 28 14:06:51.882370 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1a037cfk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:06:51.950262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1a037cfk" returned: 0 in 0.068s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:06:51.958643 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Took 45.64 seconds to build instance.
May 28 14:06:51.980639 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Releasing lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:51.981006 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-plugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:51.982321 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:51.982718 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:51.982945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:51.983162 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-plugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:51.983340 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8f1ef8c0-d754-4ca4-841e-7dec8e2c3468 req-5e48ac8a-4a45-48f4-bdb6-6fce17d92565 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received unexpected event network-vif-plugged-ac3a901d-4ef1-4379-974d-324dded4930d for instance with vm_state building and task_state spawning.
May 28 14:06:52.098347 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:06:52.098732 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:06:52.098877 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:52.457947 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'flavor' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:52.460987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.150s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:52.483170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:52.519203 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:52.520495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:52.638116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:52.746979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7a1b528e-c20f-413b-b3a2-32c4bfad9cef req-cfb5715d-e898-478a-b683-f2a9eca2e6a4 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:52.746979 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7a1b528e-c20f-413b-b3a2-32c4bfad9cef req-cfb5715d-e898-478a-b683-f2a9eca2e6a4 service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:52.747112 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7a1b528e-c20f-413b-b3a2-32c4bfad9cef req-cfb5715d-e898-478a-b683-f2a9eca2e6a4 service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:52.747288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7a1b528e-c20f-413b-b3a2-32c4bfad9cef req-cfb5715d-e898-478a-b683-f2a9eca2e6a4 service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:52.747494 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7a1b528e-c20f-413b-b3a2-32c4bfad9cef req-cfb5715d-e898-478a-b683-f2a9eca2e6a4 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Processing event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:06:52.963905 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:52.970030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:52.978964 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:53.005344 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:53.482792 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ccc7c9a6-f2b6-457a-bdf4-31a4b77fb4e5 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.923s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:53.774002 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977213.7735982, 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:53.774191 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] VM Started (Lifecycle Event)
May 28 14:06:53.777801 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:06:53.785468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:06:53.790966 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Instance spawned successfully.
May 28 14:06:53.791376 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:06:54.281922 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:54.284127 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:54.302033 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:54.302033 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:54.302295 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:54.302597 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:54.302925 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:54.303218 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:06:54.455506 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:54.633965 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:54.635841 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:54.636070 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:54.636253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:54.636424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:54.636599 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:54.641045 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Terminating instance
May 28 14:06:54.787320 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:06:54.787883 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977214.7876139, 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:54.788096 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] VM Paused (Lifecycle Event)
May 28 14:06:54.809790 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Took 8.07 seconds to spawn the instance on the hypervisor.
May 28 14:06:54.809942 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:54.830897 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:54.831050 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:54.831251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:54.831398 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:54.834017 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] No waiting events found dispatching network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:54.834262 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received unexpected event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 for instance with vm_state building and task_state spawning.
May 28 14:06:54.834697 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-changed-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:54.835191 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing instance network info cache due to event network-changed-300da7b6-2392-463e-9abf-448f59da647d. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:54.835704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] Acquiring lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:54.836090 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] Acquired lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:54.836271 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Refreshing network info cache for port 300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:54.964299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.865s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:54.965249 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:06:54.982651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:54.983289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:06:54.985175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:54.985406 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:54.986033 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:06:54.986192 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:54.999930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:54.999930 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:55.006834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:06:55.006834 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:55.016192 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d] added
May 28 14:06:55.016192 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:55.016192 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:55.016192 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:55.016192 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:55.016192 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:55.016192 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:55.016567 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:55.017104 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:55.017257 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:55.022314 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d] added
May 28 14:06:55.022314 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:06:55.022314 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:55.022314 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:55.022314 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:06:55.022314 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:06:55.022314 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:55.022679 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:06:55.023040 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:06:55.023040 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:06:55.145883 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:06:55.179896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:55.187212 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:55.210437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:55.212745 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:55.241763 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:55.245951 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:55.293142 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:55.306087 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977215.305567, 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:06:55.306087 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] VM Resumed (Lifecycle Event)
May 28 14:06:55.327133 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Took 14.14 seconds to build instance.
May 28 14:06:55.343722 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:55.430071 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7164788d-0704-4a8c-9fde-2fe7e7964ed1 req-54a38020-3159-4add-9bbe-5455284b162f service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:55.430314 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7164788d-0704-4a8c-9fde-2fe7e7964ed1 req-54a38020-3159-4add-9bbe-5455284b162f service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:55.430580 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7164788d-0704-4a8c-9fde-2fe7e7964ed1 req-54a38020-3159-4add-9bbe-5455284b162f service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:55.430750 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7164788d-0704-4a8c-9fde-2fe7e7964ed1 req-54a38020-3159-4add-9bbe-5455284b162f service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:55.430931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7164788d-0704-4a8c-9fde-2fe7e7964ed1 req-54a38020-3159-4add-9bbe-5455284b162f service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:55.432583 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7164788d-0704-4a8c-9fde-2fe7e7964ed1 req-54a38020-3159-4add-9bbe-5455284b162f service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:55.527762 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Instance destroyed successfully.
May 28 14:06:55.527762 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lazy-loading 'resources' on Instance uuid 8584659f-147f-4b78-ad59-e0eebdb9aaf3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:55.810533 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:06:55.813171 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:06:55.832900 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.667s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:55.955798 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:56.017780 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:06:56.024779 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:06:56.029251 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-294841717',display_name='tempest-ServerStableDeviceRescueTest-server-294841717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serverstabledevicerescuetest-server-294841717',id=23,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0NOTH30hDWSiHEniaN0RC5oWheCyp/m3BonLN/TN1md0y7tPyNxh4sAnGG+z2B7LwUqdQHyPvX8A7mOyGnWq+aFvvM6+hI6nlYEMk1CjTlbq7QgfcIKB9Pbgk76U14Fw==',key_name='tempest-keypair-1832891856',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:10Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38e8657cdaa8482182b12ae39785f074',ramdisk_id='',reservation_id='r-d4uk1qsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-456151526',owner_user_name='tempest-ServerStableDeviceRescueTest-456151526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01855887e3a0438bbe84fb9664132ad1',uuid=8584659f-147f-4b78-ad59-e0eebdb9aaf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:06:56.032568 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converting VIF {"id": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "address": "fa:16:3e:5f:89:50", "network": {"id": "140ca163-393c-4294-97b3-34a421ffd598", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2012873626-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38e8657cdaa8482182b12ae39785f074", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4e4b15-72", "ovs_interfaceid": "cb4e4b15-723c-469c-b5f8-53863c6ac3d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:06:56.032568 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:06:56.032568 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:06:56.032910 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:56.033154 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb4e4b15-72, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:56.035664 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:56.035664 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.042434 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:56.042434 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:56.045378 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:56.047753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:56.049529 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f90fe57-feb0-4d25-b2ab-dc59e2065b0f) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:06:56.051701 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:06:56.051701 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.055245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:56.057122 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:06:56.057122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.059678 np0000001643 nova-compute[98269]: INFO os_vif [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:50,bridge_name='br-int',has_traffic_filtering=True,id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6,network=Network(140ca163-393c-4294-97b3-34a421ffd598),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4e4b15-72')
May 28 14:06:56.059999 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Deleting instance files /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3_del
May 28 14:06:56.061128 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Deletion of /opt/stack/data/nova/instances/8584659f-147f-4b78-ad59-e0eebdb9aaf3_del complete
May 28 14:06:56.079330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.085433 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.086218 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.117532 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.119216 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:56.186679 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.40.100,3260]
May 28 14:06:56.186679 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.40.100,3260] successful.
May 28 14:06:56.186679 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.209102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.50.100,3260]
May 28 14:06:56.209102 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.50.100,3260] successful.
May 28 14:06:56.209102 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.211185 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.219188 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updated VIF entry in instance network info cache for port 300da7b6-2392-463e-9abf-448f59da647d. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:56.221030 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [{"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:56.229924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.244540 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.259s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:56.244540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:56.246732 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('13', '-', '-', 0) found on session 63 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:56.247078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.258132 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97d28d69-3206-4a56-8f52-154b3ab25f46 (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:06:56.261096 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:06:56.261096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.275s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:56.263552 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:06:56.263552 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('14', '-', '-', 0) found on session 64 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:06:56.263552 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:06:56.278173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 63 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:56.278339 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:56.291638 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 64 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:06:56.291638 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:06:56.321149 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999667226999918 future=<Future at 0x71a7801ef530 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:56.322165 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998318448999953 future=<Future at 0x71a7801ef530 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:56.322755 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997149788999877 future=<Future at 0x71a7801ef530 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:06:56.579849 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 14:06:56.581922 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:06:56.582259 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:06:56.582527 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:06:56.582863 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:56.725608 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cca025e6-f1b9-47b2-9af8-84f2c53f0acc req-1f2c7c3d-8a7f-481c-8af6-9e390d123782 service nova] Releasing lock "refresh_cache-409cb876-fbae-4f7d-8e80-544174cb94b6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:56.774250 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:56.986700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:06:57.369378 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65ee59eb-76d8-4ede-96de-3f9c2ecc3c11 req-93ffaecc-3521-4fa2-8708-d74c641828fa service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-deleted-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:57.369888 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-65ee59eb-76d8-4ede-96de-3f9c2ecc3c11 req-93ffaecc-3521-4fa2-8708-d74c641828fa service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Neutron deleted interface cb4e4b15-723c-469c-b5f8-53863c6ac3d6; detaching it from the instance and deleting it from the info cache
May 28 14:06:57.374092 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65ee59eb-76d8-4ede-96de-3f9c2ecc3c11 req-93ffaecc-3521-4fa2-8708-d74c641828fa service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Detach interface failed, port_id=cb4e4b15-723c-469c-b5f8-53863c6ac3d6, reason: Instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:06:57.520373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:57.522875 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] Acquiring lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:57.523175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:57.523359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:06:57.523906 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] No waiting events found dispatching network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:06:57.524034 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Received event network-vif-unplugged-cb4e4b15-723c-469c-b5f8-53863c6ac3d6 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:06:57.524191 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-changed-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:06:57.524465 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Refreshing instance network info cache due to event network-changed-cbffca20-9c6b-41fc-85fa-7eac464a7c06. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:06:57.524722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] Acquiring lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:06:57.524892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] Acquired lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:06:57.525032 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Refreshing network info cache for port cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:06:57.806297 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:58.004416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 3300000006d9dae6b for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:06:58.004949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:06:58.005100 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (5906ms) {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:06:58.005265 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:06:58.008527 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:06:58.028460 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:58.309074 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Took 1.73 seconds to deallocate network for instance.
May 28 14:06:58.514387 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Attempting to attach volume a7747ace-8e04-4cf1-af6d-fc077740fc9d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:06:58.515798 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:06:58.515798 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:06:58.515798 np0000001643 nova-compute[98269]:   <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:06:58.515798 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:06:58.515798 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:06:58.515798 np0000001643 nova-compute[98269]:   <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:06:58.515798 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:06:58.515798 np0000001643 nova-compute[98269]: </disk>
May 28 14:06:58.515798 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:06:58.572007 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:06:58.787757 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updated VIF entry in instance network info cache for port cbffca20-9c6b-41fc-85fa-7eac464a7c06. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:06:58.788219 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updating instance_info_cache with network_info: [{"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:06:58.832120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:06:58.832324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:06:59.292058 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d4ffd252-f391-437e-a9b6-f85eba0070b3 req-80959196-72a3-455f-936b-dac913a9cc44 service nova] Releasing lock "refresh_cache-7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:06:59.460716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:06:59.503310 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:06:59.505229 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:00.014951 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:00.251737 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:00.252275 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:00.252275 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:00.252373 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:ad:d3:ed, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:07:00.529758 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.697s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:00.604561 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Deleted allocations for instance 8584659f-147f-4b78-ad59-e0eebdb9aaf3
May 28 14:07:01.050327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:01.618270 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b2e15ba3-1986-4678-9b56-a871bd1eabd6 tempest-ServerStableDeviceRescueTest-456151526 tempest-ServerStableDeviceRescueTest-456151526-project-member] Lock "8584659f-147f-4b78-ad59-e0eebdb9aaf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.981s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:01.818975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36207dc9-834e-466d-91a4-ae3270e44170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.478s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:01.872686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:01.872686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:02.376354 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:03.382686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:04.464951 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:04.518403 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:04.518644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:04.518965 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Attaching volume a7747ace-8e04-4cf1-af6d-fc077740fc9d to /dev/vdb
May 28 14:07:04.589235 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:04.606004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:07:04.641829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:04.699990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:07:04.700645 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:07:04.712483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:07:04.715022 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:feab:25f1', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fed2:68ea', 'fe80::fc16:3eff:fe46:cb5b', 'fe80::18dc:67ff:fe4a:b24d', 'fe80::fc16:3eff:fe49:2e40', 'fe80::fc16:3eff:fec7:e1ff', 'fe80::fc16:3eff:feaf:1b8e', 'fe80::fc16:3eff:fedd:75a0', 'fe80::3820:d3ff:fee1:991b', 'fe80::fc16:3eff:fe6c:f2b', 'fe80::5825:dff:fe35:f22c', 'fe80::fc16:3eff:fec5:190c', 'fe80::a4ab:75ff:fe88:234a'] 
May 28 14:07:04.715220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:07:04.715719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:07:04.716236 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:04.716528 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating existing volume attachment record: ef925159-9630-424f-a276-339f04add921 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:07:05.286010 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:07:05.286540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:05.286863 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:05.287454 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:05.287771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:07:05.310608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:05.311078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:05.311343 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:05.312797 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:05.313233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:05.313441 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:05.331837 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:05.331837 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:05.337406 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:05.337406 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:05.349174 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:05.354587 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.371670 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.372122 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:05.372655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:05.372655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:05.375144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('13', '0', '0', 0) found on session 63 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:05.375144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.387205 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:05.387611 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:05.387926 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.074s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:05.387926 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:05.388639 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('14', '0', '0', 0) found on session 64 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:05.388778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:05.396325 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 63 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:05.396506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:05.401434 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 64 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:05.401790 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:05.422057 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:05.586267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:05.586267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:06.051367 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:06.088931 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Detaching volume 83919653-256c-49d2-bfc5-5d52203ab840
May 28 14:07:06.157079 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Attempting to driver detach volume 83919653-256c-49d2-bfc5-5d52203ab840 from mountpoint /dev/vdb
May 28 14:07:06.164638 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Found disk vdb by alias ua-83919653-256c-49d2-bfc5-5d52203ab840 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:07:06.170097 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Found disk vdb by alias ua-83919653-256c-49d2-bfc5-5d52203ab840 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:07:06.170371 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Attempting to detach device vdb from instance b8315b4c-90be-498b-bdc8-1a775a1480bc from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:07:06.170752 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:07:06.170752 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:07:06.170752 np0000001643 nova-compute[98269]:   <alias name="ua-83919653-256c-49d2-bfc5-5d52203ab840"/>
May 28 14:07:06.170752 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:07:06.170752 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:07:06.170752 np0000001643 nova-compute[98269]:   <serial>83919653-256c-49d2-bfc5-5d52203ab840</serial>
May 28 14:07:06.170752 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:07:06.170752 np0000001643 nova-compute[98269]: </disk>
May 28 14:07:06.170752 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:07:06.182330 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully detached device vdb from instance b8315b4c-90be-498b-bdc8-1a775a1480bc from the persistent domain config.
May 28 14:07:06.183508 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] (1/8): Attempting to detach device vdb with device alias ua-83919653-256c-49d2-bfc5-5d52203ab840 from instance b8315b4c-90be-498b-bdc8-1a775a1480bc from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:07:06.183508 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:07:06.183508 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:07:06.183508 np0000001643 nova-compute[98269]:   <alias name="ua-83919653-256c-49d2-bfc5-5d52203ab840"/>
May 28 14:07:06.183508 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:07:06.183508 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:07:06.183508 np0000001643 nova-compute[98269]:   <serial>83919653-256c-49d2-bfc5-5d52203ab840</serial>
May 28 14:07:06.183508 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:07:06.183508 np0000001643 nova-compute[98269]: </disk>
May 28 14:07:06.183508 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:07:06.315303 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:07:06.853253 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977226.8527882, b8315b4c-90be-498b-bdc8-1a775a1480bc => ua-83919653-256c-49d2-bfc5-5d52203ab840> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:07:06.856288 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-83919653-256c-49d2-bfc5-5d52203ab840 for instance b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:07:06.859434 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully detached device vdb from instance b8315b4c-90be-498b-bdc8-1a775a1480bc from the live domain config.
May 28 14:07:06.861534 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:07:06.861997 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:06.862180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:07.333767 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 3300000006d9dae6b for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:07:07.334207 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.047s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:07.334981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (2047ms) {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:07.335253 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:07:07.337328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.475s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:07.337791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83919653-256c-49d2-bfc5-5d52203ab840', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:07:07.338002 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:07:07.340844 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:07.382234 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:07.382969 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:07.382969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:07:07.383473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '49')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:07.385426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840', '50')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:07.387632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c173e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:07:07.387632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:07:07.387902 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flush multipath device 330000000179b7052 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:07:07.427577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:07.479198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:07.530159 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:07:07.530226 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:07:07.532794 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:07:07.546055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:07:07.546618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:07:07.559830 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:07.609483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260]
May 28 14:07:07.609483 np0000001643 nova-compute[98269]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.40.100,3260] successful.
May 28 14:07:07.609483 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:07.631092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:07.645694 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:07.684838 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260]
May 28 14:07:07.684838 np0000001643 nova-compute[98269]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-83919653-256c-49d2-bfc5-5d52203ab840, portal: 192.168.50.100,3260] successful.
May 28 14:07:07.684838 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:07.705532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:07.705821 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:07.705909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== disconnect_volume: return (844ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:07.706018 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:07:07.849734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Attempting to attach volume a7747ace-8e04-4cf1-af6d-fc077740fc9d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:07:07.852054 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:07:07.852054 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:07:07.852054 np0000001643 nova-compute[98269]:   <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:07:07.852054 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:07:07.852054 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:07:07.852054 np0000001643 nova-compute[98269]:   <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:07:07.852054 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:07:07.852054 np0000001643 nova-compute[98269]: </disk>
May 28 14:07:07.852054 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:07:08.223193 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:08.289851 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'flavor' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:09.299316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-10ca9bc7-dc26-443d-a807-c8faff83ece3 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.714s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:09.469726 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:09.563329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:09.563329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:09.564177 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:09.564177 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:be:b0:8b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:07:10.049691 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:10.049908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:10.050169 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:10.050359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:10.050541 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:10.052660 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Terminating instance
May 28 14:07:10.556384 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:07:10.587506 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:10.595306 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:10.620004 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:10.798932 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-da13c78a-353f-4ae4-bd98-4d4e40b3823d req-8fe6ffe5-54a4-4732-b3c9-504ab0067402 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:10.799253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-da13c78a-353f-4ae4-bd98-4d4e40b3823d req-8fe6ffe5-54a4-4732-b3c9-504ab0067402 service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:10.799471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-da13c78a-353f-4ae4-bd98-4d4e40b3823d req-8fe6ffe5-54a4-4732-b3c9-504ab0067402 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:10.799660 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-da13c78a-353f-4ae4-bd98-4d4e40b3823d req-8fe6ffe5-54a4-4732-b3c9-504ab0067402 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:10.799857 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-da13c78a-353f-4ae4-bd98-4d4e40b3823d req-8fe6ffe5-54a4-4732-b3c9-504ab0067402 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] No waiting events found dispatching network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:10.800054 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-da13c78a-353f-4ae4-bd98-4d4e40b3823d req-8fe6ffe5-54a4-4732-b3c9-504ab0067402 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:10.805319 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:10.812307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:10.859246 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:10.874214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:10.897191 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999663560000045 future=<Future at 0x71a75c3cc560 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:10.900949 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Instance destroyed successfully.
May 28 14:07:10.901407 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'resources' on Instance uuid b8315b4c-90be-498b-bdc8-1a775a1480bc {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:11.053282 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:11.146840 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-26df34c7-6c4e-4637-a8ce-839b03d4f0a7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.628s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:11.320425 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004272550002042408 future=<Future at 0x71a7801ef530 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:11.320893 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:11.321515 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.575531526000077 future=<Future at 0x71a75c3cc560 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:11.322018 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Emitting event <LifecycleEvent: 1779977216.3198059, 8584659f-147f-4b78-ad59-e0eebdb9aaf3 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:11.322987 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] VM Stopped (Lifecycle Event)
May 28 14:07:11.325356 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.571883995999997 future=<Future at 0x71a75c3cc560 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:11.410621 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1187018804',display_name='tempest-ServerActionsTestOtherA-server-20810810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-tempest-common-compute-instance-1187018804',id=25,image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPjudjxGx9MLYUVvFGlZfcC71jfy/sR8oZUcTCdliwi/R7kQu6rBd56Xf/TSYh/iBZLjjnI4has/s0nB3GdSPd4bXfjOiBefr+Yd6Vvfl1uwmkrcaxbNjs9Ha5YmPEohA==',key_name='tempest-keypair-1270102767',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:26Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-04k7gxz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=b8315b4c-90be-498b-bdc8-1a775a1480bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:11.410621 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "address": "fa:16:3e:ab:25:f1", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ba7305-7c", "ovs_interfaceid": "61ba7305-7cba-43a7-933f-1bb3fb5e7377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:11.410621 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:11.410621 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:11.414650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:11.414650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61ba7305-7c, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:11.415179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:11.416532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:11.417943 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:11.420420 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:11.420647 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=649ea3b1-0958-4bee-ac16-aac37e1c7aea) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:11.421888 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:11.422903 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:11.425493 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:11.427138 np0000001643 nova-compute[98269]: INFO os_vif [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:25:f1,bridge_name='br-int',has_traffic_filtering=True,id=61ba7305-7cba-43a7-933f-1bb3fb5e7377,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ba7305-7c')
May 28 14:07:11.427336 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Deleting instance files /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc_del
May 28 14:07:11.429725 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Deletion of /opt/stack/data/nova/instances/b8315b4c-90be-498b-bdc8-1a775a1480bc_del complete
May 28 14:07:11.827754 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 8584659f-147f-4b78-ad59-e0eebdb9aaf3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:11.940027 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 14:07:11.940492 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:07:11.940916 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:07:11.941152 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:07:11.941293 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:12.080326 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:12.795524 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bdf165bc-b9d9-4c3b-b05a-3a49d504b187 req-c2b3aca7-e81a-4896-82e5-39611ed62720 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-deleted-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:12.800264 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-bdf165bc-b9d9-4c3b-b05a-3a49d504b187 req-c2b3aca7-e81a-4896-82e5-39611ed62720 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Neutron deleted interface 61ba7305-7cba-43a7-933f-1bb3fb5e7377; detaching it from the instance and deleting it from the info cache
May 28 14:07:12.804053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bdf165bc-b9d9-4c3b-b05a-3a49d504b187 req-c2b3aca7-e81a-4896-82e5-39611ed62720 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Detach interface failed, port_id=61ba7305-7cba-43a7-933f-1bb3fb5e7377, reason: Instance b8315b4c-90be-498b-bdc8-1a775a1480bc could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:07:12.894443 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a1d20e96-6617-41a7-a773-c6e6156efc6b req-034aec75-3c5d-4aee-9844-2e8a348df860 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:12.895017 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a1d20e96-6617-41a7-a773-c6e6156efc6b req-034aec75-3c5d-4aee-9844-2e8a348df860 service nova] Acquiring lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:12.895719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a1d20e96-6617-41a7-a773-c6e6156efc6b req-034aec75-3c5d-4aee-9844-2e8a348df860 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:12.896145 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a1d20e96-6617-41a7-a773-c6e6156efc6b req-034aec75-3c5d-4aee-9844-2e8a348df860 service nova] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:12.896865 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a1d20e96-6617-41a7-a773-c6e6156efc6b req-034aec75-3c5d-4aee-9844-2e8a348df860 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] No waiting events found dispatching network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:12.896865 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a1d20e96-6617-41a7-a773-c6e6156efc6b req-034aec75-3c5d-4aee-9844-2e8a348df860 service nova] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Received event network-vif-unplugged-61ba7305-7cba-43a7-933f-1bb3fb5e7377 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:13.233127 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:13.518314 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Stashing vm_state: active {{(pid=98269) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 14:07:13.735413 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Took 1.79 seconds to deallocate network for instance.
May 28 14:07:14.096423 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:14.096964 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:14.243081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:14.470882 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:14.603361 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:07:14.603553 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Claim successful on node np0000001643
May 28 14:07:15.110553 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating resource usage from migration c8122779-9475-4ad8-85fc-1f731892010a
May 28 14:07:15.724909 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:07:15.724909 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:16.227435 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:16.421913 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:16.739654 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.643s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:16.739869 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Migrating
May 28 14:07:16.740083 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:07:16.745675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.502s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:17.260215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:17.262913 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:17.262913 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:07:17.294890 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:07:17.295156 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:17.765172 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:17.799712 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:18.179893 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:18.309657 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.564s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:18.382296 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Deleted allocations for instance b8315b4c-90be-498b-bdc8-1a775a1480bc
May 28 14:07:18.399918 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:18.902168 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:19.394121 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1818cd0c-1131-42f8-8125-92b3960d487d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "b8315b4c-90be-498b-bdc8-1a775a1480bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.344s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:19.476159 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.420631 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Starting migrate_disk_and_power_off {{(pid=98269) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 14:07:20.464245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.470590 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.502876 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.676869 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.683407 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.721409 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8ad9fba6-50f3-459d-809f-9a2e0ada80a8 req-2ce4bdae-6d7f-4ddb-b4c2-12628e4c1123 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:20.724424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8ad9fba6-50f3-459d-809f-9a2e0ada80a8 req-2ce4bdae-6d7f-4ddb-b4c2-12628e4c1123 service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:20.724424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8ad9fba6-50f3-459d-809f-9a2e0ada80a8 req-2ce4bdae-6d7f-4ddb-b4c2-12628e4c1123 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:20.724424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8ad9fba6-50f3-459d-809f-9a2e0ada80a8 req-2ce4bdae-6d7f-4ddb-b4c2-12628e4c1123 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:20.724424 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8ad9fba6-50f3-459d-809f-9a2e0ada80a8 req-2ce4bdae-6d7f-4ddb-b4c2-12628e4c1123 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] No waiting events found dispatching network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:20.724424 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8ad9fba6-50f3-459d-809f-9a2e0ada80a8 req-2ce4bdae-6d7f-4ddb-b4c2-12628e4c1123 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received unexpected event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 for instance with vm_state active and task_state resize_migrating.
May 28 14:07:20.770483 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.785519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.811614 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99970915599988 future=<Future at 0x71a778156540 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:20.813647 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance destroyed successfully.
May 28 14:07:20.815991 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=31,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:25Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-t5gyv8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=512a75c8-713d-418b-adc8-07b2bf513923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:20.815991 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:20.816347 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:20.816347 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:20.817831 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.818108 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap027666be-25, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:20.820012 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.820885 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:20.821032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.828115 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.828354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c67cdf84-53ed-4369-a01c-5bc50bc6a849) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:20.829146 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.829787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:20.830783 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:20.833486 np0000001643 nova-compute[98269]: INFO os_vif [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25')
May 28 14:07:21.390418 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Detected multiple connections on this host for volume: a7747ace-8e04-4cf1-af6d-fc077740fc9d, skipping target disconnect.
May 28 14:07:21.394691 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:21.512170 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:21.513236 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:21.644772 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:21.645433 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:07:21.646415 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_resize/disk /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:21.769984 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "cp -r /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_resize/disk /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk" returned: 0 in 0.120s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:21.769984 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_resize/disk.config /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:21.818468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "cp -r /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_resize/disk.config /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config" returned: 0 in 0.050s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:21.818985 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_resize/disk.info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:21.874997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "cp -r /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_resize/disk.info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:22.809727 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f77b8cec-b507-468d-9b6b-b4a0523686f2 req-abd06d61-8666-40f8-9a87-00e6ca245968 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:22.810101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f77b8cec-b507-468d-9b6b-b4a0523686f2 req-abd06d61-8666-40f8-9a87-00e6ca245968 service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:22.810271 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f77b8cec-b507-468d-9b6b-b4a0523686f2 req-abd06d61-8666-40f8-9a87-00e6ca245968 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:22.810430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f77b8cec-b507-468d-9b6b-b4a0523686f2 req-abd06d61-8666-40f8-9a87-00e6ca245968 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:22.812830 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f77b8cec-b507-468d-9b6b-b4a0523686f2 req-abd06d61-8666-40f8-9a87-00e6ca245968 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] No waiting events found dispatching network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:22.813051 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f77b8cec-b507-468d-9b6b-b4a0523686f2 req-abd06d61-8666-40f8-9a87-00e6ca245968 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received unexpected event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 for instance with vm_state active and task_state resize_migrating.
May 28 14:07:23.065609 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:23.068606 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:23.166631 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Port 027666be-2507-4940-ae85-8c79ccf188b7 binding to destination host np0000001643 is already ACTIVE {{(pid=98269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 14:07:23.421569 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:23.422272 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:23.926515 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:07:24.177980 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:07:24.199257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:24.199257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:24.199257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:24.478118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:24.478323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:24.478557 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:24.483697 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:07:24.483880 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Claim successful on node np0000001643
May 28 14:07:25.203467 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:25.264688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:25.264883 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:25.265015 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:07:25.767107 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:25.838795 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:25.900604 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00046258700012913323 future=<Future at 0x71a75c3cc560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:25.900604 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Emitting event <LifecycleEvent: 1779977230.8966894, b8315b4c-90be-498b-bdc8-1a775a1480bc => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:25.900604 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:25.900604 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] VM Stopped (Lifecycle Event)
May 28 14:07:25.903594 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.907753102999777 future=<Future at 0x71a778156540 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:25.903811 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.907509586999822 future=<Future at 0x71a778156540 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:26.045859 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:07:26.046081 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:26.151428 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:26.264599 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:26.405972 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fcc767ae-5d2b-43f9-bcd6-fc313f260b60 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: b8315b4c-90be-498b-bdc8-1a775a1480bc] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:26.548771 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:26.766841 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:27.056029 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.577s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:27.056409 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:07:27.078147 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:27.281130 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:27.295615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:07:27.325085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:27.380404 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:07:27.380632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:07:27.393378 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:07:27.397421 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fed2:68ea', 'fe80::fc16:3eff:fe46:cb5b', 'fe80::18dc:67ff:fe4a:b24d', 'fe80::fc16:3eff:fe49:2e40', 'fe80::fc16:3eff:fec7:e1ff', 'fe80::fc16:3eff:feaf:1b8e', 'fe80::fc16:3eff:fedd:75a0', 'fe80::3820:d3ff:fee1:991b', 'fe80::fc16:3eff:fe6c:f2b', 'fe80::5825:dff:fe35:f22c', 'fe80::fc16:3eff:fec5:190c', 'fe80::a4ab:75ff:fe88:234a'] 
May 28 14:07:27.397670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:07:27.397786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:07:27.398143 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:27.564904 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:07:27.565442 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:07:27.567098 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:27.567339 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:27.657633 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '357253ac91f34daeb60ae1dfd3e4a86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a74849f3fb24097a5a42457746f02d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:07:28.066784 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:07:28.217970 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Successfully created port: 1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:07:28.572672 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:07:28.582591 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Starting finish_migration {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 14:07:28.585143 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:07:28.585320 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Creating image(s)
May 28 14:07:28.586685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:28.697159 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:28.697600 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:07:28.698001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:28.808606 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:28.809107 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Cannot resize image /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:07:28.961796 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Successfully updated port: 1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:07:29.042796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-changed-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:29.042796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Refreshing instance network info cache due to event network-changed-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:07:29.042796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] Acquiring lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:29.043781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] Acquired lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:29.044524 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Refreshing network info cache for port 1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:07:29.077712 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Booting with volume 716e1389-8ad8-432e-bf18-b9d6eabb97e4 at /dev/vda
May 28 14:07:29.152207 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:29.172164 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:07:29.200917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:29.244355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:07:29.244652 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:07:29.255233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:07:29.257033 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fed2:68ea', 'fe80::fc16:3eff:fe46:cb5b', 'fe80::18dc:67ff:fe4a:b24d', 'fe80::fc16:3eff:fe49:2e40', 'fe80::fc16:3eff:fec7:e1ff', 'fe80::fc16:3eff:feaf:1b8e', 'fe80::fc16:3eff:fedd:75a0', 'fe80::3820:d3ff:fee1:991b', 'fe80::fc16:3eff:fe6c:f2b', 'fe80::5825:dff:fe35:f22c', 'fe80::fc16:3eff:fec5:190c', 'fe80::a4ab:75ff:fe88:234a'] 
May 28 14:07:29.257179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:07:29.257179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:07:29.257424 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:29.258760 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating existing volume attachment record: 4101cf54-c1e6-405a-94a6-af0265daa642 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:07:29.314291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:07:29.315320 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Ensure instance console log exists: /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:07:29.315897 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:29.316214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:29.316429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:29.321507 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Start _get_guest_xml network_info=[{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '4bebde1b-09aa-4adb-8503-8807e516dfaf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '512a75c8-713d-418b-adc8-07b2bf513923', 'attached_at': '2026-05-28T14:07:28.000000', 'detached_at': '', 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'multiattach': True, 'serial': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:07:29.337078 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:07:29.339235 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='512a75c8-713d-418b-adc8-07b2bf513923'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977249.3380644) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:07:29.341123 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:07:29.341572 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:07:29.343052 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:07:29.343330 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:07:29.344704 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:07:29.345363 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:07:29.347094 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:07:29.368545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:29.467327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:29.467829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:29.468385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:29.468678 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:29.470173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:29.470648 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:07:29.471079 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:29.471252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:29.471674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:29.471939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:07:29.483381 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:29.486255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:29.486839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:29.487535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:29.487739 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:29.488378 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:29.488947 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:29.504549 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:29.504549 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:29.510160 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:29.510160 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:29.518998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:29.526525 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.538614 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.539162 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:29.539162 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:29.539633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:29.540161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('13', '0', '0', 0) found on session 63 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:29.540283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:29.547930 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:29.547930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:29.549864 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:29.553547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 63 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:29.554152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:29.555742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('14', '0', '0', 0) found on session 64 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:29.555742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:29.564787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 64 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:29.564787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:29.647100 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:07:29.850658 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:30.355425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1dbe8f7e-115a-491a-adb9-f342cba338e8 req-46420770-ea5b-48b1-b6dd-5f83a632a520 service nova] Releasing lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:30.356045 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquired lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:30.356308 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:07:30.487961 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:07:30.650626 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:30.839041 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:30.930618 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:07:31.102113 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:31.220620 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating instance_info_cache with network_info: [{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Creating image(s)
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Ensure instance console log exists: /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:31.400239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:31.722609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Releasing lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:31.723098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance network_info: |[{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:07:31.723551 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Start _get_guest_xml network_info=[{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '4101cf54-c1e6-405a-94a6-af0265daa642', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '06adb11e-c76e-438b-ae08-682156eb6255', 'attached_at': '', 'detached_at': '', 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'serial': '716e1389-8ad8-432e-bf18-b9d6eabb97e4'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:07:31.726243 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:07:31.727301 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-739018894', uuid='06adb11e-c76e-438b-ae08-682156eb6255'), owner=OwnerMeta(userid='357253ac91f34daeb60ae1dfd3e4a86f', username='tempest-ServerActionsTestOtherA-354716614-project-member', projectid='6a74849f3fb24097a5a42457746f02d2', projectname='tempest-ServerActionsTestOtherA-354716614'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977251.726978) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:07:31.728215 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:07:31.728625 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:07:31.729422 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:07:31.729670 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:07:31.730562 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:07:31.730933 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:07:31.731073 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:07:31.731165 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:07:31.731314 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:07:31.731411 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:07:31.731520 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:07:31.731695 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:07:31.731805 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:07:31.731941 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:07:31.732061 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:07:31.732175 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:07:31.741629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:07:31.741858 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:31.741958 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:34.483877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:34.494175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:34.494760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:35.000469 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:35.191268 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.191510 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.191699 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.191913 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.192177 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.192387 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.192586 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.192736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:07:35.192950 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:07:35.698336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:35.698917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:35.698917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:35.699021 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:07:35.811732 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00037675900011890917 future=<Future at 0x71a778156540 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:35.812091 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Emitting event <LifecycleEvent: 1779977240.8112366, 512a75c8-713d-418b-adc8-07b2bf513923 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:35.812182 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:35.812352 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] VM Stopped (Lifecycle Event)
May 28 14:07:35.852513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:36.008330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:36.314813 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:36.316563 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:07:36.727612 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:36.819698 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 14:07:36.834246 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:36.834954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:36.948427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:36.952596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.037987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.038508 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.121317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.125027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.178844 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:37.179181 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:37.179482 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attaching volume c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 to /dev/vdb
May 28 14:07:37.205112 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.205619 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.223681 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:37.236784 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:07:37.257909 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.289216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.289838 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:07:37.294824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.307190 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:07:37.307678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:07:37.318332 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:07:37.320291 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fed2:68ea', 'fe80::fc16:3eff:fe46:cb5b', 'fe80::18dc:67ff:fe4a:b24d', 'fe80::fc16:3eff:fe49:2e40', 'fe80::fc16:3eff:fec7:e1ff', 'fe80::fc16:3eff:feaf:1b8e', 'fe80::fc16:3eff:fedd:75a0', 'fe80::3820:d3ff:fee1:991b', 'fe80::fc16:3eff:fe6c:f2b', 'fe80::5825:dff:fe35:f22c', 'fe80::fc16:3eff:fec5:190c', 'fe80::a4ab:75ff:fe88:234a'] 
May 28 14:07:37.320291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:07:37.320546 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:07:37.320762 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:37.321128 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updating existing volume attachment record: bf028dc7-39c3-4b9f-89ae-6e8ac16a063f {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:07:37.376974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.377351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.474770 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.479249 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:07:37.479401 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:07:37.479558 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-10 (vdc) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:07:37.481507 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.531186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 3300000006d9dae6b for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:07:37.532043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.060s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:37.532433 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (8060ms) {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:37.532680 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:07:37.534365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.792s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:37.534731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:07:37.549832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:37.550306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:37.550568 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:37.551675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:37.552001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:37.553632 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:37.567158 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:07:37.567158 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:37.575672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:07:37.575672 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:37.587303 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4] added
May 28 14:07:37.587303 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:07:37.587303 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:37.587303 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:37.587303 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:37.587303 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:37.587303 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:37.587592 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:07:37.587784 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:07:37.588342 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:07:37.593201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4] added
May 28 14:07:37.593201 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:07:37.593201 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:37.593201 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:37.593201 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:37.593201 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:37.593201 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:37.593528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:07:37.594272 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0399(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:07:37.594272 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:07:37.603497 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.603497 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.710325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.710735 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:07:37.714139 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.804182 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.804704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.876517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:07:37.876981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:37.877153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:37.910011 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.912595 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:07:37.914141 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:07:37.915235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:37.954651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.039s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:37.955073 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=11736MB free_disk=73.12508010864258GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:07:37.955247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:37.955485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:38.044473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=31,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:25Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-t5gyv8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:07:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=512a75c8-713d-418b-adc8-07b2bf513923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:07:38.044473 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:38.045302 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:38.046866 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] End _get_guest_xml xml=<domain type="qemu">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <uuid>512a75c8-713d-418b-adc8-07b2bf513923</uuid>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <name>instance-0000001f</name>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <memory>262144</memory>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:name>multiattach-server-0</nova:name>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:07:29</nova:creationTime>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.micro" id="84">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:memory>256</nova:memory>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         <nova:port uuid="027666be-2507-4940-ae85-8c79ccf188b7">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <system>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <entry name="serial">512a75c8-713d-418b-adc8-07b2bf513923</entry>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <entry name="uuid">512a75c8-713d-418b-adc8-07b2bf513923</entry>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </system>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <os>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   </os>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <features>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   </features>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   <devices>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </disk>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk.config"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </disk>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-5"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <shareable/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </disk>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ad:d3:ed"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <target dev="tap027666be-25"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </interface>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/console.log" append="off"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </serial>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <video>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </video>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </rng>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:   </devices>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]: </domain>
May 28 14:07:38.046866 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:07:38.049547 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=31,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:25Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-t5gyv8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:07:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=512a75c8-713d-418b-adc8-07b2bf513923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:07:38.049547 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:ad:d3:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:38.049547 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:38.049547 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:07:38.049547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:38.049547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:38.049935 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:07:38.050968 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:38.051149 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '696e0eab-508f-55e5-8851-def37590a41a', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:38.052558 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:38.052983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:38.053542 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:38.055848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:38.056068 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap027666be-25, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:38.056532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap027666be-25, col_values=(('qos', UUID('12d6d604-6994-45bb-958a-960e227e4fe2')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:38.056731 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap027666be-25, col_values=(('external_ids', {'iface-id': '027666be-2507-4940-ae85-8c79ccf188b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:d3:ed', 'vm-uuid': '512a75c8-713d-418b-adc8-07b2bf513923'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:38.057700 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:38.059078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:38.070702 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:38.071733 np0000001643 nova-compute[98269]: INFO os_vif [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25')
May 28 14:07:38.588530 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:38.594247 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:38.603746 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:38.603746 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:38.610695 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:38.610695 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.619638 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.627579 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.638911 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.639266 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.651117 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.651604 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:38.695495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260]
May 28 14:07:38.695495 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260] successful.
May 28 14:07:38.695495 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.709011 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.722838 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260]
May 28 14:07:38.722838 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260] successful.
May 28 14:07:38.722838 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.731414 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.733623 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:38.733623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:38.734636 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('7', '-', '-', 0) found on session 65 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:38.734636 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:38.738046 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:38.753384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 65 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:38.753384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.762831 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:38.763264 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:38.763664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:38.764087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:38.767559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('8', '-', '-', 0) found on session 66 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:38.767559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:38.783231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 66 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:38.783371 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:38.968374 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Applying migration context for instance 512a75c8-713d-418b-adc8-07b2bf513923 as it has an incoming, in-progress migration c8122779-9475-4ad8-85fc-1f731892010a. Migration status is post-migrating {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 14:07:38.969636 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating resource usage from migration c8122779-9475-4ad8-85fc-1f731892010a
May 28 14:07:39.019147 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 90b0ea10-2b38-4907-aa11-02454a817a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.019280 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 27823c45-9fce-41b2-923b-a5a907ef029c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.019396 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.019528 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.019656 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 409cb876-fbae-4f7d-8e80-544174cb94b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.019781 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d6202b83-7043-4c19-81b6-13f2e5c64fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.019916 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.020049 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Migration c8122779-9475-4ad8-85fc-1f731892010a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 14:07:39.020163 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 512a75c8-713d-418b-adc8-07b2bf513923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.020279 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 06adb11e-c76e-438b-ae08-682156eb6255 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:07:39.020504 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:07:39.020667 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:07:37 up 34 min,  2 users,  load average: 8.97, 7.73, 4.10\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_6a74849f3fb24097a5a42457746f02d2': '2', 'io_workload': '1', 'num_proj_ac4618bb9b554fb8af8f26aae95c016a': '5', 'num_proj_9378d3afdd7e4c58bb7884c3cdea9056': '1', 'num_task_resize_finish': '1', 'num_proj_706c08c92c6844b3ab7b4019269eabad': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:07:39.487461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:39.523860 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:07:39.524115 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:39.553028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:07:39.590178 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:39.590306 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:39.590875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:39.590875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:ad:d3:ed, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:07:39.590993 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Using config drive
May 28 14:07:40.028603 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:40.033765 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:40.063502 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:40.065121 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:40.154648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:40.209190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:40.210085 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:40.251183 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-425189c3-bd2a-448d-b968-f08f0dcb1282 req-22e6108b-dd06-474b-8825-7a4d79a5ba72 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:40.251183 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-425189c3-bd2a-448d-b968-f08f0dcb1282 req-22e6108b-dd06-474b-8825-7a4d79a5ba72 service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:40.251474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-425189c3-bd2a-448d-b968-f08f0dcb1282 req-22e6108b-dd06-474b-8825-7a4d79a5ba72 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:40.251728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-425189c3-bd2a-448d-b968-f08f0dcb1282 req-22e6108b-dd06-474b-8825-7a4d79a5ba72 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:40.251930 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-425189c3-bd2a-448d-b968-f08f0dcb1282 req-22e6108b-dd06-474b-8825-7a4d79a5ba72 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] No waiting events found dispatching network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:40.251980 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-425189c3-bd2a-448d-b968-f08f0dcb1282 req-22e6108b-dd06-474b-8825-7a4d79a5ba72 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received unexpected event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 for instance with vm_state active and task_state resize_finish.
May 28 14:07:40.446365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:40.446664 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:40.446982 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:40.447250 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:40.447346 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:40.451405 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Terminating instance
May 28 14:07:40.537084 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:07:40.537304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.582s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:40.537647 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 38.29 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:07:40.572981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Found WWN 330000000bc8d01a1 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:07:40.573342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:40.573620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== connect_volume: return (8831ms) {'type': 'block', 'scsi_wwn': '330000000bc8d01a1', 'path': '/dev/dm-0', 'multipath_id': '330000000bc8d01a1'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:40.573782 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bc8d01a1', 'path': '/dev/dm-0', 'multipath_id': '330000000bc8d01a1'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:07:40.575119 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.697s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:40.575459 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:07:40.594440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:40.594653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:40.595139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:40.596028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:40.597132 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:40.597132 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:40.614938 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:07:40.614938 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:40.623425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:07:40.623425 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:40.632890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8] added
May 28 14:07:40.632890 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:07:40.632890 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:40.632890 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:40.632890 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:40.632890 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:40.632890 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:40.634204 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:07:40.634204 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:07:40.634204 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:07:40.636005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8] added
May 28 14:07:40.636005 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:07:40.636005 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:40.636005 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:40.636005 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:40.636005 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:40.636005 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:40.636311 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:07:40.636311 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:07:40.636458 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:07:40.895650 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977260.8952086, 512a75c8-713d-418b-adc8-07b2bf513923 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:40.895793 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] VM Resumed (Lifecycle Event)
May 28 14:07:40.897267 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:07:40.902635 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance running successfully.
May 28 14:07:40.903329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Failed to set time: agent not configured {{(pid=98269) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 14:07:40.903790 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71e2e252-cba4-415b-9ebd-66f92859c826 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] finish_migration finished successfully. {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 14:07:40.956225 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:07:40.985071 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:40.988870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.015843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.017667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.047366 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.053026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.091025 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-739018894',display_name='tempest-ServerActionsTestOtherA-server-739018894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-739018894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-2neos4o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=06adb11e-c76e-438b-ae08-682156eb6255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:07:41.091816 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:41.092741 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:41.093666 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'pci_devices' on Instance uuid 06adb11e-c76e-438b-ae08-682156eb6255 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:41.098479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.105885 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.194773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.232715 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cd2a04bb-793f-40fb-960c-02860231399e req-9d337f4f-d87c-449a-89ed-19b3017b1696 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:41.233424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd2a04bb-793f-40fb-960c-02860231399e req-9d337f4f-d87c-449a-89ed-19b3017b1696 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:41.233424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd2a04bb-793f-40fb-960c-02860231399e req-9d337f4f-d87c-449a-89ed-19b3017b1696 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:41.233424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd2a04bb-793f-40fb-960c-02860231399e req-9d337f4f-d87c-449a-89ed-19b3017b1696 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:41.234943 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cd2a04bb-793f-40fb-960c-02860231399e req-9d337f4f-d87c-449a-89ed-19b3017b1696 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:41.234943 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cd2a04bb-793f-40fb-960c-02860231399e req-9d337f4f-d87c-449a-89ed-19b3017b1696 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-300da7b6-2392-463e-9abf-448f59da647d for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:41.269158 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8cb2c8b0-9e2b-4c26-a523-8372f40474a7 req-4c69a8dd-c2af-40a6-a07f-64b67b5ce36d service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:41.269354 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8cb2c8b0-9e2b-4c26-a523-8372f40474a7 req-4c69a8dd-c2af-40a6-a07f-64b67b5ce36d service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:41.271142 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8cb2c8b0-9e2b-4c26-a523-8372f40474a7 req-4c69a8dd-c2af-40a6-a07f-64b67b5ce36d service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:41.271142 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8cb2c8b0-9e2b-4c26-a523-8372f40474a7 req-4c69a8dd-c2af-40a6-a07f-64b67b5ce36d service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:41.271142 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8cb2c8b0-9e2b-4c26-a523-8372f40474a7 req-4c69a8dd-c2af-40a6-a07f-64b67b5ce36d service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:41.271142 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8cb2c8b0-9e2b-4c26-a523-8372f40474a7 req-4c69a8dd-c2af-40a6-a07f-64b67b5ce36d service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-ac3a901d-4ef1-4379-974d-324dded4930d for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:41.314329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.364476 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.401091 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:41.407742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.409328 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:07:41.438534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.496087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.496087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.532220 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.577582 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.606372 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] End _get_guest_xml xml=<domain type="qemu">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <uuid>06adb11e-c76e-438b-ae08-682156eb6255</uuid>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <name>instance-00000022</name>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsTestOtherA-server-739018894</nova:name>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:07:31</nova:creationTime>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:user uuid="357253ac91f34daeb60ae1dfd3e4a86f">tempest-ServerActionsTestOtherA-354716614-project-member</nova:user>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:project uuid="6a74849f3fb24097a5a42457746f02d2">tempest-ServerActionsTestOtherA-354716614</nova:project>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         <nova:port uuid="1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <system>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <entry name="serial">06adb11e-c76e-438b-ae08-682156eb6255</entry>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <entry name="uuid">06adb11e-c76e-438b-ae08-682156eb6255</entry>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </system>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <os>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   </os>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <features>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   </features>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   <devices>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </disk>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <alias name="ua-716e1389-8ad8-432e-bf18-b9d6eabb97e4"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <serial>716e1389-8ad8-432e-bf18-b9d6eabb97e4</serial>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </disk>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:4e:07:8b"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <target dev="tap1aa9a613-a7"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </interface>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/console.log" append="off"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </serial>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <video>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </video>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </rng>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:   </devices>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]: </domain>
May 28 14:07:41.606372 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:07:41.606372 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Preparing to wait for external event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:07:41.606372 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:41.606372 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:41.606372 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:41.611299 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-739018894',display_name='tempest-ServerActionsTestOtherA-server-739018894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-739018894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-2neos4o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=06adb11e-c76e-438b-ae08-682156eb6255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:07:41.611299 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:41.611623 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:41.611775 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:07:41.612283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.612996 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:41.612996 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:07:41.618488 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.618715 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c479fc93-b004-52b2-b0a6-e49ad7249f64', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:41.621093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.625051 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:41.634846 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:41.636869 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:41.647797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:41.659815 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:41.659815 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:41.675307 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:41.675307 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.678154 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Instance destroyed successfully.
May 28 14:07:41.678154 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lazy-loading 'resources' on Instance uuid 409cb876-fbae-4f7d-8e80-544174cb94b6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:41.686338 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.693098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.701377 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.702803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.706565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aa9a613-a7, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:41.706565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aa9a613-a7, col_values=(('qos', UUID('ea03a0fb-18a8-4369-82bb-421c2f212e5b')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:41.706565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aa9a613-a7, col_values=(('external_ids', {'iface-id': '1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:07:8b', 'vm-uuid': '06adb11e-c76e-438b-ae08-682156eb6255'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:41.712004 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.712742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.731760 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.732840 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.739739 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.740779 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:41.795219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:41.797110 np0000001643 nova-compute[98269]: INFO os_vif [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7')
May 28 14:07:41.803339 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.50.100,3260]
May 28 14:07:41.803339 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.50.100,3260] successful.
May 28 14:07:41.803339 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.822223 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.833122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.40.100,3260]
May 28 14:07:41.833122 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.40.100,3260] successful.
May 28 14:07:41.833122 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.847406 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.847781 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:41.848114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.253s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:41.848114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:41.849079 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('11', '-', '-', 0) found on session 67 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:41.849180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:41.852294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:41.873200 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 67 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:41.873200 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:41.884270 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.288s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:41.884270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:41.886062 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('12', '-', '-', 0) found on session 68 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:41.886062 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:41.900675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 68 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:41.900675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:41.912024 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 14:07:41.912315 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977261.9121196, 512a75c8-713d-418b-adc8-07b2bf513923 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:41.912427 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] VM Started (Lifecycle Event)
May 28 14:07:42.185742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:42.186376 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "300da7b6-2392-463e-9abf-448f59da647d", "address": "fa:16:3e:d2:68:ea", "network": {"id": "f33b58c7-1a00-462b-bcf5-d5bbf59254fe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1885282984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap300da7b6-23", "ovs_interfaceid": "300da7b6-2392-463e-9abf-448f59da647d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:42.187064 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:68:ea,bridge_name='br-int',has_traffic_filtering=True,id=300da7b6-2392-463e-9abf-448f59da647d,network=Network(f33b58c7-1a00-462b-bcf5-d5bbf59254fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300da7b6-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:42.187064 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:68:ea,bridge_name='br-int',has_traffic_filtering=True,id=300da7b6-2392-463e-9abf-448f59da647d,network=Network(f33b58c7-1a00-462b-bcf5-d5bbf59254fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300da7b6-23') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:42.190329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.190604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap300da7b6-23, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.191688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.192378 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.228261 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.229497 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.229699 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c99b4db3-45c9-41ec-a23b-9f1b28b4d5b0) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.230244 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.230757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.267351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.270082 np0000001643 nova-compute[98269]: INFO os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:68:ea,bridge_name='br-int',has_traffic_filtering=True,id=300da7b6-2392-463e-9abf-448f59da647d,network=Network(f33b58c7-1a00-462b-bcf5-d5bbf59254fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300da7b6-23')
May 28 14:07:42.270968 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:42.271123 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "ac3a901d-4ef1-4379-974d-324dded4930d", "address": "fa:16:3e:46:cb:5b", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3a901d-4e", "ovs_interfaceid": "ac3a901d-4ef1-4379-974d-324dded4930d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:42.271712 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:cb:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac3a901d-4ef1-4379-974d-324dded4930d,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac3a901d-4e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:42.271974 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cb:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac3a901d-4ef1-4379-974d-324dded4930d,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac3a901d-4e') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:42.273295 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.273461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac3a901d-4e, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.274462 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.275160 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.304068 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.305289 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.305408 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b9cf073-29a8-4a49-a344-e70e0b885730) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.305951 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.306816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.337214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.339150 np0000001643 nova-compute[98269]: INFO os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cb:5b,bridge_name='br-int',has_traffic_filtering=True,id=ac3a901d-4ef1-4379-974d-324dded4930d,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac3a901d-4e')
May 28 14:07:42.339849 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:42.340076 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "address": "fa:16:3e:49:2e:40", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ddc5d3-9a", "ovs_interfaceid": "89ddc5d3-9aaa-4728-a54a-054a2d23b0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:42.340656 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:2e:40,bridge_name='br-int',has_traffic_filtering=True,id=89ddc5d3-9aaa-4728-a54a-054a2d23b0e3,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89ddc5d3-9a') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:42.340838 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2e:40,bridge_name='br-int',has_traffic_filtering=True,id=89ddc5d3-9aaa-4728-a54a-054a2d23b0e3,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89ddc5d3-9a') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:42.342063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.342293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89ddc5d3-9a, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.343372 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.344300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.371303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.372531 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.372737 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0665ed44-c923-462f-a213-53c09e14cb49) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.373418 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.374200 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.400656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.405136 np0000001643 nova-compute[98269]: INFO os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2e:40,bridge_name='br-int',has_traffic_filtering=True,id=89ddc5d3-9aaa-4728-a54a-054a2d23b0e3,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap89ddc5d3-9a')
May 28 14:07:42.405895 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:42.406103 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "address": "fa:16:3e:c7:e1:ff", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ebef22-93", "ovs_interfaceid": "28ebef22-93cd-4d32-90a8-9511a7ed313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:42.406901 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e1:ff,bridge_name='br-int',has_traffic_filtering=True,id=28ebef22-93cd-4d32-90a8-9511a7ed313a,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ebef22-93') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:42.407097 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e1:ff,bridge_name='br-int',has_traffic_filtering=True,id=28ebef22-93cd-4d32-90a8-9511a7ed313a,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ebef22-93') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:42.408625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.408625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28ebef22-93, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.409311 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.410135 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.414967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:42.418154 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:07:42.436227 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.437429 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.437620 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60cc60b9-08ed-4fd1-ae6a-b3ad18960a7a) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.438217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.438732 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.458560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.461049 np0000001643 nova-compute[98269]: INFO os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e1:ff,bridge_name='br-int',has_traffic_filtering=True,id=28ebef22-93cd-4d32-90a8-9511a7ed313a,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ebef22-93')
May 28 14:07:42.461834 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:42.462091 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "address": "fa:16:3e:af:1b:8e", "network": {"id": "e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1924473097", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d834084-9d", "ovs_interfaceid": "9d834084-9ddc-48db-9f45-8d878ab91ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:42.462659 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1b:8e,bridge_name='br-int',has_traffic_filtering=True,id=9d834084-9ddc-48db-9f45-8d878ab91ac5,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d834084-9d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:42.462872 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1b:8e,bridge_name='br-int',has_traffic_filtering=True,id=9d834084-9ddc-48db-9f45-8d878ab91ac5,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d834084-9d') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:42.464412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.464643 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d834084-9d, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.465579 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.466535 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.482085 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.483038 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.483302 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d47a7c34-281d-47c7-98aa-b52ba460bb67) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.483809 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.484313 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.500784 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.503155 np0000001643 nova-compute[98269]: INFO os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1b:8e,bridge_name='br-int',has_traffic_filtering=True,id=9d834084-9ddc-48db-9f45-8d878ab91ac5,network=Network(e68de8ec-35ad-4ff5-b6f1-2d4d09de36f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d834084-9d')
May 28 14:07:42.504629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:42.504629 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "address": "fa:16:3e:dd:75:a0", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b97fba0-f9", "ovs_interfaceid": "9b97fba0-f944-4595-8a3b-127f5cc7d846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:42.504629 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=9b97fba0-f944-4595-8a3b-127f5cc7d846,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b97fba0-f9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:42.504993 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=9b97fba0-f944-4595-8a3b-127f5cc7d846,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b97fba0-f9') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:42.506531 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.506819 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b97fba0-f9, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.508018 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.509304 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.520861 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.521912 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.522069 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74d41479-0c3e-4b00-9217-6463adbe9c28) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.522960 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.523896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.534222 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.536405 np0000001643 nova-compute[98269]: INFO os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=9b97fba0-f944-4595-8a3b-127f5cc7d846,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b97fba0-f9')
May 28 14:07:42.537084 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-702030566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-device-tagging-server-702030566',id=30,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBj5xBEGpp2W/zBIdDQFWYwCwiHxNzC6Oi+SwjLdPtRKtkIfIXSd/vmk3TlNHJp9scfxUrJPkNi3IMN9zX9zahOx5MuOPsF5DQ9CM8SRRkOoNJ41flLl02neXkYF2h/4Q==',key_name='tempest-keypair-592726446',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378d3afdd7e4c58bb7884c3cdea9056',ramdisk_id='',reservation_id='r-brq0jjcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1877897096',owner_user_name='tempest-TaggedBootDevicesTest-1877897096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a28d8974a9141cb8333d6ae154e7387',uuid=409cb876-fbae-4f7d-8e80-544174cb94b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:07:42.537304 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converting VIF {"id": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "address": "fa:16:3e:6c:0f:2b", "network": {"id": "df64d041-81e9-4def-8ca8-2ca5b2a75fdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1237192807", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9378d3afdd7e4c58bb7884c3cdea9056", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c95821-59", "ovs_interfaceid": "c2c95821-5913-43a4-868b-7c483f5a2ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:07:42.537882 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0f:2b,bridge_name='br-int',has_traffic_filtering=True,id=c2c95821-5913-43a4-868b-7c483f5a2ed1,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c95821-59') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:07:42.537985 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0f:2b,bridge_name='br-int',has_traffic_filtering=True,id=c2c95821-5913-43a4-868b-7c483f5a2ed1,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c95821-59') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:07:42.538975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.539054 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2c95821-59, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.541489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.547620 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.549142 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.549345 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3ad94ec-696c-4032-99ba-ca02dab15a8b) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:07:42.549990 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.551215 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:07:42.556704 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:42.559295 np0000001643 nova-compute[98269]: INFO os_vif [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0f:2b,bridge_name='br-int',has_traffic_filtering=True,id=c2c95821-5913-43a4-868b-7c483f5a2ed1,network=Network(df64d041-81e9-4def-8ca8-2ca5b2a75fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c95821-59')
May 28 14:07:42.560936 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:07:42.561592 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:42.561746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:42.587421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:42.587603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:42.587738 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Going to confirm migration 2 {{(pid=98269) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 14:07:42.596030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:07:42.898788 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9a36cc0-39e3-4719-8047-7f8387cf0dcf req-b9c633f1-9d85-4d2f-9e09-6b62d1361d1b service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:42.899076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9a36cc0-39e3-4719-8047-7f8387cf0dcf req-b9c633f1-9d85-4d2f-9e09-6b62d1361d1b service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:42.899200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9a36cc0-39e3-4719-8047-7f8387cf0dcf req-b9c633f1-9d85-4d2f-9e09-6b62d1361d1b service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:42.899337 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9a36cc0-39e3-4719-8047-7f8387cf0dcf req-b9c633f1-9d85-4d2f-9e09-6b62d1361d1b service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:42.899535 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9a36cc0-39e3-4719-8047-7f8387cf0dcf req-b9c633f1-9d85-4d2f-9e09-6b62d1361d1b service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] No waiting events found dispatching network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:42.899678 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b9a36cc0-39e3-4719-8047-7f8387cf0dcf req-b9c633f1-9d85-4d2f-9e09-6b62d1361d1b service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received unexpected event network-vif-plugged-027666be-2507-4940-ae85-8c79ccf188b7 for instance with vm_state resized and task_state None.
May 28 14:07:42.921433 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999589010999898 future=<Future at 0x71a75c2e15e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:42.922088 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99889134599971 future=<Future at 0x71a75c2e15e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:42.922185 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998754831000042 future=<Future at 0x71a75c2e15e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:43.092243 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:43.252127 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:43.252487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:43.252533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:43.252634 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:07:43.252788 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'info_cache' on Instance uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:43.318397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:43.318575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:43.318720 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No VIF found with MAC fa:16:3e:4e:07:8b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:07:43.319895 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Using config drive
May 28 14:07:43.334228 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.334438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.337246 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.337437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.337800 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.337972 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-300da7b6-2392-463e-9abf-448f59da647d for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.338056 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.338187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.338301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.338405 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.338553 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.338653 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.338763 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.338876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.339040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.339208 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.339325 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.339426 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f9701e39-10ef-475f-a037-321f60f0f473 req-b55611c1-2f2a-4eda-bbb1-6303b157329b service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-c2c95821-5913-43a4-868b-7c483f5a2ed1 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.364081 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.364305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.364479 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.364612 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.364916 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-ac3a901d-4ef1-4379-974d-324dded4930d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.365076 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-ac3a901d-4ef1-4379-974d-324dded4930d for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.365201 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.365526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.365526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.365646 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.365706 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.365767 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-28ebef22-93cd-4d32-90a8-9511a7ed313a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.365853 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.366001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.366114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.366216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.366332 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.366399 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-28ebef22-93cd-4d32-90a8-9511a7ed313a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.366509 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.366609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.366716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.366821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.366949 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.367040 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.367128 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.367233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.367362 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.367468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.367759 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.367824 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-89ddc5d3-9aaa-4728-a54a-054a2d23b0e3 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.367911 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.368051 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.368157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.368271 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.368370 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.368630 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.368630 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.368763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.368912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.369050 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.369159 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.369252 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9d834084-9ddc-48db-9f45-8d878ab91ac5 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.369338 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.369438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.369560 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.369644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.369730 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.369815 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.369899 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:43.370011 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Acquiring lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:43.370102 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:43.370183 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:43.370320 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] No waiting events found dispatching network-vif-unplugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:43.370426 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65376327-7272-455d-9207-865293c25423 req-47d78a14-c5d3-4fcf-9219-bbaf36582eb1 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-unplugged-9b97fba0-f944-4595-8a3b-127f5cc7d846 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:07:43.612560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found WWN 3300000007873a100 for multipath device dm-12 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:07:43.612842 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:43.613719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== connect_volume: return (5736ms) {'type': 'block', 'scsi_wwn': '3300000007873a100', 'path': '/dev/dm-12', 'multipath_id': '3300000007873a100'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:43.613719 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007873a100', 'path': '/dev/dm-12', 'multipath_id': '3300000007873a100'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:07:43.613882 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.052s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:43.614160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0bb48f61-5540-460d-95d2-f0ef27a59003', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:07:43.614570 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:07:43.621462 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:43.655942 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:43.656617 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '68')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:07:43.656617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '53')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:43.657850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003', '54')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:43.658856 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a77811dd00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'): ({'sdk'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:07:43.659105 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Removing multipathed devices sdj, sdk {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:07:43.659344 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Flush multipath device 330000000cc91dec2 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:07:43.724154 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:43.774699 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:43.822059 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:07:43.822217 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:07:43.823695 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:07:43.827844 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:43.834382 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:07:43.834580 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:07:43.848879 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:43.898744 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.40.100,3260]
May 28 14:07:43.898744 np0000001643 nova-compute[98269]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.40.100,3260] successful.
May 28 14:07:43.898744 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:43.924496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:43.942737 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:43.974369 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Creating config drive at /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config
May 28 14:07:43.979302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6av9axfy {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:43.993201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.50.100,3260]
May 28 14:07:43.993201 np0000001643 nova-compute[98269]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-0bb48f61-5540-460d-95d2-f0ef27a59003, portal: 192.168.50.100,3260] successful.
May 28 14:07:43.993201 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.022685 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.025255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:44.025255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== disconnect_volume: return (1461ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:44.025255 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:07:44.026021 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:07:44.026477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:44.027631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:44.027759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:44.028040 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f783b53-ba58-4c15-95ee-2b30fb9c5957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:07:44.028187 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:07:44.045389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6av9axfy" returned: 0 in 0.063s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.062052 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:44.062052 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '68')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:07:44.063007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '57')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:44.065753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957', '58')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:44.065753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778162e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'): ({'sdm'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:07:44.065753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Removing multipathed devices sdl, sdm {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:07:44.066304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Flush multipath device 330000000d2207249 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:07:44.098069 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:44.124884 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attempting to attach volume c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:07:44.126758 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:07:44.126758 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:07:44.126758 np0000001643 nova-compute[98269]:   <alias name="ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8"/>
May 28 14:07:44.126758 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-12"/>
May 28 14:07:44.126758 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:07:44.126758 np0000001643 nova-compute[98269]:   <serial>c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8</serial>
May 28 14:07:44.126758 np0000001643 nova-compute[98269]: </disk>
May 28 14:07:44.126758 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:07:44.157396 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:44.217998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:07:44.218188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:07:44.219715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:07:44.232774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:07:44.233224 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:07:44.250025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.262001 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:44.301053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.40.100,3260]
May 28 14:07:44.301053 np0000001643 nova-compute[98269]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.40.100,3260] successful.
May 28 14:07:44.301053 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.334943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.358100 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.410162 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.50.100,3260]
May 28 14:07:44.410162 np0000001643 nova-compute[98269]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-1f783b53-ba58-4c15-95ee-2b30fb9c5957, portal: 192.168.50.100,3260] successful.
May 28 14:07:44.410162 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.437041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.437392 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:44.437613 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== disconnect_volume: return (409ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:44.437807 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:07:44.439952 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:07:44.440502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:44.440830 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:44.441280 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:44.441683 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f27c099-929f-4674-ac6f-7f8e770116d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:07:44.442502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.482298 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:44.482741 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '68')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:07:44.482741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '59')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:44.484038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8', '60')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:07:44.484986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778163740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'): ({'sdo'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:07:44.485269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Removing multipathed devices sdo, sdn {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:07:44.485929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Flush multipath device 330000000eb13186c {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:07:44.489302 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:44.526301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:44.588884 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:07:44.638634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:07:44.638866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:07:44.640166 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:07:44.659625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:07:44.659625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:07:44.682350 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.721211 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.40.100,3260]
May 28 14:07:44.721211 np0000001643 nova-compute[98269]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.40.100,3260] successful.
May 28 14:07:44.721211 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.748782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.771803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.782977 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:44.789863 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:44.814046 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:44.817531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.50.100,3260]
May 28 14:07:44.817531 np0000001643 nova-compute[98269]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-7f27c099-929f-4674-ac6f-7f8e770116d8, portal: 192.168.50.100,3260] successful.
May 28 14:07:44.817531 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.841972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:44.842344 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:44.842581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] <== disconnect_volume: return (401ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:44.842752 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:07:44.843466 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Deleting instance files /opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6_del
May 28 14:07:44.843988 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Deletion of /opt/stack/data/nova/instances/409cb876-fbae-4f7d-8e80-544174cb94b6_del complete
May 28 14:07:44.913820 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:44.991471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:45.009576 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:45.010779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:45.143890 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a7a98509-7c68-4055-97f6-ab8760bb3d5e req-72beda92-26a9-47b2-89dd-aa07e6d715e9 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:45.145273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a7a98509-7c68-4055-97f6-ab8760bb3d5e req-72beda92-26a9-47b2-89dd-aa07e6d715e9 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:45.145273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a7a98509-7c68-4055-97f6-ab8760bb3d5e req-72beda92-26a9-47b2-89dd-aa07e6d715e9 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:45.145273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a7a98509-7c68-4055-97f6-ab8760bb3d5e req-72beda92-26a9-47b2-89dd-aa07e6d715e9 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:45.145273 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a7a98509-7c68-4055-97f6-ab8760bb3d5e req-72beda92-26a9-47b2-89dd-aa07e6d715e9 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Processing event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:07:45.250398 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:45.353276 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Took 4.40 seconds to destroy the instance on the hypervisor.
May 28 14:07:45.354053 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:07:45.354414 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:07:45.354552 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:07:45.354799 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:45.493988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:45.494262 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'migration_context' on Instance uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:45.617850 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:45.805736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:07:45.807037 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977265.806613, 06adb11e-c76e-438b-ae08-682156eb6255 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:45.807215 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] VM Started (Lifecycle Event)
May 28 14:07:45.811242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:07:45.813393 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance spawned successfully.
May 28 14:07:45.813839 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:07:45.996807 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Object Instance<512a75c8-713d-418b-adc8-07b2bf513923> lazy-loaded attributes: info_cache,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:07:46.003572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:46.003761 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:46.177475 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:46.177475 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:46.177475 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:46.177475 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No VIF found with MAC fa:16:3e:c5:19:0c, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:07:46.311148 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:46.313701 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:07:46.325563 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:07:46.325755 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:07:46.326249 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:07:46.326491 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:07:46.326805 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:07:46.327228 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:07:46.821071 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:07:46.823005 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977266.8216753, 06adb11e-c76e-438b-ae08-682156eb6255 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:46.823005 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] VM Paused (Lifecycle Event)
May 28 14:07:46.835080 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Took 15.44 seconds to spawn the instance on the hypervisor.
May 28 14:07:46.835364 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:47.151223 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:47.174581 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:07:47.174581 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:47.221861 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-49ed32c1-ca92-449d-97d1-98237956785e req-792f2d2f-b1b2-4e97-81b0-d6097eac5ac3 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:47.222878 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-49ed32c1-ca92-449d-97d1-98237956785e req-792f2d2f-b1b2-4e97-81b0-d6097eac5ac3 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:47.223025 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-49ed32c1-ca92-449d-97d1-98237956785e req-792f2d2f-b1b2-4e97-81b0-d6097eac5ac3 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:47.223134 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-49ed32c1-ca92-449d-97d1-98237956785e req-792f2d2f-b1b2-4e97-81b0-d6097eac5ac3 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:47.223218 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-49ed32c1-ca92-449d-97d1-98237956785e req-792f2d2f-b1b2-4e97-81b0-d6097eac5ac3 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] No waiting events found dispatching network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:07:47.223328 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-49ed32c1-ca92-449d-97d1-98237956785e req-792f2d2f-b1b2-4e97-81b0-d6097eac5ac3 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received unexpected event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c for instance with vm_state active and task_state None.
May 28 14:07:47.263991 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4c1246c7-e079-48be-b201-46751e868817 req-ba102eed-8329-495b-9776-c197bdcfe9c8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-deleted-c2c95821-5913-43a4-868b-7c483f5a2ed1 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:47.263991 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-4c1246c7-e079-48be-b201-46751e868817 req-ba102eed-8329-495b-9776-c197bdcfe9c8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Neutron deleted interface c2c95821-5913-43a4-868b-7c483f5a2ed1; detaching it from the instance and deleting it from the info cache
May 28 14:07:47.266880 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4c1246c7-e079-48be-b201-46751e868817 req-ba102eed-8329-495b-9776-c197bdcfe9c8 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Detach interface failed, port_id=c2c95821-5913-43a4-868b-7c483f5a2ed1, reason: Instance 409cb876-fbae-4f7d-8e80-544174cb94b6 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:07:47.324828 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:47.326572 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977267.3262246, 06adb11e-c76e-438b-ae08-682156eb6255 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:47.326680 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] VM Resumed (Lifecycle Event)
May 28 14:07:47.348230 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Took 22.92 seconds to build instance.
May 28 14:07:47.551571 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:47.676932 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:47.766701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b07a3de0-f088-44e1-9934-5bab4e316354 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.587s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:47.830007 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:47.836092 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:07:47.850113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.428s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:48.478975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:48.692940 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.688s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:49.048288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:49.048833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:49.115794 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:49.305966 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d47998a2-5333-4e14-b3f0-dc9247643322 req-93138187-706a-45f5-ad4b-4c3f46b7d1a5 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-deleted-28ebef22-93cd-4d32-90a8-9511a7ed313a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:49.343341 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-82d4c7c5-ce49-4d11-94a0-06ffd57bcd48 req-9bce14fb-db44-4218-9f89-b1ac087d7b13 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-deleted-9d834084-9ddc-48db-9f45-8d878ab91ac5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:49.344530 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-82d4c7c5-ce49-4d11-94a0-06ffd57bcd48 req-9bce14fb-db44-4218-9f89-b1ac087d7b13 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-deleted-300da7b6-2392-463e-9abf-448f59da647d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:49.344530 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-82d4c7c5-ce49-4d11-94a0-06ffd57bcd48 req-9bce14fb-db44-4218-9f89-b1ac087d7b13 service nova] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Received event network-vif-deleted-9b97fba0-f944-4595-8a3b-127f5cc7d846 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:49.364627 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocation for migration c8122779-9475-4ad8-85fc-1f731892010a
May 28 14:07:49.491403 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:49.552755 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:49.618302 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Took 4.26 seconds to deallocate network for instance.
May 28 14:07:49.871703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74c29fb1-e74c-49e9-8879-9018677184fb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.284s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:50.667592 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.619s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:51.332750 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Took 1.71 seconds to detach 3 volumes for instance.
May 28 14:07:51.457833 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:51.457955 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing instance network info cache due to event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:07:51.458183 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:51.458326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:51.458662 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing network info cache for port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:07:51.498188 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-changed-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:51.498326 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Refreshing instance network info cache due to event network-changed-f9e5c2e2-c369-4d24-9857-ff3df1320952. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:07:51.498521 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] Acquiring lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:51.498597 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] Acquired lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:51.498743 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Refreshing network info cache for port f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:07:51.795557 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:51.796074 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:51.796074 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attaching volume b162555f-3e97-45c3-be2f-d6436d05eead to /dev/vdc
May 28 14:07:51.841654 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:51.842023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:51.865054 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:51.880716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:07:51.911914 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Stashing vm_state: active {{(pid=98269) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 14:07:51.917187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:07:51.961998 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:51.965187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:07:51.966651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:07:51.980581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:07:51.982088 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fec5:190c', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:fe4e:78b'] 
May 28 14:07:51.982321 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:07:51.982495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:07:51.982805 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:51.983310 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updating existing volume attachment record: affa54ec-6179-401c-a3fc-c9dd4cb06e69 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:07:52.006314 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:52.392303 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:52.414645 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:52.520998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:52.543818 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:52.554980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:52.580476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:07:52.580476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b162555f-3e97-45c3-be2f-d6436d05eead', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:07:52.580476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:52.580476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:52.580476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b162555f-3e97-45c3-be2f-d6436d05eead', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:07:52.598129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:52.599285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:07:52.600262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:52.600262 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:52.601623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:07:52.601623 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:52.619432 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:07:52.619432 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:52.628237 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:07:52.628237 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead] added
May 28 14:07:52.641136 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:52.641136 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:07:52.641136 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:07:52.647923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead] added
May 28 14:07:52.647923 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:07:52.647923 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:52.647923 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:52.647923 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:07:52.647923 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:07:52.647923 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:52.648225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:07:52.648406 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.047(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:07:52.648680 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:07:52.657058 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updated VIF entry in instance network info cache for port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:07:52.662181 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:52.747478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:07:52.747895 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:52.790945 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Updated VIF entry in instance network info cache for port f9e5c2e2-c369-4d24-9857-ff3df1320952. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:07:52.791088 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Updating instance_info_cache with network_info: [{"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:53.169513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-699faa66-0d44-45f3-95e2-6050f4c2a2ab req-2fbe6d1b-dadc-4ac7-b530-73d05fff05d7 service nova] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:53.254230 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:53.294852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] Releasing lock "refresh_cache-90b0ea10-2b38-4907-aa11-02454a817a01" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:53.295121 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-changed-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:53.295271 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Refreshing instance network info cache due to event network-changed-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:07:53.295435 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] Acquiring lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:53.295551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] Acquired lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:53.295678 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Refreshing network info cache for port 1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:07:53.525158 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-changed-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:07:53.525384 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing instance network info cache due to event network-changed-027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:07:53.525643 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:53.525802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:53.526155 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:07:53.639415 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:07:53.650317 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:53.657036 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:53.657036 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:07:53.667603 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:07:53.667603 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.675114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.682989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.696644 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.704412 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:53.749393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.50.100,3260]
May 28 14:07:53.749393 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.50.100,3260] successful.
May 28 14:07:53.749393 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.757348 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.40.100,3260]
May 28 14:07:53.757348 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.40.100,3260] successful.
May 28 14:07:53.757348 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.763951 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.922s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:53.767145 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.768316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.248s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:53.777754 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.790063 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:53.792377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:53.792377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:53.792377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('15', '-', '-', 0) found on session 69 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:53.792377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:53.798194 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:07:53.803157 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:53.803157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:07:53.804322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] HCTL ('16', '-', '-', 0) found on session 70 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:07:53.804322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:07:53.816108 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 69 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:53.816108 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b162555f-3e97-45c3-be2f-d6436d05eead', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:53.837909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Searching for a device in session 70 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:07:53.837909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b162555f-3e97-45c3-be2f-d6436d05eead', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:07:53.865246 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Deleted allocations for instance 409cb876-fbae-4f7d-8e80-544174cb94b6
May 28 14:07:54.030022 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:54.275130 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:07:54.275524 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Claim successful on node np0000001643
May 28 14:07:54.332499 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:54.495349 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:54.512389 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updated VIF entry in instance network info cache for port 1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:07:54.512725 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating instance_info_cache with network_info: [{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:54.534960 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:54.601678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:07:54.783357 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating resource usage from migration 2c387403-04ae-4f5e-af89-3fc622eea30d
May 28 14:07:54.878794 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updated VIF entry in instance network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:07:54.879099 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:54.881742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9bacb12d-2451-455b-a9d5-75f20a6b11c7 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Lock "409cb876-fbae-4f7d-8e80-544174cb94b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.435s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:55.015618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-379413a5-74e6-4bbe-96ef-7bfa67291a37 req-9f71ca17-6dcd-4901-b56d-a17ce4fb16a6 service nova] Releasing lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:55.345568 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:07:55.346286 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:07:55.382074 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-99c33c73-459c-456c-bfb3-e6840c71f708 req-bb308105-8c85-45a7-b58f-8a2d8be885ff service nova] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:55.621510 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found WWN 3300000006f3240d6 for multipath device dm-6 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:07:55.621981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:07:55.622353 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '3300000006f3240d6', 'path': '/dev/dm-6', 'multipath_id': '3300000006f3240d6'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:07:55.622650 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006f3240d6', 'path': '/dev/dm-6', 'multipath_id': '3300000006f3240d6'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:07:55.626702 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:07:55.785729 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:55.848500 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:07:56.134436 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attempting to attach volume b162555f-3e97-45c3-be2f-d6436d05eead with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:07:56.136834 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:07:56.136834 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:07:56.136834 np0000001643 nova-compute[98269]:   <alias name="ua-b162555f-3e97-45c3-be2f-d6436d05eead"/>
May 28 14:07:56.136834 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-6"/>
May 28 14:07:56.136834 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:07:56.136834 np0000001643 nova-compute[98269]:   <serial>b162555f-3e97-45c3-be2f-d6436d05eead</serial>
May 28 14:07:56.136834 np0000001643 nova-compute[98269]: </disk>
May 28 14:07:56.136834 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:07:56.356533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.588s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:56.356956 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Migrating
May 28 14:07:56.357000 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:07:56.702153 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:56.883752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:07:56.883808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquired lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:07:56.883916 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:07:57.386713 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:57.555688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:57.714861 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:07:57.806939 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:57.807134 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:57.807276 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:57.807425 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:07:57.807668 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] No VIF found with MAC fa:16:3e:c5:19:0c, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:07:57.870655 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating instance_info_cache with network_info: [{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:07:57.921496 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004902770001535828 future=<Future at 0x71a75c2e15e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:57.922570 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Emitting event <LifecycleEvent: 1779977262.9208536, 409cb876-fbae-4f7d-8e80-544174cb94b6 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:07:57.922711 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:07:57.922884 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] VM Stopped (Lifecycle Event)
May 28 14:07:58.372998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Releasing lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:07:58.427430 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 409cb876-fbae-4f7d-8e80-544174cb94b6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:07:59.046707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:59.046920 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:07:59.229510 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:59.360412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e5a9abd9-c18a-4f0d-ae4f-e4cca47cc2b2 tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.565s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:07:59.497967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:59.549518 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:07:59.887235 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Starting migrate_disk_and_power_off {{(pid=98269) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 14:07:59.912829 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:59.915896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:59.940315 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:07:59.952149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:07:59.952342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:00.106977 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.113745 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.118608 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:00.118807 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:00.124465 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:08:00.124829 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Claim successful on node np0000001643
May 28 14:08:00.206000 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.214197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.231369 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999688289000005 future=<Future at 0x71a7801f6a50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:00.231608 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99939805599979 future=<Future at 0x71a7801f6a50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:00.233282 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997717225999622 future=<Future at 0x71a7801f6a50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:00.235138 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance destroyed successfully.
May 28 14:08:00.236574 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-739018894',display_name='tempest-ServerActionsTestOtherA-server-739018894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-739018894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:07:46Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-2neos4o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=06adb11e-c76e-438b-ae08-682156eb6255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:08:00.236868 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:00.237703 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:00.237984 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:08:00.242485 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.242485 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aa9a613-a7, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:00.243878 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.246805 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:00.247605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.247827 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea03a0fb-18a8-4369-82bb-421c2f212e5b) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:00.248411 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.249117 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:00.249374 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:00.251988 np0000001643 nova-compute[98269]: INFO os_vif [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7')
May 28 14:08:00.254306 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:08:00.254306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:00.254306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:00.254764 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:00.255129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:08:00.255269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:00.286477 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:00.287030 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '70')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:08:00.287030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '65')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:00.287898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '66')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:00.290170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c767060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:08:00.290426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:08:00.290676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flush multipath device 330000000bc8d01a1 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:08:00.354989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:00.402151 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:00.452394 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:08:00.452585 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:08:00.454136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:08:00.457896 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Detaching volume c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8
May 28 14:08:00.466170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:08:00.466428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:08:00.481557 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:00.517266 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attempting to driver detach volume c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 from mountpoint /dev/vdb
May 28 14:08:00.523003 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found disk vdb by alias ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:08:00.523802 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found disk vdb by alias ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:08:00.523971 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Attempting to detach device vdb from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:08:00.524339 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:08:00.524339 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:08:00.524339 np0000001643 nova-compute[98269]:   <alias name="ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8"/>
May 28 14:08:00.524339 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-12"/>
May 28 14:08:00.524339 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:08:00.524339 np0000001643 nova-compute[98269]:   <serial>c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8</serial>
May 28 14:08:00.524339 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:08:00.524339 np0000001643 nova-compute[98269]: </disk>
May 28 14:08:00.524339 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:08:00.528061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260]
May 28 14:08:00.528061 np0000001643 nova-compute[98269]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260] successful.
May 28 14:08:00.528061 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:00.533314 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully detached device vdb from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the persistent domain config.
May 28 14:08:00.533671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] (1/8): Attempting to detach device vdb with device alias ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:08:00.533874 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:08:00.533874 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:08:00.533874 np0000001643 nova-compute[98269]:   <alias name="ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8"/>
May 28 14:08:00.533874 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-12"/>
May 28 14:08:00.533874 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:08:00.533874 np0000001643 nova-compute[98269]:   <serial>c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8</serial>
May 28 14:08:00.533874 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:08:00.533874 np0000001643 nova-compute[98269]: </disk>
May 28 14:08:00.533874 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:08:00.550203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:00.564870 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:00.601833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260]
May 28 14:08:00.601833 np0000001643 nova-compute[98269]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260] successful.
May 28 14:08:00.601833 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:00.620880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:00.621178 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:00.621329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== disconnect_volume: return (366ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:00.621485 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:08:00.624295 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:08:00.624742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255_resize/disk.config /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:00.673478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "cp -r /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255_resize/disk.config /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config" returned: 0 in 0.048s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:01.151139 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977281.1506526, 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b => ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:08:01.153523 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 for instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:08:01.156220 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully detached device vdb from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the live domain config.
May 28 14:08:01.160432 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:08:01.160432 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:01.160432 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:01.161824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:01.162518 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:08:01.164202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8 (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:01.193489 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:01.193489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '70')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:08:01.194269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '68')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:01.194598 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8', '67')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:01.195328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c3c4720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:08:01.195583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:08:01.195949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flush multipath device 3300000007873a100 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:08:01.210577 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:01.229925 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:01.282075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:01.334040 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:08:01.334228 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:08:01.335408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:08:01.349199 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:08:01.349469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:08:01.366102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:01.405339 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.40.100,3260]
May 28 14:08:01.405339 np0000001643 nova-compute[98269]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.40.100,3260] successful.
May 28 14:08:01.405339 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:01.422508 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:01.433885 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:01.470289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.50.100,3260]
May 28 14:08:01.470289 np0000001643 nova-compute[98269]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-c8e35f9b-fa7c-47af-8e4e-415ad5b5fbb8, portal: 192.168.50.100,3260] successful.
May 28 14:08:01.470289 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:01.488138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:01.488399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:01.488605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== disconnect_volume: return (327ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:01.488793 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:08:01.699907 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:01.700374 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:01.830439 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:01.831398 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:01.945206 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Port 1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c binding to destination host np0000001643 is already ACTIVE {{(pid=98269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 14:08:02.044021 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:02.140234 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8aa99b9c-8e84-4d72-b89f-d1bf82a85d1e req-047e8204-3c69-4b71-9510-9f9bec3b3618 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:02.141194 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8aa99b9c-8e84-4d72-b89f-d1bf82a85d1e req-047e8204-3c69-4b71-9510-9f9bec3b3618 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:02.141401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8aa99b9c-8e84-4d72-b89f-d1bf82a85d1e req-047e8204-3c69-4b71-9510-9f9bec3b3618 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:02.141592 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8aa99b9c-8e84-4d72-b89f-d1bf82a85d1e req-047e8204-3c69-4b71-9510-9f9bec3b3618 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:02.141784 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8aa99b9c-8e84-4d72-b89f-d1bf82a85d1e req-047e8204-3c69-4b71-9510-9f9bec3b3618 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] No waiting events found dispatching network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:02.141964 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8aa99b9c-8e84-4d72-b89f-d1bf82a85d1e req-047e8204-3c69-4b71-9510-9f9bec3b3618 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received unexpected event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c for instance with vm_state active and task_state resize_migrating.
May 28 14:08:02.203668 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:02.694879 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:02.711738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.593s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:02.712224 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:08:02.953669 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:08:02.963476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:02.963999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:02.963999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:03.050097 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b42bcc82-7209-4bbc-8773-501f1bdcd36f tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.098s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:03.218504 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:08:03.218687 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:08:03.219443 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:03.219443 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:03.304425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:03.304751 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:03.366255 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fa84ba4c848478ebc210aed12edd83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6508d9982d4947a5e5ec3f5c04580c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:08:03.721865 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:08:03.808776 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Detaching volume b162555f-3e97-45c3-be2f-d6436d05eead
May 28 14:08:03.852763 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Attempting to driver detach volume b162555f-3e97-45c3-be2f-d6436d05eead from mountpoint /dev/vdc
May 28 14:08:03.859235 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found disk vdc by alias ua-b162555f-3e97-45c3-be2f-d6436d05eead {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:08:03.861989 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Found disk vdc by alias ua-b162555f-3e97-45c3-be2f-d6436d05eead {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:08:03.862483 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Attempting to detach device vdc from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:08:03.862681 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:08:03.862681 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:08:03.862681 np0000001643 nova-compute[98269]:   <alias name="ua-b162555f-3e97-45c3-be2f-d6436d05eead"/>
May 28 14:08:03.862681 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-6"/>
May 28 14:08:03.862681 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:08:03.862681 np0000001643 nova-compute[98269]:   <serial>b162555f-3e97-45c3-be2f-d6436d05eead</serial>
May 28 14:08:03.862681 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:08:03.862681 np0000001643 nova-compute[98269]: </disk>
May 28 14:08:03.862681 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:08:03.874484 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully detached device vdc from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the persistent domain config.
May 28 14:08:03.874484 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] (1/8): Attempting to detach device vdc with device alias ua-b162555f-3e97-45c3-be2f-d6436d05eead from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:08:03.874484 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:08:03.874484 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:08:03.874484 np0000001643 nova-compute[98269]:   <alias name="ua-b162555f-3e97-45c3-be2f-d6436d05eead"/>
May 28 14:08:03.874484 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-6"/>
May 28 14:08:03.874484 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:08:03.874484 np0000001643 nova-compute[98269]:   <serial>b162555f-3e97-45c3-be2f-d6436d05eead</serial>
May 28 14:08:03.874484 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:08:03.874484 np0000001643 nova-compute[98269]: </disk>
May 28 14:08:03.874484 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:08:03.900356 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Successfully created port: e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:08:03.973188 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:04.064819 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:04.207059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:04.207059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquired lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:04.207193 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:08:04.226434 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:08:04.237017 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a265d55d-e8a3-45c8-aecb-2ca93ff667ec req-65cb5926-31f7-4365-bf07-c2ee5f780e20 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:04.237218 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a265d55d-e8a3-45c8-aecb-2ca93ff667ec req-65cb5926-31f7-4365-bf07-c2ee5f780e20 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:04.237387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a265d55d-e8a3-45c8-aecb-2ca93ff667ec req-65cb5926-31f7-4365-bf07-c2ee5f780e20 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:04.237758 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a265d55d-e8a3-45c8-aecb-2ca93ff667ec req-65cb5926-31f7-4365-bf07-c2ee5f780e20 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:04.240105 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a265d55d-e8a3-45c8-aecb-2ca93ff667ec req-65cb5926-31f7-4365-bf07-c2ee5f780e20 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] No waiting events found dispatching network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:04.240105 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a265d55d-e8a3-45c8-aecb-2ca93ff667ec req-65cb5926-31f7-4365-bf07-c2ee5f780e20 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received unexpected event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c for instance with vm_state active and task_state resize_migrated.
May 28 14:08:04.420151 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977284.419745, 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b => ua-b162555f-3e97-45c3-be2f-d6436d05eead> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:08:04.423558 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-b162555f-3e97-45c3-be2f-d6436d05eead for instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:08:04.426263 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully detached device vdc from instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b from the live domain config.
May 28 14:08:04.427515 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:08:04.427846 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b162555f-3e97-45c3-be2f-d6436d05eead', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:04.428004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:04.428508 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:04.428936 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b162555f-3e97-45c3-be2f-d6436d05eead', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:08:04.429099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:08:04.458173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:04.458173 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:04.458173 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:04.458173 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:04.458173 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:04.458173 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:04.458173 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead (non-flash)
May 28 14:08:04.458568 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '70')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:08:04.458568 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '70')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:04.459770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead', '69')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:04.460952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780dced40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead'): ({'sdj'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:08:04.461489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Removing multipathed devices sdj, sdk {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:08:04.461489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Flush multipath device 3300000006f3240d6 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:08:04.495270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:04.500255 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:04.554040 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:04.596103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:08:04.596191 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:08:04.597614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:08:04.614726 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:08:04.614971 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:08:04.628190 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:04.660867 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.40.100,3260]
May 28 14:08:04.660867 np0000001643 nova-compute[98269]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.40.100,3260] successful.
May 28 14:08:04.660867 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:04.681921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:04.697006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:04.710837 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:04.745867 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:04.748172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.50.100,3260]
May 28 14:08:04.748172 np0000001643 nova-compute[98269]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-b162555f-3e97-45c3-be2f-d6436d05eead, portal: 192.168.50.100,3260] successful.
May 28 14:08:04.748172 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:04.766707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:04.767167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:04.767167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] <== disconnect_volume: return (339ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:04.767167 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:08:05.209239 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Successfully updated port: e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:08:05.245636 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:08:05.246747 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:08:05.247012 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Creating image(s)
May 28 14:08:05.247755 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:05.247999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "/opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:05.248591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "/opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:05.249066 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:05.249787 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:05.253268 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:05.255001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:05.288291 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-changed-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:05.289098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Refreshing instance network info cache due to event network-changed-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:08:05.289098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] Acquiring lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:05.289098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] Acquired lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:05.289379 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Refreshing network info cache for port e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:08:05.343361 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'flavor' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:05.361258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:05.361850 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:05.362687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:05.363473 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:05.366276 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:05.366820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:05.478707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:05.478707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:05.541818 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk 1073741824" returned: 0 in 0.063s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:05.543001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:05.543416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:05.639931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:05.640285 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:08:05.640501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:05.662617 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:05.711614 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:05.739472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:05.739931 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Cannot resize image /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:08:05.740375 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:08:05.740988 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Ensure instance console log exists: /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:08:05.741231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:05.741530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:05.741838 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:05.794005 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:05.860846 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:08:05.941843 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating instance_info_cache with network_info: [{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:06.006880 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:06.156299 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:06.350784 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-14f56df8-43db-4bb2-98b4-a967efcf57fc tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.046s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:06.446175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Releasing lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:06.659651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-41ce700c-27a5-4127-a392-c4e484b2f5e1 req-93c33dcc-cb1b-4039-8fad-0bea13f12684 service nova] Releasing lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:06.660488 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquired lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:06.660673 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:08:06.837353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:06.837869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:06.837869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:06.837869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:06.838008 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:06.840991 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Terminating instance
May 28 14:08:06.955367 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:06.965765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:08:06.994544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:07.058124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:08:07.058582 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:08:07.070045 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:08:07.071546 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fec5:190c', 'fe80::a4ab:75ff:fe88:234a', 'fe80::fc16:3eff:fead:d3ed'] 
May 28 14:08:07.071668 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:08:07.071809 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:08:07.072130 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:07.234683 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:08:07.347127 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:08:07.374671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.385550 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.403908 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.426024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.460020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.468972 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:07.647675 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1dc57b83-8784-4cad-b9cc-ccc485e938f3 req-a844c38d-f287-4d09-8faa-af54f7d71593 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:07.649211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1dc57b83-8784-4cad-b9cc-ccc485e938f3 req-a844c38d-f287-4d09-8faa-af54f7d71593 service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:07.649211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1dc57b83-8784-4cad-b9cc-ccc485e938f3 req-a844c38d-f287-4d09-8faa-af54f7d71593 service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:07.649211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1dc57b83-8784-4cad-b9cc-ccc485e938f3 req-a844c38d-f287-4d09-8faa-af54f7d71593 service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:07.649211 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1dc57b83-8784-4cad-b9cc-ccc485e938f3 req-a844c38d-f287-4d09-8faa-af54f7d71593 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] No waiting events found dispatching network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:07.649211 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1dc57b83-8784-4cad-b9cc-ccc485e938f3 req-a844c38d-f287-4d09-8faa-af54f7d71593 service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:07.711304 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.747378 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.756809 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.757216 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Instance destroyed successfully.
May 28 14:08:07.758414 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lazy-loading 'resources' on Instance uuid 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:07.762349 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.996864773999732 future=<Future at 0x71a75c362570 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:07.782319 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:07.809471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:07.809728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:07.862219 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Updating instance_info_cache with network_info: [{"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:07.873876 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a97fcd60-ce18-443d-ae33-5bdd014effbd req-8828a102-bd9a-4ab9-908e-cd67bdbea581 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:07.873876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a97fcd60-ce18-443d-ae33-5bdd014effbd req-8828a102-bd9a-4ab9-908e-cd67bdbea581 service nova] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:07.873876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a97fcd60-ce18-443d-ae33-5bdd014effbd req-8828a102-bd9a-4ab9-908e-cd67bdbea581 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:07.873876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a97fcd60-ce18-443d-ae33-5bdd014effbd req-8828a102-bd9a-4ab9-908e-cd67bdbea581 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:07.873876 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a97fcd60-ce18-443d-ae33-5bdd014effbd req-8828a102-bd9a-4ab9-908e-cd67bdbea581 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] No waiting events found dispatching network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:07.873876 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a97fcd60-ce18-443d-ae33-5bdd014effbd req-8828a102-bd9a-4ab9-908e-cd67bdbea581 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received unexpected event network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe for instance with vm_state building and task_state spawning.
May 28 14:08:08.151785 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.164959 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.195605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.204536 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.267712 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303708888',display_name='tempest-AttachVolumeTestJSON-server-303708888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumetestjson-server-303708888',id=33,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdXeZQJwDcBhqVR4EvXDIYIPC+YhZ/W51yfwDk2PM42wFFcfi7mDOYmmiRYxgcfVE214iy53MBq6VjEc4XyZ6zLXgKU3yLqqH8dnvuvGVmyAtKMq2TWUqYRPRqjrHsxQ==',key_name='tempest-keypair-737057592',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:54Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='706c08c92c6844b3ab7b4019269eabad',ramdisk_id='',reservation_id='r-ttb5c0l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1658324310',owner_user_name='tempest-AttachVolumeTestJSON-1658324310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ab771f08c245c7a7dffca595835dba',uuid=7c25a8ba-cc94-4ac1-be8f-f7e32850f46b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:08:08.268073 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converting VIF {"id": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "address": "fa:16:3e:c5:19:0c", "network": {"id": "9bba96c3-3c9e-4f69-a2e9-5c78555edbc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1075713995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "706c08c92c6844b3ab7b4019269eabad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbffca20-9c", "ovs_interfaceid": "cbffca20-9c6b-41fc-85fa-7eac464a7c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:08.268819 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:19:0c,bridge_name='br-int',has_traffic_filtering=True,id=cbffca20-9c6b-41fc-85fa-7eac464a7c06,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbffca20-9c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:08.269875 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:19:0c,bridge_name='br-int',has_traffic_filtering=True,id=cbffca20-9c6b-41fc-85fa-7eac464a7c06,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbffca20-9c') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:08:08.271417 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.271717 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbffca20-9c, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:08.273983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.273983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:08.275841 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Starting finish_migration {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 14:08:08.276975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.277662 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:08:08.278311 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.278506 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Creating image(s)
May 28 14:08:08.278901 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:08:08.279269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f4a364b-ba08-4f71-8722-e9df70da43c0) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:08.280172 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Ensure instance console log exists: /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:08:08.281423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:08.281423 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:08.281553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:08.281698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:08.282465 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Start _get_guest_xml network_info=[{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '2d990cc0-91d2-4a5f-b626-72665283a130', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '06adb11e-c76e-438b-ae08-682156eb6255', 'attached_at': '2026-05-28T14:08:07.000000', 'detached_at': '', 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'serial': '716e1389-8ad8-432e-bf18-b9d6eabb97e4'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:08:08.283141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.285783 np0000001643 nova-compute[98269]: INFO os_vif [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:19:0c,bridge_name='br-int',has_traffic_filtering=True,id=cbffca20-9c6b-41fc-85fa-7eac464a7c06,network=Network(9bba96c3-3c9e-4f69-a2e9-5c78555edbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbffca20-9c')
May 28 14:08:08.286382 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Deleting instance files /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b_del
May 28 14:08:08.287252 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:08:08.288408 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-739018894', uuid='06adb11e-c76e-438b-ae08-682156eb6255'), owner=OwnerMeta(userid='357253ac91f34daeb60ae1dfd3e4a86f', username='tempest-ServerActionsTestOtherA-354716614-project-member', projectid='6a74849f3fb24097a5a42457746f02d2', projectname='tempest-ServerActionsTestOtherA-354716614'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977288.28806) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:08:08.289421 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Deletion of /opt/stack/data/nova/instances/7c25a8ba-cc94-4ac1-be8f-f7e32850f46b_del complete
May 28 14:08:08.291784 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:08:08.292522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:08:08.293696 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:08:08.294577 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:08:08.295477 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:08:08.295939 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:08:08.296127 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:08:08.296257 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:08:08.296437 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:08:08.296601 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:08:08.296778 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:08:08.296981 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:08:08.297137 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:08:08.297301 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:08:08.304651 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:08:08.304651 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:08:08.307362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.313633 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:08:08.320896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:08.339563 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.372191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Releasing lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:08.373541 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Instance network_info: |[{"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:08:08.377287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Start _get_guest_xml network_info=[{"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:08:08.384946 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:08:08.386351 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225', uuid='3f2b70b6-0378-4920-b040-12ac657d6ca5'), owner=OwnerMeta(userid='6fa84ba4c848478ebc210aed12edd83f', username='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member', projectid='0e6508d9982d4947a5e5ec3f5c04580c', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977288.3859441) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:08:08.387571 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:08:08.387943 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:08:08.388981 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:08:08.389221 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:08:08.390026 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:08:08.390320 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:08:08.390506 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:08:08.390553 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:08:08.390694 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:08:08.390761 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:08:08.390852 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:08:08.391126 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:08:08.391126 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:08:08.391363 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:08:08.391527 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:08:08.391656 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:08:08.402670 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testservervolumeattachscenariooldversion-server-1682159',id=35,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJVLiSohUhwiXqYkEOtEEf3c/LnHoK725ydBJrynWKvR15yEmPJgvA6oWwp3mEpPEvFfnxz5vbepsP2GhxfPUrN8H3Z1UpxYW5wwS2fHxX2r+VHx8Ts2T8t5jXHE3ktHw==',key_name='tempest-keypair-1102347540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e6508d9982d4947a5e5ec3f5c04580c',ramdisk_id='',reservation_id='r-avwzg5p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fa84ba4c848478ebc210aed12edd83f',uuid=3f2b70b6-0378-4920-b040-12ac657d6ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:08:08.402887 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Converting VIF {"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:08.403329 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:6b:45,bridge_name='br-int',has_traffic_filtering=True,id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe,network=Network(4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b89c9c-68') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:08.404271 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f2b70b6-0378-4920-b040-12ac657d6ca5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:08.424895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:08.425719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "/opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:08.425719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:08.426434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "/opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:08.426718 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:08:08.427181 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:08.427529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:08.427766 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:08.427905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:08:08.443329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:08.444017 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:08.444268 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:08:08.444817 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:08.447338 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:08.447338 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:08:08.458931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:08:08.458931 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:08.464993 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:08:08.464993 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:08.471881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4] added
May 28 14:08:08.471881 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:08:08.471881 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:08.471881 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:08.471881 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:08.471881 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:08.471881 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:08.472263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:08:08.472335 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:08:08.472525 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:08:08.478061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4] added
May 28 14:08:08.478061 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:08:08.478061 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:08.478061 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:08.478061 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:08.478061 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:08.478061 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:08.478419 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:08:08.478419 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:08:08.478640 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:08:08.797185 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 14:08:08.798084 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:08:08.798432 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:08:08.798550 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:08:08.798900 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:08.868419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:08.868806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:08.871544 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:08:08.871715 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Claim successful on node np0000001643
May 28 14:08:08.876174 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:08.907702 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] End _get_guest_xml xml=<domain type="qemu">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <uuid>3f2b70b6-0378-4920-b040-12ac657d6ca5</uuid>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <name>instance-00000023</name>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225</nova:name>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:08:08</nova:creationTime>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:user uuid="6fa84ba4c848478ebc210aed12edd83f">tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member</nova:user>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:project uuid="0e6508d9982d4947a5e5ec3f5c04580c">tempest-TestServerVolumeAttachScenarioOldVersion-2004318273</nova:project>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         <nova:port uuid="e8b89c9c-681a-4b69-aa59-d76d57ac6ffe">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <system>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <entry name="serial">3f2b70b6-0378-4920-b040-12ac657d6ca5</entry>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <entry name="uuid">3f2b70b6-0378-4920-b040-12ac657d6ca5</entry>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </system>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <os>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   </os>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <features>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   </features>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   <devices>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk.config"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:28:6b:45"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <target dev="tape8b89c9c-68"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </interface>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/console.log" append="off"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </serial>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <video>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </video>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </rng>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:   </devices>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]: </domain>
May 28 14:08:08.907702 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:08:08.909670 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Preparing to wait for external event network-vif-plugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:08:08.909670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:08.909670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:08.909670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:08.909670 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testservervolumeattachscenariooldversion-server-1682159',id=35,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJVLiSohUhwiXqYkEOtEEf3c/LnHoK725ydBJrynWKvR15yEmPJgvA6oWwp3mEpPEvFfnxz5vbepsP2GhxfPUrN8H3Z1UpxYW5wwS2fHxX2r+VHx8Ts2T8t5jXHE3ktHw==',key_name='tempest-keypair-1102347540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e6508d9982d4947a5e5ec3f5c04580c',ramdisk_id='',reservation_id='r-avwzg5p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fa84ba4c848478ebc210aed12edd83f',uuid=3f2b70b6-0378-4920-b040-12ac657d6ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:08:08.909670 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Converting VIF {"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:08.910312 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:6b:45,bridge_name='br-int',has_traffic_filtering=True,id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe,network=Network(4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b89c9c-68') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:08.910687 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6b:45,bridge_name='br-int',has_traffic_filtering=True,id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe,network=Network(4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b89c9c-68') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:08:08.911066 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.911213 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:08.911441 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:08:08.913221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.913356 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bcc089f-c144-5446-a206-445006a5bb1f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:08.915065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.915065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:08.916998 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.917174 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b89c9c-68, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:08.917499 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8b89c9c-68, col_values=(('qos', UUID('1ae912cb-3527-4299-943e-042eae68111c')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:08.917666 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8b89c9c-68, col_values=(('external_ids', {'iface-id': 'e8b89c9c-681a-4b69-aa59-d76d57ac6ffe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:6b:45', 'vm-uuid': '3f2b70b6-0378-4920-b040-12ac657d6ca5'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:08.918325 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.919331 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:08.924830 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:08.925643 np0000001643 nova-compute[98269]: INFO os_vif [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:6b:45,bridge_name='br-int',has_traffic_filtering=True,id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe,network=Network(4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b89c9c-68')
May 28 14:08:09.473025 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:08:09.481876 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:08:09.487415 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:08:09.487415 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:08:09.496283 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:08:09.496283 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.502581 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:09.508004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.512457 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.521582 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.521582 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.521582 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.521582 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.521582 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:09.521912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.521912 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.521912 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.521912 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.521912 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:09.526285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.526285 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.526285 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.526285 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.526285 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:09.526483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.526483 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.526483 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.526483 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.526483 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:09.553878 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260]
May 28 14:08:09.553878 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260] successful.
May 28 14:08:09.553878 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.564174 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.576476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260]
May 28 14:08:09.576476 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260] successful.
May 28 14:08:09.576476 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.582463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.582463 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.582463 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.582463 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.582463 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.582463 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.582463 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:09.582739 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.582739 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.582739 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.582739 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.582739 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.582739 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.582739 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:09.582852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:09.582951 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:08:09.583707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('7', '-', '-', 0) found on session 71 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:08:09.584137 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:08:09.589921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:09.602682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 71 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:08:09.602682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:08:09.607342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.607342 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.607342 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.607342 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.607342 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.607342 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.607342 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:09.607688 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.607688 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:09.607688 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.607688 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:09.607688 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.607688 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:09.607688 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:09.607972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:09.607972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:08:09.608538 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] HCTL ('8', '-', '-', 0) found on session 72 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:08:09.608628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:08:09.626037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Searching for a device in session 72 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:08:09.626037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:08:09.716366 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:09.716831 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:09.716831 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:09.718196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:09.718196 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] No waiting events found dispatching network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:09.718196 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:09.718196 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:09.718682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:09.718862 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:09.719049 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:09.719242 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] No waiting events found dispatching network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:09.719428 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received unexpected event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 for instance with vm_state active and task_state deleting.
May 28 14:08:09.719598 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:09.719922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:09.720230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:09.720414 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:09.721031 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] No waiting events found dispatching network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:09.721223 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received unexpected event network-vif-plugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 for instance with vm_state active and task_state deleting.
May 28 14:08:09.721374 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:09.721623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:09.721850 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:09.722204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:09.722491 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] No waiting events found dispatching network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:09.722701 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:09.722950 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:09.723150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Acquiring lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:09.723289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:09.723436 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:09.723625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] No waiting events found dispatching network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:09.723769 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-unplugged-cbffca20-9c6b-41fc-85fa-7eac464a7c06 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:09.723922 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Received event network-vif-deleted-cbffca20-9c6b-41fc-85fa-7eac464a7c06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:09.724089 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Neutron deleted interface cbffca20-9c6b-41fc-85fa-7eac464a7c06; detaching it from the instance and deleting it from the info cache
May 28 14:08:09.730426 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-809648bb-cdc5-4765-bccf-e0e8931738e9 req-f30178c3-df28-450d-b4c7-866a396e3b3d service nova] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Detach interface failed, port_id=cbffca20-9c6b-41fc-85fa-7eac464a7c06, reason: Instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:08:09.796631 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:10.301639 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Took 1.50 seconds to deallocate network for instance.
May 28 14:08:10.407703 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:10.407947 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:10.446468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:08:10.447051 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:10.447237 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:10.447372 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] No VIF found with MAC fa:16:3e:28:6b:45, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:08:10.447870 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Using config drive
May 28 14:08:10.807299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:10.910943 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:10.953747 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:11.078417 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Creating config drive at /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk.config
May 28 14:08:11.082951 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo692iuoz {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:11.143651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo692iuoz" returned: 0 in 0.060s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:11.418559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.550s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:11.419427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.612s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:11.419711 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:08:11.463528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Found WWN 330000000bc8d01a1 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:08:11.463761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:11.463976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000bc8d01a1', 'path': '/dev/dm-0', 'multipath_id': '330000000bc8d01a1'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:11.464186 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bc8d01a1', 'path': '/dev/dm-0', 'multipath_id': '330000000bc8d01a1'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:08:11.586689 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.616159 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.692541 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.932265 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:08:11.932495 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:08:11.935235 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:11.935235 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:11.948761 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.955364 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.970513 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-739018894',display_name='tempest-ServerActionsTestOtherA-server-739018894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-739018894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:07:46Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-2neos4o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=06adb11e-c76e-438b-ae08-682156eb6255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:08:11.970727 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:11.971386 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:11.973197 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] End _get_guest_xml xml=<domain type="qemu">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <uuid>06adb11e-c76e-438b-ae08-682156eb6255</uuid>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <name>instance-00000022</name>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <memory>262144</memory>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsTestOtherA-server-739018894</nova:name>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:08:08</nova:creationTime>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.micro" id="84">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:memory>256</nova:memory>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:user uuid="357253ac91f34daeb60ae1dfd3e4a86f">tempest-ServerActionsTestOtherA-354716614-project-member</nova:user>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:project uuid="6a74849f3fb24097a5a42457746f02d2">tempest-ServerActionsTestOtherA-354716614</nova:project>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         <nova:port uuid="1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <system>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <entry name="serial">06adb11e-c76e-438b-ae08-682156eb6255</entry>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <entry name="uuid">06adb11e-c76e-438b-ae08-682156eb6255</entry>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </system>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <os>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   </os>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <features>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   </features>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   <devices>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/disk.config"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <alias name="ua-716e1389-8ad8-432e-bf18-b9d6eabb97e4"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <serial>716e1389-8ad8-432e-bf18-b9d6eabb97e4</serial>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:4e:07:8b"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <target dev="tap1aa9a613-a7"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </interface>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255/console.log" append="off"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </serial>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <video>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </video>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </rng>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:   </devices>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]: </domain>
May 28 14:08:11.973197 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:08:11.976691 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-739018894',display_name='tempest-ServerActionsTestOtherA-server-739018894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-739018894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:07:46Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-2neos4o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=06adb11e-c76e-438b-ae08-682156eb6255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:08:11.976691 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1052260659-network", "vif_mac": "fa:16:3e:4e:07:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:11.976691 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:11.976691 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:08:11.976691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.976691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:11.976691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:08:11.977311 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.977368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c479fc93-b004-52b2-b0a6-e49ad7249f64', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:11.978053 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.978766 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:11.980499 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.980703 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aa9a613-a7, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:11.981859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aa9a613-a7, col_values=(('qos', UUID('03ccf8cb-82fa-4456-917f-666f6a2ede26')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:11.981859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aa9a613-a7, col_values=(('external_ids', {'iface-id': '1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:07:8b', 'vm-uuid': '06adb11e-c76e-438b-ae08-682156eb6255'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:11.981961 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.983059 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:11.987414 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:11.988421 np0000001643 nova-compute[98269]: INFO os_vif [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7')
May 28 14:08:12.017722 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2970f4b582e4859a97a6d44af82915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dbb1d4f2104a6e9881dcedc07b1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:08:12.072378 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:12.072609 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:12.367466 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977292.3670852, 3f2b70b6-0378-4920-b040-12ac657d6ca5 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:12.367711 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] VM Started (Lifecycle Event)
May 28 14:08:12.433414 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:08:12.444912 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Successfully created port: fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:08:12.525656 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Stashing vm_state: active {{(pid=98269) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 14:08:12.575047 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:12.870058 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:12.871652 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977292.8714328, 3f2b70b6-0378-4920-b040-12ac657d6ca5 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:12.871772 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] VM Paused (Lifecycle Event)
May 28 14:08:12.936231 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:08:13.078255 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:13.083719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.665s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:13.086706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.009s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:13.133924 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Deleted allocations for instance 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b
May 28 14:08:13.374152 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:13.376958 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:13.419412 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Successfully updated port: fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:08:13.474609 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-changed-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:13.475172 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Refreshing instance network info cache due to event network-changed-fb5649ab-2e53-4c23-aa12-399f3bd1149c. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:08:13.476360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] Acquiring lock "refresh_cache-557d0595-bf4f-44be-a706-20f24bdf2bbe" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:13.476588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] Acquired lock "refresh_cache-557d0595-bf4f-44be-a706-20f24bdf2bbe" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:13.476757 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Refreshing network info cache for port fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:08:13.510425 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:13.510603 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:13.510603 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] No VIF found with MAC fa:16:3e:4e:07:8b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:08:13.510986 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Using config drive
May 28 14:08:13.593754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:08:13.593904 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Claim successful on node np0000001643
May 28 14:08:13.879690 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:08:13.921536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "refresh_cache-557d0595-bf4f-44be-a706-20f24bdf2bbe" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:13.943886 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:08:13.944911 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:08:13.945176 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Creating image(s)
May 28 14:08:13.945656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "/opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:13.945848 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "/opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:13.946575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "/opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:13.947222 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:13.950638 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:13.951115 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:13.970493 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:13.978874 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:13.982295 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:13.985096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:14.065828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:14.066420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:14.067025 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:14.067590 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:14.074559 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:08:14.077703 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:08:14.078655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:14.094840 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:14.111833 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating resource usage from migration bd83054a-1b87-4731-82f5-c170a6642d2d
May 28 14:08:14.149457 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0c8f8f0e-191c-41c4-a126-28d7e2f19d4c tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Lock "7c25a8ba-cc94-4ac1-be8f-f7e32850f46b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.312s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:14.151149 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:14.151990 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:14.187892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:14.188526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:14.236481 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ceef5a44-689b-4ba3-8879-b57c98f50820 req-ba7b0860-bb47-45c7-916a-79c853e29f68 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:14.237043 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ceef5a44-689b-4ba3-8879-b57c98f50820 req-ba7b0860-bb47-45c7-916a-79c853e29f68 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:14.237473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ceef5a44-689b-4ba3-8879-b57c98f50820 req-ba7b0860-bb47-45c7-916a-79c853e29f68 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:14.237735 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ceef5a44-689b-4ba3-8879-b57c98f50820 req-ba7b0860-bb47-45c7-916a-79c853e29f68 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:14.238091 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ceef5a44-689b-4ba3-8879-b57c98f50820 req-ba7b0860-bb47-45c7-916a-79c853e29f68 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] No waiting events found dispatching network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:14.238770 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ceef5a44-689b-4ba3-8879-b57c98f50820 req-ba7b0860-bb47-45c7-916a-79c853e29f68 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received unexpected event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c for instance with vm_state active and task_state resize_finish.
May 28 14:08:14.276143 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk 1073741824" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:14.276630 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:14.276876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:14.395680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.118s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:14.395680 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:08:14.395680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:14.458875 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:14.504264 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:14.504264 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Cannot resize image /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:08:14.505387 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:08:14.505575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Ensure instance console log exists: /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:08:14.505917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:14.506137 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:14.506286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:14.506539 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:14.790678 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:14.790880 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:14.828861 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:08:14.831085 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 06adb11e-c76e-438b-ae08-682156eb6255 due to new event <LifecycleEvent: 1779977294.829395, 06adb11e-c76e-438b-ae08-682156eb6255 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:08:14.832387 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977294.829395, 06adb11e-c76e-438b-ae08-682156eb6255 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:14.832387 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] VM Resumed (Lifecycle Event)
May 28 14:08:14.833814 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance running successfully.
May 28 14:08:14.834848 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Failed to set time: agent not configured {{(pid=98269) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 14:08:14.834978 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8f046320-3acc-497f-bf07-344b1d045ced tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] finish_migration finished successfully. {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 14:08:14.962045 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d365e206-c09b-4bb0-96e9-6ceca5f3b3c9 req-2d2ef71d-c8e5-4b43-bbfd-ee262ae82993 service nova] Releasing lock "refresh_cache-557d0595-bf4f-44be-a706-20f24bdf2bbe" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:14.963387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquired lock "refresh_cache-557d0595-bf4f-44be-a706-20f24bdf2bbe" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:14.963387 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:08:15.231726 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00046512800008713384 future=<Future at 0x71a7801f6a50 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:15.231899 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:15.231994 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.527177596000001 future=<Future at 0x71a75c362570 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:15.232125 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.527042394999626 future=<Future at 0x71a75c362570 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:15.294029 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:15.338857 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:15.345646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:15.542640 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-plugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:15.543126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:15.543126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:15.543233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:15.543337 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Processing event network-vif-plugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:08:15.543854 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-plugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:15.544042 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:15.544248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:15.544406 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:15.544598 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] No waiting events found dispatching network-vif-plugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:15.544763 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-4084bc77-7ed4-418f-9e44-4c43302d6724 req-aa574d89-ae97-4492-b2fb-9409b600b910 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received unexpected event network-vif-plugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe for instance with vm_state building and task_state spawning.
May 28 14:08:15.547082 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:08:15.552546 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:08:15.556712 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:08:15.559875 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Instance spawned successfully.
May 28 14:08:15.560384 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:08:15.757371 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:15.800311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.713s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:15.800507 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Migrating
May 28 14:08:15.800782 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:08:15.850293 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 14:08:15.850596 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977295.8503706, 06adb11e-c76e-438b-ae08-682156eb6255 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:15.850755 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] VM Started (Lifecycle Event)
May 28 14:08:15.965872 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Updating instance_info_cache with network_info: [{"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:16.069701 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:16.069847 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:16.070226 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:16.070525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:16.070824 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:16.071129 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:16.312391 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8e1d77e3-0c48-4e5a-b578-8da6fdb6bd83 req-9253ba04-3da9-43d4-9f82-b6c282eb3c49 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:16.312677 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8e1d77e3-0c48-4e5a-b578-8da6fdb6bd83 req-9253ba04-3da9-43d4-9f82-b6c282eb3c49 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:16.313382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8e1d77e3-0c48-4e5a-b578-8da6fdb6bd83 req-9253ba04-3da9-43d4-9f82-b6c282eb3c49 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:16.314798 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8e1d77e3-0c48-4e5a-b578-8da6fdb6bd83 req-9253ba04-3da9-43d4-9f82-b6c282eb3c49 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:16.314798 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8e1d77e3-0c48-4e5a-b578-8da6fdb6bd83 req-9253ba04-3da9-43d4-9f82-b6c282eb3c49 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] No waiting events found dispatching network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:16.314798 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8e1d77e3-0c48-4e5a-b578-8da6fdb6bd83 req-9253ba04-3da9-43d4-9f82-b6c282eb3c49 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received unexpected event network-vif-plugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c for instance with vm_state resized and task_state None.
May 28 14:08:16.332624 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:16.332735 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:16.333995 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:08:16.353780 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:16.356931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:16.468898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Releasing lock "refresh_cache-557d0595-bf4f-44be-a706-20f24bdf2bbe" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:16.469286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Instance network_info: |[{"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:08:16.471198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Start _get_guest_xml network_info=[{"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:08:16.478208 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:08:16.479888 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-931901849', uuid='557d0595-bf4f-44be-a706-20f24bdf2bbe'), owner=OwnerMeta(userid='f2970f4b582e4859a97a6d44af82915a', username='tempest-VolumesActionsTest-1085038326-project-member', projectid='53dbb1d4f2104a6e9881dcedc07b1763', projectname='tempest-VolumesActionsTest-1085038326'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977296.479364) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:08:16.481465 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:08:16.481895 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:08:16.484868 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:08:16.485057 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:08:16.486196 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:08:16.486653 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:08:16.486852 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:08:16.486983 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:08:16.487145 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:08:16.487276 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:08:16.487335 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:08:16.487625 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:08:16.487765 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:08:16.487891 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:08:16.488013 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:08:16.488293 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:08:16.503671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:08:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-931901849',display_name='tempest-VolumesActionsTest-instance-931901849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-931901849',id=36,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53dbb1d4f2104a6e9881dcedc07b1763',ramdisk_id='',reservation_id='r-64kggutk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1085038326',owner_user_name='tempest-VolumesActionsTest-1085038326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:13Z,user_data=None,user_id='f2970f4b582e4859a97a6d44af82915a',uuid=557d0595-bf4f-44be-a706-20f24bdf2bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:08:16.503928 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Converting VIF {"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:16.504655 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:3c,bridge_name='br-int',has_traffic_filtering=True,id=fb5649ab-2e53-4c23-aa12-399f3bd1149c,network=Network(82b4c21b-07e9-4732-a3f2-8f2a9def2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5649ab-2e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:16.505770 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lazy-loading 'pci_devices' on Instance uuid 557d0595-bf4f-44be-a706-20f24bdf2bbe {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:16.576856 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Took 11.33 seconds to spawn the instance on the hypervisor.
May 28 14:08:16.577393 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:16.764000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:16.764303 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:16.764521 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Going to confirm migration 3 {{(pid=98269) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 14:08:16.836383 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:16.860082 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977296.8585467, 3f2b70b6-0378-4920-b040-12ac657d6ca5 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:16.860082 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] VM Resumed (Lifecycle Event)
May 28 14:08:16.984096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.008922 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] End _get_guest_xml xml=<domain type="qemu">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <uuid>557d0595-bf4f-44be-a706-20f24bdf2bbe</uuid>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <name>instance-00000024</name>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesActionsTest-instance-931901849</nova:name>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:08:16</nova:creationTime>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:user uuid="f2970f4b582e4859a97a6d44af82915a">tempest-VolumesActionsTest-1085038326-project-member</nova:user>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:project uuid="53dbb1d4f2104a6e9881dcedc07b1763">tempest-VolumesActionsTest-1085038326</nova:project>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         <nova:port uuid="fb5649ab-2e53-4c23-aa12-399f3bd1149c">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <system>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <entry name="serial">557d0595-bf4f-44be-a706-20f24bdf2bbe</entry>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <entry name="uuid">557d0595-bf4f-44be-a706-20f24bdf2bbe</entry>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </system>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <os>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   </os>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <features>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   </features>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   <devices>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk.config"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:5d:c1:3c"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <target dev="tapfb5649ab-2e"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </interface>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/console.log" append="off"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </serial>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <video>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </video>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </rng>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:   </devices>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]: </domain>
May 28 14:08:17.008922 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Preparing to wait for external event network-vif-plugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:08:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-931901849',display_name='tempest-VolumesActionsTest-instance-931901849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-931901849',id=36,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53dbb1d4f2104a6e9881dcedc07b1763',ramdisk_id='',reservation_id='r-64kggutk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1085038326',owner_user_name='tempest-VolumesActionsTest-1085038326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:13Z,user_data=None,user_id='f2970f4b582e4859a97a6d44af82915a',uuid=557d0595-bf4f-44be-a706-20f24bdf2bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Converting VIF {"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:3c,bridge_name='br-int',has_traffic_filtering=True,id=fb5649ab-2e53-4c23-aa12-399f3bd1149c,network=Network(82b4c21b-07e9-4732-a3f2-8f2a9def2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5649ab-2e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:3c,bridge_name='br-int',has_traffic_filtering=True,id=fb5649ab-2e53-4c23-aa12-399f3bd1149c,network=Network(82b4c21b-07e9-4732-a3f2-8f2a9def2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5649ab-2e') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.013524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e24bd1a2-13a6-54d7-939d-547bd9ca741b', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:17.014721 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.014996 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:17.015558 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.018205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.018360 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb5649ab-2e, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:17.018681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb5649ab-2e, col_values=(('qos', UUID('81e925c5-cc94-459d-bb72-0ab3eb603ef7')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:17.018848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb5649ab-2e, col_values=(('external_ids', {'iface-id': 'fb5649ab-2e53-4c23-aa12-399f3bd1149c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:c1:3c', 'vm-uuid': '557d0595-bf4f-44be-a706-20f24bdf2bbe'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:17.020133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.021236 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:17.028219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:17.029033 np0000001643 nova-compute[98269]: INFO os_vif [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:3c,bridge_name='br-int',has_traffic_filtering=True,id=fb5649ab-2e53-4c23-aa12-399f3bd1149c,network=Network(82b4c21b-07e9-4732-a3f2-8f2a9def2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5649ab-2e')
May 28 14:08:17.086299 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Took 17.03 seconds to build instance.
May 28 14:08:17.161824 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:17.269812 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:17.304120 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:17.362552 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:17.367089 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:17.396963 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:17.397336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:17.397534 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquired lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:17.397659 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:08:17.397826 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'info_cache' on Instance uuid 06adb11e-c76e-438b-ae08-682156eb6255 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:17.591793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-486ac758-d212-46aa-b352-36667569d069 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.545s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:17.806950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:18.229599 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-changed-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:18.229599 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Refreshing instance network info cache due to event network-changed-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:08:18.229599 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] Acquiring lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:18.229599 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] Acquired lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:18.229599 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Refreshing network info cache for port e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:08:18.402960 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:18.543607 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:18.543786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:18.543914 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] No VIF found with MAC fa:16:3e:5d:c1:3c, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:08:18.544500 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Using config drive
May 28 14:08:18.733891 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:18.829808 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:18.830441 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:08:18.851252 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:19.024556 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating instance_info_cache with network_info: [{"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:19.050157 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:19.114846 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:19.204332 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Creating config drive at /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk.config
May 28 14:08:19.212934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5t20nj5k {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:19.264753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5t20nj5k" returned: 0 in 0.051s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:19.307573 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Updated VIF entry in instance network info cache for port e8b89c9c-681a-4b69-aa59-d76d57ac6ffe. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:08:19.308155 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Updating instance_info_cache with network_info: [{"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:19.321083 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Starting migrate_disk_and_power_off {{(pid=98269) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 14:08:19.338995 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:08:19.339549 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:19.358195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.362916 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.390982 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.511326 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.526430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Releasing lock "refresh_cache-06adb11e-c76e-438b-ae08-682156eb6255" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:19.526834 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'migration_context' on Instance uuid 06adb11e-c76e-438b-ae08-682156eb6255 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:19.537787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.544329 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3ce68896-5a38-41d7-b4a7-3ad012f1abab req-97d5590f-55bd-4bfa-8873-99ed0cb906e5 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:19.544680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3ce68896-5a38-41d7-b4a7-3ad012f1abab req-97d5590f-55bd-4bfa-8873-99ed0cb906e5 service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:19.544890 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3ce68896-5a38-41d7-b4a7-3ad012f1abab req-97d5590f-55bd-4bfa-8873-99ed0cb906e5 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:19.545066 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3ce68896-5a38-41d7-b4a7-3ad012f1abab req-97d5590f-55bd-4bfa-8873-99ed0cb906e5 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:19.552148 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3ce68896-5a38-41d7-b4a7-3ad012f1abab req-97d5590f-55bd-4bfa-8873-99ed0cb906e5 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] No waiting events found dispatching network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:19.552148 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-3ce68896-5a38-41d7-b4a7-3ad012f1abab req-97d5590f-55bd-4bfa-8873-99ed0cb906e5 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received unexpected event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 for instance with vm_state active and task_state resize_migrating.
May 28 14:08:19.552148 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.792927 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999596938000195 future=<Future at 0x71a75c298140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:19.798202 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance destroyed successfully.
May 28 14:08:19.799339 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=32,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:43Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-zh8rv90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=d6202b83-7043-4c19-81b6-13f2e5c64fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:08:19.799570 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:19.800364 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:19.800676 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:08:19.804311 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.804311 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e595d6c-88, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:19.806190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.806190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:19.811559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ee7187ad-636d-487f-9ff0-e044e2a2e870 req-e390490c-1dd2-4762-bb19-5ec03ca122a2 service nova] Releasing lock "refresh_cache-3f2b70b6-0378-4920-b040-12ac657d6ca5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:19.813594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.814943 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.815386 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1718ffd-1bc9-4fd9-97bb-203575773a42) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:19.816248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.817220 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:19.826598 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.828642 np0000001643 nova-compute[98269]: INFO os_vif [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88')
May 28 14:08:19.845193 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:19.925090 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:19.955930 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:20.029392 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Object Instance<06adb11e-c76e-438b-ae08-682156eb6255> lazy-loaded attributes: info_cache,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:08:20.033019 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:20.033019 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:20.063166 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:20.333229 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:20.333229 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:08:20.372362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:20.374854 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:20.379898 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:20.393383 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Detected multiple connections on this host for volume: a7747ace-8e04-4cf1-af6d-fc077740fc9d, skipping target disconnect.
May 28 14:08:20.402086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:20.422943 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:20.514327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:20.514948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:20.617151 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:20.619315 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:08:20.619315 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_resize/disk /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:20.719385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "cp -r /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_resize/disk /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:20.719945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_resize/disk.config /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:20.764416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "cp -r /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_resize/disk.config /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config" returned: 0 in 0.044s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:20.764976 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_resize/disk.info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:20.813938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "cp -r /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_resize/disk.info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info" returned: 0 in 0.049s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:20.840114 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:20.953410 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-783ec297-32fd-4854-b025-bd2754d8dbbf req-cbba3add-3db0-484a-8765-2d938f193898 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-vif-plugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:20.954032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-783ec297-32fd-4854-b025-bd2754d8dbbf req-cbba3add-3db0-484a-8765-2d938f193898 service nova] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:20.954287 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-783ec297-32fd-4854-b025-bd2754d8dbbf req-cbba3add-3db0-484a-8765-2d938f193898 service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:20.956184 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-783ec297-32fd-4854-b025-bd2754d8dbbf req-cbba3add-3db0-484a-8765-2d938f193898 service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:20.956184 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-783ec297-32fd-4854-b025-bd2754d8dbbf req-cbba3add-3db0-484a-8765-2d938f193898 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Processing event network-vif-plugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:08:21.014020 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:08:21.014020 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977301.0118685, 557d0595-bf4f-44be-a706-20f24bdf2bbe => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:21.014020 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] VM Started (Lifecycle Event)
May 28 14:08:21.019418 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:08:21.029415 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Instance spawned successfully.
May 28 14:08:21.029980 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:08:21.358364 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:21.358364 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:21.521402 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:21.524357 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:21.543843 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:21.543968 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:21.546324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:21.546324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:21.546324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:21.548402 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:08:21.661751 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-261cfe4d-1cab-4fc6-acc7-513679dce2ae req-9e135ec2-6482-4bcf-aea0-3fc850d169bf service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:21.662018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-261cfe4d-1cab-4fc6-acc7-513679dce2ae req-9e135ec2-6482-4bcf-aea0-3fc850d169bf service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:21.662302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-261cfe4d-1cab-4fc6-acc7-513679dce2ae req-9e135ec2-6482-4bcf-aea0-3fc850d169bf service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:21.662556 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-261cfe4d-1cab-4fc6-acc7-513679dce2ae req-9e135ec2-6482-4bcf-aea0-3fc850d169bf service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:21.662680 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-261cfe4d-1cab-4fc6-acc7-513679dce2ae req-9e135ec2-6482-4bcf-aea0-3fc850d169bf service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] No waiting events found dispatching network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:21.663294 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-261cfe4d-1cab-4fc6-acc7-513679dce2ae req-9e135ec2-6482-4bcf-aea0-3fc850d169bf service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received unexpected event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 for instance with vm_state active and task_state resize_migrating.
May 28 14:08:21.861087 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:22.016819 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:22.027649 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:08:22.027934 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977302.0277297, 557d0595-bf4f-44be-a706-20f24bdf2bbe => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:22.028084 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] VM Paused (Lifecycle Event)
May 28 14:08:22.055256 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Took 8.11 seconds to spawn the instance on the hypervisor.
May 28 14:08:22.055700 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:22.070058 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:22.072255 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:22.148146 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 binding to destination host np0000001643 is already ACTIVE {{(pid=98269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 14:08:22.530688 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:22.533483 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977302.5331013, 557d0595-bf4f-44be-a706-20f24bdf2bbe => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:22.533750 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] VM Resumed (Lifecycle Event)
May 28 14:08:22.564507 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Took 13.75 seconds to build instance.
May 28 14:08:22.759804 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005839550003656768 future=<Future at 0x71a75c362570 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:22.760054 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:22.760054 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=12.032411050000064 future=<Future at 0x71a75c298140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:22.760054 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=12.032335539000087 future=<Future at 0x71a75c298140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:22.762183 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Emitting event <LifecycleEvent: 1779977287.759102, 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:22.762376 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] VM Stopped (Lifecycle Event)
May 28 14:08:22.874507 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.843s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:23.036818 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:23.043633 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:23.055015 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8237481b-ef75-410d-b7c5-648d4e220e4e req-78649dd9-9dea-4faf-8f66-3d869e4d426a service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-vif-plugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:23.055015 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8237481b-ef75-410d-b7c5-648d4e220e4e req-78649dd9-9dea-4faf-8f66-3d869e4d426a service nova] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:23.055015 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8237481b-ef75-410d-b7c5-648d4e220e4e req-78649dd9-9dea-4faf-8f66-3d869e4d426a service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:23.055429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8237481b-ef75-410d-b7c5-648d4e220e4e req-78649dd9-9dea-4faf-8f66-3d869e4d426a service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:23.056495 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8237481b-ef75-410d-b7c5-648d4e220e4e req-78649dd9-9dea-4faf-8f66-3d869e4d426a service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] No waiting events found dispatching network-vif-plugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:23.056809 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8237481b-ef75-410d-b7c5-648d4e220e4e req-78649dd9-9dea-4faf-8f66-3d869e4d426a service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received unexpected event network-vif-plugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c for instance with vm_state active and task_state None.
May 28 14:08:23.066381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.256s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:23.157246 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:08:23.180472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:23.180778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:23.181238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:23.265264 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 7c25a8ba-cc94-4ac1-be8f-f7e32850f46b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:23.334685 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:23.335072 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:23.505939 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Deleted allocation for migration 2c387403-04ae-4f5e-af89-3fc622eea30d
May 28 14:08:23.827047 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:23.827220 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:08:23.827508 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:24.011430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0584eedd-477b-4895-aa33-c4149fc3bb04 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.247s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:24.183060 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:24.331207 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:24.331535 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:24.331811 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:08:24.514118 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:24.592507 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b2ff8b98-3f28-4da3-8fcc-776609dc27d7 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Get console output
May 28 14:08:24.658591 np0000001643 nova-compute[98269]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 14:08:24.816645 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:24.823392 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:24.823694 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:24.826678 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:24.826886 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:24.827119 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:24.838374 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:25.158903 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:25.313882 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:25.815923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:25.829936 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:25.830227 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:25.830556 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:26.327395 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:26.341752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:08:26.364998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:26.407433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:08:26.409876 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:08:26.416557 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:08:26.418299 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe44:40ea', 'fe80::dc5b:d0ff:fed1:72a0', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:fe28:6b45', 'fe80::e407:84ff:fe6e:8427', 'fe80::fc16:3eff:fe4e:78b', 'fe80::fc16:3eff:fe5d:c13c', 'fe80::845b:b7ff:fe8f:a7ef'] 
May 28 14:08:26.418484 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:08:26.418610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:08:26.418915 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:26.827133 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:27.333819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:27.334360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:27.334360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:27.334601 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:08:27.589721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Starting finish_migration {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 14:08:27.591071 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:08:27.591213 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Creating image(s)
May 28 14:08:27.591992 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:27.697463 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:27.698016 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:08:27.698323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:27.809374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:27.810521 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Cannot resize image /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:08:28.316955 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:08:28.317157 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Ensure instance console log exists: /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:08:28.317623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:28.317898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:28.318104 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:28.321561 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Start _get_guest_xml network_info=[{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'f3c5efff-8924-4f0f-90d7-f2233b2f31c7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'd6202b83-7043-4c19-81b6-13f2e5c64fef', 'attached_at': '2026-05-28T14:08:27.000000', 'detached_at': '', 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'multiattach': True, 'serial': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:08:28.331857 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:08:28.334893 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='d6202b83-7043-4c19-81b6-13f2e5c64fef'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977308.334184) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:08:28.338577 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:08:28.338577 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:08:28.339535 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:08:28.340032 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:08:28.342329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:08:28.343672 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:08:28.344465 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:08:28.344465 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:08:28.344465 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:08:28.344465 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:08:28.345223 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:08:28.345223 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:08:28.345424 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:08:28.348018 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:08:28.348018 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:08:28.348018 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:08:28.369015 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:28.370071 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:28.489181 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:28.490029 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:28.515941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config --force-share --output=json" returned: 0 in 0.146s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:28.516970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:28.518260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:28.519329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:28.520391 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:08:28.521687 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:28.521989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:28.522789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:28.523135 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:08:28.540904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:28.542246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:28.542246 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:08:28.542810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:28.544176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:28.544496 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:08:28.560546 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:08:28.560546 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:08:28.564610 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:08:28.564610 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:28.576173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:28.585025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.599980 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('13', '0', '0', 0) found on session 63 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:08:28.599980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:28.608908 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:28.609640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:28.609640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:08:28.610085 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('14', '0', '0', 0) found on session 64 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:08:28.610206 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:08:28.612302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:28.617598 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:28.631434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:28.631821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:28.632529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:28.632529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:28.632529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:28.638061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 64 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:08:28.638061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:08:28.639337 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Terminating instance
May 28 14:08:28.641835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 63 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:08:28.641835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:08:28.734780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:28.735322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:28.843771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:28.848461 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:08:28.851327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:28.949828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:28.950549 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.052060 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.052647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:08:29.057681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.147377 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:08:29.178092 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:29.183741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:29.199351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.199893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.221773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:29.244010 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:29.325879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.360305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.477786 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d7ec063d-f6d7-4692-bd7a-8d9a4ffaa167 req-6267d627-de80-49f0-b7c0-3d9da3252883 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-vif-unplugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:29.478425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d7ec063d-f6d7-4692-bd7a-8d9a4ffaa167 req-6267d627-de80-49f0-b7c0-3d9da3252883 service nova] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:29.480361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d7ec063d-f6d7-4692-bd7a-8d9a4ffaa167 req-6267d627-de80-49f0-b7c0-3d9da3252883 service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:29.480547 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d7ec063d-f6d7-4692-bd7a-8d9a4ffaa167 req-6267d627-de80-49f0-b7c0-3d9da3252883 service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:29.480692 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d7ec063d-f6d7-4692-bd7a-8d9a4ffaa167 req-6267d627-de80-49f0-b7c0-3d9da3252883 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] No waiting events found dispatching network-vif-unplugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:29.481223 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d7ec063d-f6d7-4692-bd7a-8d9a4ffaa167 req-6267d627-de80-49f0-b7c0-3d9da3252883 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-vif-unplugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:29.482245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.482811 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.506893 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:29.516913 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:29.535059 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999210115000096 future=<Future at 0x71a75c264ad0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:29.542981 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Instance destroyed successfully.
May 28 14:08:29.544593 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lazy-loading 'resources' on Instance uuid 557d0595-bf4f-44be-a706-20f24bdf2bbe {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:29.547829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:08:29.606524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.612319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.706506 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.706506 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.813078 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.813904 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:08:29.818091 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:29.819479 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:29.920146 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:29.920895 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:30.012582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:30.016851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:08:30.018792 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:08:30.019996 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:30.054066 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:08:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-931901849',display_name='tempest-VolumesActionsTest-instance-931901849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesactionstest-instance-931901849',id=36,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:08:22Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53dbb1d4f2104a6e9881dcedc07b1763',ramdisk_id='',reservation_id='r-64kggutk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1085038326',owner_user_name='tempest-VolumesActionsTest-1085038326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:08:22Z,user_data=None,user_id='f2970f4b582e4859a97a6d44af82915a',uuid=557d0595-bf4f-44be-a706-20f24bdf2bbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:08:30.054374 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Converting VIF {"id": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "address": "fa:16:3e:5d:c1:3c", "network": {"id": "82b4c21b-07e9-4732-a3f2-8f2a9def2a65", "bridge": "br-int", "label": "tempest-VolumesActionsTest-582806329-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "53dbb1d4f2104a6e9881dcedc07b1763", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5649ab-2e", "ovs_interfaceid": "fb5649ab-2e53-4c23-aa12-399f3bd1149c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:30.056321 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:3c,bridge_name='br-int',has_traffic_filtering=True,id=fb5649ab-2e53-4c23-aa12-399f3bd1149c,network=Network(82b4c21b-07e9-4732-a3f2-8f2a9def2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5649ab-2e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:30.056727 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:3c,bridge_name='br-int',has_traffic_filtering=True,id=fb5649ab-2e53-4c23-aa12-399f3bd1149c,network=Network(82b4c21b-07e9-4732-a3f2-8f2a9def2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5649ab-2e') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:08:30.060187 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:30.060805 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb5649ab-2e, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:30.065752 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:30.067057 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:30.067966 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:30.068125 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81e925c5-cc94-459d-bb72-0ab3eb603ef7) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:30.069311 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:30.069499 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:30.071672 np0000001643 nova-compute[98269]: INFO os_vif [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:3c,bridge_name='br-int',has_traffic_filtering=True,id=fb5649ab-2e53-4c23-aa12-399f3bd1149c,network=Network(82b4c21b-07e9-4732-a3f2-8f2a9def2a65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5649ab-2e')
May 28 14:08:30.072060 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Deleting instance files /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe_del
May 28 14:08:30.074143 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Deletion of /opt/stack/data/nova/instances/557d0595-bf4f-44be-a706-20f24bdf2bbe_del complete
May 28 14:08:30.078033 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:08:30.078502 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=11524MB free_disk=73.10678482055664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:08:30.078765 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:30.079095 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:30.565189 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 3300000006d9dae6b for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:08:30.565795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.043s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:30.566535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (2044ms) {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:30.566834 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d9dae6b', 'path': '/dev/dm-5', 'multipath_id': '3300000006d9dae6b'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:08:30.587580 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 14:08:30.589657 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:08:30.590158 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:08:30.590458 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:08:30.591095 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:30.737276 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:31.072799 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=32,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:43Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-zh8rv90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=d6202b83-7043-4c19-81b6-13f2e5c64fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:08:31.072994 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:31.076458 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:31.079390 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] End _get_guest_xml xml=<domain type="qemu">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <uuid>d6202b83-7043-4c19-81b6-13f2e5c64fef</uuid>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <name>instance-00000020</name>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <memory>262144</memory>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:name>multiattach-server-1</nova:name>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:08:28</nova:creationTime>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.micro" id="84">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:memory>256</nova:memory>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         <nova:port uuid="8e595d6c-8803-4a5b-9a05-b21d4c21b3d2">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <system>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <entry name="serial">d6202b83-7043-4c19-81b6-13f2e5c64fef</entry>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <entry name="uuid">d6202b83-7043-4c19-81b6-13f2e5c64fef</entry>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </system>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <os>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   </os>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <features>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   </features>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   <devices>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk.config"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-5"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <shareable/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </disk>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:be:b0:8b"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <target dev="tap8e595d6c-88"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </interface>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/console.log" append="off"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </serial>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <video>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </video>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </rng>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:   </devices>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]: </domain>
May 28 14:08:31.079390 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:08:31.082314 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=32,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:06:43Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-zh8rv90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=d6202b83-7043-4c19-81b6-13f2e5c64fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:08:31.083100 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "vif_mac": "fa:16:3e:be:b0:8b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:31.083100 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:31.083496 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:08:31.083907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:31.084283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:31.084984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:08:31.085722 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:31.085946 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3b14d3b-9a5a-5703-8292-986cc4a7ef0d', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:31.086864 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:31.087519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:31.087760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:31.090284 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:31.090519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e595d6c-88, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:31.090858 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e595d6c-88, col_values=(('qos', UUID('3b62c6ab-b8e3-4340-8850-56b20834ead4')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:31.091015 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e595d6c-88, col_values=(('external_ids', {'iface-id': '8e595d6c-8803-4a5b-9a05-b21d4c21b3d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:b0:8b', 'vm-uuid': 'd6202b83-7043-4c19-81b6-13f2e5c64fef'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:31.092225 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:31.093841 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:31.100123 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:31.101254 np0000001643 nova-compute[98269]: INFO os_vif [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88')
May 28 14:08:31.103003 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Applying migration context for instance d6202b83-7043-4c19-81b6-13f2e5c64fef as it has an incoming, in-progress migration bd83054a-1b87-4731-82f5-c170a6642d2d. Migration status is post-migrating {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 14:08:31.104611 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating resource usage from migration bd83054a-1b87-4731-82f5-c170a6642d2d
May 28 14:08:31.117750 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d68d3025-69d5-4b75-aadd-53ea5f56a6a8 req-8e94ec00-95ae-4893-8821-7883ed6fe0dd service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-vif-deleted-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:31.120905 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-d68d3025-69d5-4b75-aadd-53ea5f56a6a8 req-8e94ec00-95ae-4893-8821-7883ed6fe0dd service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Neutron deleted interface fb5649ab-2e53-4c23-aa12-399f3bd1149c; detaching it from the instance and deleting it from the info cache
May 28 14:08:31.124393 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d68d3025-69d5-4b75-aadd-53ea5f56a6a8 req-8e94ec00-95ae-4893-8821-7883ed6fe0dd service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Detach interface failed, port_id=fb5649ab-2e53-4c23-aa12-399f3bd1149c, reason: Instance 557d0595-bf4f-44be-a706-20f24bdf2bbe could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:08:31.162941 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 90b0ea10-2b38-4907-aa11-02454a817a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163046 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 27823c45-9fce-41b2-923b-a5a907ef029c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163162 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163284 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163373 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 512a75c8-713d-418b-adc8-07b2bf513923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163477 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 06adb11e-c76e-438b-ae08-682156eb6255 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163658 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 3f2b70b6-0378-4920-b040-12ac657d6ca5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163767 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 557d0595-bf4f-44be-a706-20f24bdf2bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.163881 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Migration bd83054a-1b87-4731-82f5-c170a6642d2d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 14:08:31.164022 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d6202b83-7043-4c19-81b6-13f2e5c64fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:08:31.164135 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:08:31.164266 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=2624MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:08:30 up 35 min,  2 users,  load average: 7.14, 7.45, 4.20\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_6a74849f3fb24097a5a42457746f02d2': '2', 'io_workload': '0', 'num_proj_ac4618bb9b554fb8af8f26aae95c016a': '5', 'num_task_resize_finish': '1', 'num_proj_0e6508d9982d4947a5e5ec3f5c04580c': '1', 'num_task_deleting': '1', 'num_proj_53dbb1d4f2104a6e9881dcedc07b1763': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:08:31.540269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-66c45bcb-107e-427d-b868-719dcc3f4227 req-6acdb557-feba-4bc7-8610-35e69871de44 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-vif-unplugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:31.540269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-66c45bcb-107e-427d-b868-719dcc3f4227 req-6acdb557-feba-4bc7-8610-35e69871de44 service nova] Acquiring lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:31.540269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-66c45bcb-107e-427d-b868-719dcc3f4227 req-6acdb557-feba-4bc7-8610-35e69871de44 service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:31.540269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-66c45bcb-107e-427d-b868-719dcc3f4227 req-6acdb557-feba-4bc7-8610-35e69871de44 service nova] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:31.540269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-66c45bcb-107e-427d-b868-719dcc3f4227 req-6acdb557-feba-4bc7-8610-35e69871de44 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] No waiting events found dispatching network-vif-unplugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:31.540269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-66c45bcb-107e-427d-b868-719dcc3f4227 req-6acdb557-feba-4bc7-8610-35e69871de44 service nova] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Received event network-vif-unplugged-fb5649ab-2e53-4c23-aa12-399f3bd1149c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:31.553750 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:31.741034 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:31.741654 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:32.055773 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Took 1.47 seconds to deallocate network for instance.
May 28 14:08:32.244523 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:32.570479 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:32.641831 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:32.641999 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:32.642176 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:08:32.642355 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:be:b0:8b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:08:32.643120 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Using config drive
May 28 14:08:32.753641 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:08:32.754155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.675s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:32.754155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.186s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:32.754278 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:33.175260 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:33.205647 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:33.212582 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:33.324648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:33.401046 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:33.401625 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:33.426396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:33.434158 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5464cc58-b8e6-4b9d-8e71-99c1cb329eee req-55e17427-4a96-4441-be42-65dca531b007 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:33.434417 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5464cc58-b8e6-4b9d-8e71-99c1cb329eee req-55e17427-4a96-4441-be42-65dca531b007 service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:33.435716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5464cc58-b8e6-4b9d-8e71-99c1cb329eee req-55e17427-4a96-4441-be42-65dca531b007 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:33.435716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5464cc58-b8e6-4b9d-8e71-99c1cb329eee req-55e17427-4a96-4441-be42-65dca531b007 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:33.435716 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5464cc58-b8e6-4b9d-8e71-99c1cb329eee req-55e17427-4a96-4441-be42-65dca531b007 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] No waiting events found dispatching network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:33.435716 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-5464cc58-b8e6-4b9d-8e71-99c1cb329eee req-55e17427-4a96-4441-be42-65dca531b007 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received unexpected event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 for instance with vm_state active and task_state resize_finish.
May 28 14:08:33.905564 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:34.162631 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for d6202b83-7043-4c19-81b6-13f2e5c64fef due to new event <LifecycleEvent: 1779977314.1621335, d6202b83-7043-4c19-81b6-13f2e5c64fef => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:08:34.162852 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977314.1621335, d6202b83-7043-4c19-81b6-13f2e5c64fef => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:34.162994 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] VM Resumed (Lifecycle Event)
May 28 14:08:34.165331 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:08:34.169200 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance running successfully.
May 28 14:08:34.171691 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Failed to set time: agent not configured {{(pid=98269) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 14:08:34.171918 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-65b8f017-1b88-4c6a-80fd-59b63a00a170 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] finish_migration finished successfully. {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 14:08:34.417680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.663s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:34.500441 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Deleted allocations for instance 557d0595-bf4f-44be-a706-20f24bdf2bbe
May 28 14:08:34.520926 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:34.668647 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:34.672301 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:34.750112 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:08:34.750723 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 27.77 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:34.792896 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00044571199987331056 future=<Future at 0x71a75c298140 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:34.793075 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:34.793158 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.739462905999972 future=<Future at 0x71a75c264ad0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:34.793253 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.739373068000077 future=<Future at 0x71a75c264ad0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:35.175884 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 14:08:35.176311 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977315.1759868, d6202b83-7043-4c19-81b6-13f2e5c64fef => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:35.176391 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] VM Started (Lifecycle Event)
May 28 14:08:35.515955 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9d7622e4-be5e-42c1-ada7-d170954c326e tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Lock "557d0595-bf4f-44be-a706-20f24bdf2bbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.884s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:35.539930 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b20809d1-2e51-48ff-a5e4-3166fa5f1b7f req-0d21bbd1-c00f-48eb-944c-7f728b7d4c02 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:35.540134 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b20809d1-2e51-48ff-a5e4-3166fa5f1b7f req-0d21bbd1-c00f-48eb-944c-7f728b7d4c02 service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:35.540341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b20809d1-2e51-48ff-a5e4-3166fa5f1b7f req-0d21bbd1-c00f-48eb-944c-7f728b7d4c02 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:35.540512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b20809d1-2e51-48ff-a5e4-3166fa5f1b7f req-0d21bbd1-c00f-48eb-944c-7f728b7d4c02 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:35.540654 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b20809d1-2e51-48ff-a5e4-3166fa5f1b7f req-0d21bbd1-c00f-48eb-944c-7f728b7d4c02 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] No waiting events found dispatching network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:35.540850 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b20809d1-2e51-48ff-a5e4-3166fa5f1b7f req-0d21bbd1-c00f-48eb-944c-7f728b7d4c02 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received unexpected event network-vif-plugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 for instance with vm_state resized and task_state None.
May 28 14:08:35.685894 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:35.690048 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:08:36.006790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:36.006997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:36.007174 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Going to confirm migration 4 {{(pid=98269) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 14:08:36.093793 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:36.513547 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:36.589988 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:36.590215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:36.590322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:36.590444 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:08:36.590626 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'info_cache' on Instance uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:37.596629 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:37.883892 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:38.017877 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:38.520428 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:38.520730 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'migration_context' on Instance uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:39.023503 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Object Instance<d6202b83-7043-4c19-81b6-13f2e5c64fef> lazy-loaded attributes: info_cache,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:08:39.029548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:39.029723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:39.520323 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:39.706022 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:08:39.765765 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:08:39.765929 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:08:39.812149 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:08:39.861884 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:08:40.388508 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:40.388911 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:40.891291 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:41.097361 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:41.907592 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.878s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:42.033023 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:08:42.597963 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocation for migration bd83054a-1b87-4731-82f5-c170a6642d2d
May 28 14:08:43.104512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d4cab3aa-a7f7-4e40-8030-dc57901f8f09 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.097s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:44.522543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:44.533030 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003886250001414737 future=<Future at 0x71a75c264ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:44.533131 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:44.533712 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Emitting event <LifecycleEvent: 1779977309.5324206, 557d0595-bf4f-44be-a706-20f24bdf2bbe => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:08:44.533919 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] VM Stopped (Lifecycle Event)
May 28 14:08:44.778604 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-changed-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:44.779486 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing instance network info cache due to event network-changed-027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:08:44.780129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] Acquiring lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:44.780327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] Acquired lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:44.780436 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Refreshing network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:08:45.040505 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 557d0595-bf4f-44be-a706-20f24bdf2bbe] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:08:45.283834 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:45.635901 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:45.813366 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updated VIF entry in instance network info cache for port 027666be-2507-4940-ae85-8c79ccf188b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:08:45.814018 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [{"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:46.101753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:46.316074 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be6de83f-c0d9-4597-a28d-bddcc3259bb4 req-d66af4b3-7181-4e4d-8f57-7d38c3daf088 service nova] Releasing lock "refresh_cache-512a75c8-713d-418b-adc8-07b2bf513923" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:46.840921 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:46.840921 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing instance network info cache due to event network-changed-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:08:46.840921 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] Acquiring lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:08:46.841531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] Acquired lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:08:46.841531 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Refreshing network info cache for port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:08:47.344055 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:47.760121 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:47.954723 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updated VIF entry in instance network info cache for port 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:08:47.955145 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [{"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:48.295546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:48.295734 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:48.295919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:48.296052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:48.296155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:48.298390 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Terminating instance
May 28 14:08:48.304360 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:48.457856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8afe3281-9c57-4a6c-80e3-9012b5a4492b req-3eeb816c-1bbc-4ae5-b70e-44d6630a6cb8 service nova] Releasing lock "refresh_cache-d6202b83-7043-4c19-81b6-13f2e5c64fef" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:08:48.801820 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:08:48.826022 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:48.856752 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:49.025214 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-060039e0-2097-44dc-b31d-466f27efe90e req-cac8f45b-a7b0-4311-b95d-3dd40aa2fef1 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:49.028152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:49.028490 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-060039e0-2097-44dc-b31d-466f27efe90e req-cac8f45b-a7b0-4311-b95d-3dd40aa2fef1 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:49.029767 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-060039e0-2097-44dc-b31d-466f27efe90e req-cac8f45b-a7b0-4311-b95d-3dd40aa2fef1 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:49.029767 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-060039e0-2097-44dc-b31d-466f27efe90e req-cac8f45b-a7b0-4311-b95d-3dd40aa2fef1 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:49.029928 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-060039e0-2097-44dc-b31d-466f27efe90e req-cac8f45b-a7b0-4311-b95d-3dd40aa2fef1 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] No waiting events found dispatching network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:49.030073 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-060039e0-2097-44dc-b31d-466f27efe90e req-cac8f45b-a7b0-4311-b95d-3dd40aa2fef1 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:49.035422 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:49.155042 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999664895000024 future=<Future at 0x71a75c2669f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:49.156734 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997995330999856 future=<Future at 0x71a75c2669f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:49.158197 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997778557999936 future=<Future at 0x71a75c2669f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:49.158979 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Instance destroyed successfully.
May 28 14:08:49.159692 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'resources' on Instance uuid 06adb11e-c76e-438b-ae08-682156eb6255 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:49.529231 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:49.663613 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-739018894',display_name='tempest-ServerActionsTestOtherA-server-739018894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-739018894',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:08:15Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-2neos4o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=06adb11e-c76e-438b-ae08-682156eb6255,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:08:49.666850 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "address": "fa:16:3e:4e:07:8b", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aa9a613-a7", "ovs_interfaceid": "1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:49.667901 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:49.668166 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:08:49.673999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:49.674170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aa9a613-a7, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:49.678440 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:49.682184 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:49.682524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03ccf8cb-82fa-4456-917f-666f6a2ede26) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:49.684887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:49.693226 np0000001643 nova-compute[98269]: INFO os_vif [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:07:8b,bridge_name='br-int',has_traffic_filtering=True,id=1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aa9a613-a7')
May 28 14:08:49.695740 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:08:49.696253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:49.696518 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:49.697070 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:49.697542 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '716e1389-8ad8-432e-bf18-b9d6eabb97e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:08:49.697743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:08:49.731794 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:49.731794 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:49.731794 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:49.731794 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:49.731794 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:49.731794 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:49.731794 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:08:49.732142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:49.732142 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:08:49.732142 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:49.732142 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:08:49.732142 np0000001643 nova-compute[98269]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:49.732142 np0000001643 nova-compute[98269]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4 (non-flash)
May 28 14:08:49.732142 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:08:49.732142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '72')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:08:49.732489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '71')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:49.733438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4', '72')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:08:49.734433 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c3c72e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:08:49.734858 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:08:49.735235 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Flush multipath device 330000000bc8d01a1 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:08:49.800353 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:49.845345 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:08:49.890035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:08:49.890242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:08:49.891671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:08:49.902466 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:08:49.902793 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:08:49.917752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:49.955370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260]
May 28 14:08:49.955370 np0000001643 nova-compute[98269]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.40.100,3260] successful.
May 28 14:08:49.955370 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:49.969932 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:49.981430 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:50.014047 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260]
May 28 14:08:50.014047 np0000001643 nova-compute[98269]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-716e1389-8ad8-432e-bf18-b9d6eabb97e4, portal: 192.168.50.100,3260] successful.
May 28 14:08:50.014047 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:50.036673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:50.037862 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:08:50.038111 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] <== disconnect_volume: return (341ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:50.038332 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:08:50.039030 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Deleting instance files /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255_del
May 28 14:08:50.039488 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Deletion of /opt/stack/data/nova/instances/06adb11e-c76e-438b-ae08-682156eb6255_del complete
May 28 14:08:50.555022 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Took 1.75 seconds to destroy the instance on the hypervisor.
May 28 14:08:50.555746 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:08:50.556059 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:08:50.556161 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:08:50.556422 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:50.621675 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:51.004152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:51.115211 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-057bc07e-051e-4cfc-a019-8bac9ee04ef7 req-418dddd0-fa2d-4db2-8dbc-096d3174bd53 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:51.115656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-057bc07e-051e-4cfc-a019-8bac9ee04ef7 req-418dddd0-fa2d-4db2-8dbc-096d3174bd53 service nova] Acquiring lock "06adb11e-c76e-438b-ae08-682156eb6255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:51.115656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-057bc07e-051e-4cfc-a019-8bac9ee04ef7 req-418dddd0-fa2d-4db2-8dbc-096d3174bd53 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:51.115819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-057bc07e-051e-4cfc-a019-8bac9ee04ef7 req-418dddd0-fa2d-4db2-8dbc-096d3174bd53 service nova] Lock "06adb11e-c76e-438b-ae08-682156eb6255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:51.115967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-057bc07e-051e-4cfc-a019-8bac9ee04ef7 req-418dddd0-fa2d-4db2-8dbc-096d3174bd53 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] No waiting events found dispatching network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:08:51.116130 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-057bc07e-051e-4cfc-a019-8bac9ee04ef7 req-418dddd0-fa2d-4db2-8dbc-096d3174bd53 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-unplugged-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:08:51.601919 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:08:52.104023 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Took 1.55 seconds to deallocate network for instance.
May 28 14:08:52.240937 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:52.675438 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Took 0.57 seconds to detach 1 volumes for instance.
May 28 14:08:52.676314 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Deleting volume: 716e1389-8ad8-432e-bf18-b9d6eabb97e4 {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:08:53.227262 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-520900b0-275b-49e1-b87f-8d6bcca87dbe req-257730dc-68a3-456b-a621-cb5a94480834 service nova] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Received event network-vif-deleted-1aa9a613-a7ea-4fd6-9568-2d7fcda0a14c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:08:53.256360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:53.257087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:53.335492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:53.714466 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:08:53.714755 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:08:54.218092 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:08:54.355173 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:54.526639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:54.683923 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:54.725496 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.469s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:54.790856 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Deleted allocations for instance 06adb11e-c76e-438b-ae08-682156eb6255
May 28 14:08:56.646419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9770f0a1-7782-4737-8285-5100b002cef9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "06adb11e-c76e-438b-ae08-682156eb6255" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.509s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:56.646419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:56.646419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:57.018623 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lazy-loading 'flavor' on Instance uuid 3f2b70b6-0378-4920-b040-12ac657d6ca5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:57.725533 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:57.898706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:57.898919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:57.899111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:57.899270 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:57.899440 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:57.901536 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Terminating instance
May 28 14:08:58.029806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:08:58.404815 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:08:58.429399 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:58.433142 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:58.455640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:58.460962 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:58.485994 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:58.488750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:58.750800 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999632965999808 future=<Future at 0x71a78048f470 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:08:58.751960 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Instance destroyed successfully.
May 28 14:08:58.752325 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lazy-loading 'resources' on Instance uuid 90b0ea10-2b38-4907-aa11-02454a817a01 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:08:59.122742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:08:59.122943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:08:59.123101 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Attaching volume 7011a5a4-ec6b-43e8-b166-1c608e46d434 to /dev/vdb
May 28 14:08:59.160671 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:59.171010 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:08:59.191038 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:08:59.232758 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:08:59.233118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:08:59.242172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:08:59.243892 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:fe28:6b45', 'fe80::e407:84ff:fe6e:8427', 'fe80::fc16:3eff:febe:b08b'] 
May 28 14:08:59.244601 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:08:59.244601 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:08:59.244601 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:08:59.244815 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Updating existing volume attachment record: 9ca53491-d1d2-4f87-9de4-3718d2f9a015 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:08:59.254999 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1156511192',display_name='tempest-ServerActionsTestOtherA-server-1156511192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionstestothera-server-1156511192',id=21,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/Uvuc/p1xMVj4lNbHRwUTy7QwRJRU3KydWghNwwUOtSzS4RkXSkyn2a19u71ItbsGqX1/zQuamekuR+d9f4pVh0xvURwGf+6ysQNxuHrZHxwJr56gZCjLHVVJdhjytQ==',key_name='tempest-keypair-1657566322',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:04:21Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a74849f3fb24097a5a42457746f02d2',ramdisk_id='',reservation_id='r-oa885l96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-354716614',owner_user_name='tempest-ServerActionsTestOtherA-354716614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='357253ac91f34daeb60ae1dfd3e4a86f',uuid=90b0ea10-2b38-4907-aa11-02454a817a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:08:59.255195 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converting VIF {"id": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "address": "fa:16:3e:44:40:ea", "network": {"id": "07297104-0218-4e83-bc6c-83f82996e038", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1052260659-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a74849f3fb24097a5a42457746f02d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e5c2e2-c3", "ovs_interfaceid": "f9e5c2e2-c369-4d24-9857-ff3df1320952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:08:59.256064 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:40:ea,bridge_name='br-int',has_traffic_filtering=True,id=f9e5c2e2-c369-4d24-9857-ff3df1320952,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e5c2e2-c3') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:08:59.256245 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:40:ea,bridge_name='br-int',has_traffic_filtering=True,id=f9e5c2e2-c369-4d24-9857-ff3df1320952,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e5c2e2-c3') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:08:59.259152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.259717 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9e5c2e2-c3, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:59.262245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.262633 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:59.263100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.264432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.264625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=285ea45e-56f3-4d50-8982-87226f9ffce3) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:08:59.265119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.265980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:08:59.266250 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.268542 np0000001643 nova-compute[98269]: INFO os_vif [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:40:ea,bridge_name='br-int',has_traffic_filtering=True,id=f9e5c2e2-c369-4d24-9857-ff3df1320952,network=Network(07297104-0218-4e83-bc6c-83f82996e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e5c2e2-c3')
May 28 14:08:59.268907 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Deleting instance files /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01_del
May 28 14:08:59.270357 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Deletion of /opt/stack/data/nova/instances/90b0ea10-2b38-4907-aa11-02454a817a01_del complete
May 28 14:08:59.507318 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.528524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:08:59.778542 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 14:08:59.779895 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:08:59.780100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:08:59.780221 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:08:59.780596 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:08:59.809024 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:08:59.809416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7011a5a4-ec6b-43e8-b166-1c608e46d434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:08:59.809541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:59.809958 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:59.810198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7011a5a4-ec6b-43e8-b166-1c608e46d434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:08:59.822227 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:59.823268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:08:59.823629 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:59.823800 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:08:59.824524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:08:59.824740 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:08:59.838387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:08:59.838387 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:59.844835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:08:59.844835 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:59.852132 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434] added
May 28 14:08:59.852132 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:08:59.852132 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:59.852132 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:59.852132 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:59.852132 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:59.852132 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:59.852571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:08:59.852627 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:08:59.852808 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:08:59.860500 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434] added
May 28 14:08:59.860500 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:08:59.860500 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:59.860500 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:59.860500 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:08:59.860500 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:08:59.860500 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:08:59.860833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:08:59.860877 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:08:59.861146 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:08:59.890007 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:00.198831 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8a6b2474-c80d-4af6-8c8e-ec73e5ae2273 req-e2d316b5-49f9-47c3-8970-a9ae325ccaea service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-vif-unplugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:00.199040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8a6b2474-c80d-4af6-8c8e-ec73e5ae2273 req-e2d316b5-49f9-47c3-8970-a9ae325ccaea service nova] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:00.199228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8a6b2474-c80d-4af6-8c8e-ec73e5ae2273 req-e2d316b5-49f9-47c3-8970-a9ae325ccaea service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:00.199384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8a6b2474-c80d-4af6-8c8e-ec73e5ae2273 req-e2d316b5-49f9-47c3-8970-a9ae325ccaea service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:00.199578 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8a6b2474-c80d-4af6-8c8e-ec73e5ae2273 req-e2d316b5-49f9-47c3-8970-a9ae325ccaea service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] No waiting events found dispatching network-vif-unplugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:00.199686 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8a6b2474-c80d-4af6-8c8e-ec73e5ae2273 req-e2d316b5-49f9-47c3-8970-a9ae325ccaea service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-vif-unplugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:09:00.367389 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-08cd6626-e7d7-4191-8ebb-638094728a43 req-7be17bcb-5250-452e-bc41-b475c159f70a service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-vif-deleted-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:00.367389 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-08cd6626-e7d7-4191-8ebb-638094728a43 req-7be17bcb-5250-452e-bc41-b475c159f70a service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Neutron deleted interface f9e5c2e2-c369-4d24-9857-ff3df1320952; detaching it from the instance and deleting it from the info cache
May 28 14:09:00.369342 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-08cd6626-e7d7-4191-8ebb-638094728a43 req-7be17bcb-5250-452e-bc41-b475c159f70a service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Detach interface failed, port_id=f9e5c2e2-c369-4d24-9857-ff3df1320952, reason: Instance 90b0ea10-2b38-4907-aa11-02454a817a01 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:09:00.796347 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:00.853250 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:09:00.861525 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:09:00.867927 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:09:00.867927 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:09:00.877072 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:09:00.877072 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.885935 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.891561 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.903905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.903905 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.903905 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.903905 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.903905 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:00.904128 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.904128 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.904128 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.904128 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.904128 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:00.910499 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.910499 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.910499 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.910499 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.910499 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:00.910673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.910673 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.910673 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.910673 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.910673 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:00.947767 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.50.100,3260]
May 28 14:09:00.947767 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.50.100,3260] successful.
May 28 14:09:00.947767 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.954542 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.40.100,3260]
May 28 14:09:00.954542 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.40.100,3260] successful.
May 28 14:09:00.954542 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.962609 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.968905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:00.979949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.979949 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.979949 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.979949 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.979949 np0000001643 nova-compute[98269]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.979949 np0000001643 nova-compute[98269]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.979949 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:00.980137 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.980137 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.980137 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.980137 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.980137 np0000001643 nova-compute[98269]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.980137 np0000001643 nova-compute[98269]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.980137 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:00.980331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:00.980460 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:09:00.981253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] HCTL ('7', '-', '-', 0) found on session 73 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:09:00.981365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:09:00.988528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.988528 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.988528 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.988528 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.988528 np0000001643 nova-compute[98269]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.988528 np0000001643 nova-compute[98269]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.988528 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:00.988814 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.988814 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:00.988814 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.988814 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:00.988814 np0000001643 nova-compute[98269]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.988814 np0000001643 nova-compute[98269]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:00.988814 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:00.989044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:00.989137 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:09:00.989903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] HCTL ('8', '-', '-', 0) found on session 74 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:09:00.990038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:09:00.999718 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Searching for a device in session 73 and hctl ['7', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:01.005541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Searching for a device in session 74 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:01.005541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7011a5a4-ec6b-43e8-b166-1c608e46d434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:09:01.299255 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Took 1.52 seconds to deallocate network for instance.
May 28 14:09:01.811551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:01.812051 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:01.998528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Searching for a device in session 73 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:01.998728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7011a5a4-ec6b-43e8-b166-1c608e46d434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:09:02.205976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:02.206187 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:02.284043 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbb3ad01-8324-4111-91d3-94fc92cf7acf req-c61bd0a3-62a9-48c4-a4ad-233ade658cae service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received event network-vif-unplugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:02.284536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbb3ad01-8324-4111-91d3-94fc92cf7acf req-c61bd0a3-62a9-48c4-a4ad-233ade658cae service nova] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:02.284789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbb3ad01-8324-4111-91d3-94fc92cf7acf req-c61bd0a3-62a9-48c4-a4ad-233ade658cae service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:02.284789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbb3ad01-8324-4111-91d3-94fc92cf7acf req-c61bd0a3-62a9-48c4-a4ad-233ade658cae service nova] Lock "90b0ea10-2b38-4907-aa11-02454a817a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:02.285976 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbb3ad01-8324-4111-91d3-94fc92cf7acf req-c61bd0a3-62a9-48c4-a4ad-233ade658cae service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] No waiting events found dispatching network-vif-unplugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:02.285976 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-fbb3ad01-8324-4111-91d3-94fc92cf7acf req-c61bd0a3-62a9-48c4-a4ad-233ade658cae service nova] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Received unexpected event network-vif-unplugged-f9e5c2e2-c369-4d24-9857-ff3df1320952 for instance with vm_state deleted and task_state None.
May 28 14:09:02.523299 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:02.709613 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:02.839585 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Found WWN 33000000021b28250 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:09:02.840053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:02.840096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000021b28250', 'path': '/dev/dm-0', 'multipath_id': '33000000021b28250'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:02.840257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000021b28250', 'path': '/dev/dm-0', 'multipath_id': '33000000021b28250'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:09:02.842815 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lazy-loading 'flavor' on Instance uuid 3f2b70b6-0378-4920-b040-12ac657d6ca5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:03.028262 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
May 28 14:09:03.028434 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid 27823c45-9fce-41b2-923b-a5a907ef029c {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:09:03.029244 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid cfa684f7-1fb1-4e0f-bf60-3c42614b2670 {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:09:03.029738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.029942 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "27823c45-9fce-41b2-923b-a5a907ef029c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:03.030407 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid 0cb5afe2-5125-4261-b2f3-f0431bc65134 {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:09:03.030834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.031056 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:03.031660 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:09:03.032150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.032360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:03.033938 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:09:03.034369 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.037564 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "512a75c8-713d-418b-adc8-07b2bf513923" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:03.037564 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid 3f2b70b6-0378-4920-b040-12ac657d6ca5 {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:09:03.037564 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid 90b0ea10-2b38-4907-aa11-02454a817a01 {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:09:03.040389 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 22.30 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:09:03.044901 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.045093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:03.168421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.168667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:03.216827 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.405s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:03.292644 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Deleted allocations for instance 90b0ea10-2b38-4907-aa11-02454a817a01
May 28 14:09:03.305175 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:03.345985 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Attempting to attach volume 7011a5a4-ec6b-43e8-b166-1c608e46d434 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:09:03.346977 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:09:03.346977 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:03.346977 np0000001643 nova-compute[98269]:   <alias name="ua-7011a5a4-ec6b-43e8-b166-1c608e46d434"/>
May 28 14:09:03.346977 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:09:03.346977 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:09:03.346977 np0000001643 nova-compute[98269]:   <serial>7011a5a4-ec6b-43e8-b166-1c608e46d434</serial>
May 28 14:09:03.346977 np0000001643 nova-compute[98269]: </disk>
May 28 14:09:03.346977 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:09:03.544792 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "27823c45-9fce-41b2-923b-a5a907ef029c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.515s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:03.545608 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:03.546030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.546348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "90b0ea10-2b38-4907-aa11-02454a817a01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:03.550182 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.519s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:03.556705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "512a75c8-713d-418b-adc8-07b2bf513923" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.520s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:03.557493 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:03.672038 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:09:04.155151 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004347320000306354 future=<Future at 0x71a75c2669f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:04.155591 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:04.155591 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.594934202999866 future=<Future at 0x71a78048f470 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:04.155591 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.594805142999576 future=<Future at 0x71a78048f470 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:04.157030 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] Emitting event <LifecycleEvent: 1779977329.1545691, 06adb11e-c76e-438b-ae08-682156eb6255 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:04.157030 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] VM Stopped (Lifecycle Event)
May 28 14:09:04.224574 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:04.224868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:04.230282 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:09:04.230440 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Claim successful on node np0000001643
May 28 14:09:04.265083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:04.301328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-21334097-efc1-436d-97dd-7520c6295cc9 tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Lock "90b0ea10-2b38-4907-aa11-02454a817a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.402s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:04.302623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "90b0ea10-2b38-4907-aa11-02454a817a01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.756s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:04.530177 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:04.658709 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bae0a9f1-3c91-46ab-8db6-90a27c6b7442 tempest-TestMultiAttachVolumeSwap-1324034633 tempest-TestMultiAttachVolumeSwap-1324034633-project-member] [instance: 06adb11e-c76e-438b-ae08-682156eb6255] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:04.808389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "90b0ea10-2b38-4907-aa11-02454a817a01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:05.006756 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:05.006887 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:05.006948 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:05.007065 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] No VIF found with MAC fa:16:3e:28:6b:45, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:09:05.077911 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:05.078157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:05.580933 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Detaching volume a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:09:05.642180 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Attempting to driver detach volume a7747ace-8e04-4cf1-af6d-fc077740fc9d from mountpoint /dev/vdb
May 28 14:09:05.650383 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:05.652036 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:09:05.654517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:09:05.654962 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Attempting to detach device vdb from instance 512a75c8-713d-418b-adc8-07b2bf513923 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:09:05.655507 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:   <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:   <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]: </disk>
May 28 14:09:05.655507 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:09:05.655945 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:05.656195 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:05.665332 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance 512a75c8-713d-418b-adc8-07b2bf513923 from the persistent domain config.
May 28 14:09:05.665580 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] (1/8): Attempting to detach device vdb with device alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d from instance 512a75c8-713d-418b-adc8-07b2bf513923 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:09:05.665953 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:   <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:   <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]: </disk>
May 28 14:09:05.665953 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:09:06.159479 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:06.268338 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977346.267968, 512a75c8-713d-418b-adc8-07b2bf513923 => ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:09:06.270508 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d for instance 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:09:06.274271 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance 512a75c8-713d-418b-adc8-07b2bf513923 from the live domain config.
May 28 14:09:06.571419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fb40ac7-6966-406e-9edf-1fc32fd6f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.448s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:06.572521 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.027s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:06.665989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.441s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:06.666404 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:09:06.815677 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Detected multiple connections on this host for volume: a7747ace-8e04-4cf1-af6d-fc077740fc9d, skipping target disconnect.
May 28 14:09:07.046824 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:07.078748 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:07.172895 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:09:07.173115 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:09:07.173504 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:07.173926 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:07.261092 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '072a73099ec74dbd8f4253608d1d04f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cef3deefeb451d897a690dd0e2529b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:09:07.394083 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:07.677825 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:09:07.863391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:07.863391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:07.929003 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Successfully created port: d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:09:08.185195 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:09:08.366120 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Detaching volume 7011a5a4-ec6b-43e8-b166-1c608e46d434
May 28 14:09:08.403553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8a6a3ad8-2006-4de7-8594-28171612f220 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.325s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:08.412860 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Attempting to driver detach volume 7011a5a4-ec6b-43e8-b166-1c608e46d434 from mountpoint /dev/vdb
May 28 14:09:08.419990 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Found disk vdb by alias ua-7011a5a4-ec6b-43e8-b166-1c608e46d434 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:09:08.422039 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Found disk vdb by alias ua-7011a5a4-ec6b-43e8-b166-1c608e46d434 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:09:08.422341 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Attempting to detach device vdb from instance 3f2b70b6-0378-4920-b040-12ac657d6ca5 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:09:08.422765 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:09:08.422765 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:08.422765 np0000001643 nova-compute[98269]:   <alias name="ua-7011a5a4-ec6b-43e8-b166-1c608e46d434"/>
May 28 14:09:08.422765 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:09:08.422765 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:09:08.422765 np0000001643 nova-compute[98269]:   <serial>7011a5a4-ec6b-43e8-b166-1c608e46d434</serial>
May 28 14:09:08.422765 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:09:08.422765 np0000001643 nova-compute[98269]: </disk>
May 28 14:09:08.422765 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:09:08.432208 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Successfully detached device vdb from instance 3f2b70b6-0378-4920-b040-12ac657d6ca5 from the persistent domain config.
May 28 14:09:08.432512 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] (1/8): Attempting to detach device vdb with device alias ua-7011a5a4-ec6b-43e8-b166-1c608e46d434 from instance 3f2b70b6-0378-4920-b040-12ac657d6ca5 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:09:08.432853 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:09:08.432853 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:08.432853 np0000001643 nova-compute[98269]:   <alias name="ua-7011a5a4-ec6b-43e8-b166-1c608e46d434"/>
May 28 14:09:08.432853 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:09:08.432853 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:09:08.432853 np0000001643 nova-compute[98269]:   <serial>7011a5a4-ec6b-43e8-b166-1c608e46d434</serial>
May 28 14:09:08.432853 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:09:08.432853 np0000001643 nova-compute[98269]: </disk>
May 28 14:09:08.432853 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:09:08.495434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:08.495753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:08.666031 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Successfully updated port: d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:09:08.738196 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-changed-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:08.738196 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Refreshing instance network info cache due to event network-changed-d310411e-f4f5-4d52-8377-6997e6441188. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:08.738196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] Acquiring lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:08.738196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] Acquired lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:08.738196 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Refreshing network info cache for port d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:08.994329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977348.99393, 3f2b70b6-0378-4920-b040-12ac657d6ca5 => ua-7011a5a4-ec6b-43e8-b166-1c608e46d434> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:09:08.997207 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7011a5a4-ec6b-43e8-b166-1c608e46d434 for instance 3f2b70b6-0378-4920-b040-12ac657d6ca5 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:09:08.999547 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Detaching volume a7747ace-8e04-4cf1-af6d-fc077740fc9d
May 28 14:09:09.003958 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Successfully detached device vdb from instance 3f2b70b6-0378-4920-b040-12ac657d6ca5 from the live domain config.
May 28 14:09:09.006160 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:09:09.007118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7011a5a4-ec6b-43e8-b166-1c608e46d434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:09.007118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:09.007283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:09.008018 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7011a5a4-ec6b-43e8-b166-1c608e46d434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:09:09.008018 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b486e39-52bd-41f3-aad6-171ed70a071d (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434 (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b486e39-52bd-41f3-aad6-171ed70a071d (non-flash)
May 28 14:09:09.037655 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b486e39-52bd-41f3-aad6-171ed70a071d', '75')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:09:09.037655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', '74')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:09:09.038549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434', '73')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:09:09.039233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c2c9080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:09:09.039427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:09:09.039669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Flush multipath device 33000000021b28250 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:09:09.053206 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Attempting to driver detach volume a7747ace-8e04-4cf1-af6d-fc077740fc9d from mountpoint /dev/vdb
May 28 14:09:09.061495 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:09:09.062629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found disk vdb by alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:09:09.062710 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Attempting to detach device vdb from instance d6202b83-7043-4c19-81b6-13f2e5c64fef from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:09:09.062911 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:   <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:   <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]: </disk>
May 28 14:09:09.062911 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:09:09.069593 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance d6202b83-7043-4c19-81b6-13f2e5c64fef from the persistent domain config.
May 28 14:09:09.069731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] (1/8): Attempting to detach device vdb with device alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d from instance d6202b83-7043-4c19-81b6-13f2e5c64fef from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:09:09.070005 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:   <alias name="ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d"/>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-5"/>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:   <serial>a7747ace-8e04-4cf1-af6d-fc077740fc9d</serial>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]: </disk>
May 28 14:09:09.070005 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:09:09.072637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:09:09.113092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:09:09.159831 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:09:09.160055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:09:09.161177 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:09:09.167551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:09.175896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:09:09.176430 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:09:09.185428 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:09.185841 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:09.190743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:09.200520 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:09:09.202182 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:09:09.202502 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Creating image(s)
May 28 14:09:09.203197 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:09.203358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "/opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:09.203923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "/opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:09.204373 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:09.208360 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:09.210256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:09.236742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.40.100,3260]
May 28 14:09:09.236742 np0000001643 nova-compute[98269]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.40.100,3260] successful.
May 28 14:09:09.236742 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:09.240866 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:09.255979 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:09.269466 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:09.277047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:09.307245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.50.100,3260]
May 28 14:09:09.307245 np0000001643 nova-compute[98269]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-7011a5a4-ec6b-43e8-b166-1c608e46d434, portal: 192.168.50.100,3260] successful.
May 28 14:09:09.307245 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:09.326674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:09.327066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:09.327244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] <== disconnect_volume: return (320ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:09.327437 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:09:09.334387 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:09.338050 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.125s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:09.339046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:09.339576 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:09.340024 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:09.342743 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:09.343074 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:09.445627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:09.445627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:09.522221 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk 1073741824" returned: 0 in 0.075s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:09.522221 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:09.522221 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:09.550842 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:09.632353 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:09.643717 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:09.644131 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:09:09.644461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:09.689665 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:09:09.740642 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:09.741180 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Cannot resize image /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:09:09.741337 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:09:09.741548 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Ensure instance console log exists: /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:09:09.741839 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:09.742041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:09.742213 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:09.885218 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lazy-loading 'flavor' on Instance uuid 3f2b70b6-0378-4920-b040-12ac657d6ca5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:10.135064 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe3522ec-5fd3-4b29-94a3-0b1b363931f0 req-3138a50b-164d-4155-b671-5260e3d4cd3e service nova] Releasing lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:10.135605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquired lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:10.135809 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:09:10.242135 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:10.242462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:10.247007 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:09:10.247135 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Claim successful on node np0000001643
May 28 14:09:10.715263 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:10.874830 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:10.892661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-af749691-1786-4740-80bd-b3164b61a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.031s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:11.024280 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Updating instance_info_cache with network_info: [{"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:11.525380 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Releasing lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:11.525690 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Instance network_info: |[{"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:09:11.527980 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Start _get_guest_xml network_info=[{"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:09:11.531242 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:09:11.532663 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-407309817', uuid='1ca77ae6-a7dc-4176-842d-c19b0b6ffc82'), owner=OwnerMeta(userid='072a73099ec74dbd8f4253608d1d04f9', username='tempest-TestServerVolumeAttachmentScenario-1229630570-project-member', projectid='c6cef3deefeb451d897a690dd0e2529b', projectname='tempest-TestServerVolumeAttachmentScenario-1229630570'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977351.532179) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:09:11.533638 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:09:11.533944 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:09:11.535066 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:09:11.535245 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:09:11.536109 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:09:11.536597 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:09:11.536597 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:09:11.536747 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:09:11.536747 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:09:11.536863 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:09:11.536932 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:09:11.537279 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:09:11.537279 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:09:11.537279 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:09:11.538605 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:09:11.538605 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:09:11.551066 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-407309817',display_name='tempest-TestServerVolumeAttachmentScenario-server-407309817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testservervolumeattachmentscenario-server-407309817',id=37,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZfOfyM7W/rUhU1urnNBqiL6frM26EP1oog9qgPHSiazxukV9bdCe2c2cVzfv4eHFqcU6gxo6Y/nrdUQSSh8CQdxH/1+D+86X+hhFTCUQzWOX9MNfNDu5k84z479rrNvw==',key_name='tempest-keypair-1074101902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6cef3deefeb451d897a690dd0e2529b',ramdisk_id='',reservation_id='r-xiruct9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1229630570',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1229630570-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072a73099ec74dbd8f4253608d1d04f9',uuid=1ca77ae6-a7dc-4176-842d-c19b0b6ffc82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:09:11.551321 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Converting VIF {"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:11.551843 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=d310411e-f4f5-4d52-8377-6997e6441188,network=Network(61c829b2-42b5-4977-96f2-ec6fae6c3e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd310411e-f4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:11.552517 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:11.716667 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:11.716959 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:11.996956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.055403 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] End _get_guest_xml xml=<domain type="qemu">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <uuid>1ca77ae6-a7dc-4176-842d-c19b0b6ffc82</uuid>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <name>instance-00000025</name>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-407309817</nova:name>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:09:11</nova:creationTime>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:user uuid="072a73099ec74dbd8f4253608d1d04f9">tempest-TestServerVolumeAttachmentScenario-1229630570-project-member</nova:user>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:project uuid="c6cef3deefeb451d897a690dd0e2529b">tempest-TestServerVolumeAttachmentScenario-1229630570</nova:project>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         <nova:port uuid="d310411e-f4f5-4d52-8377-6997e6441188">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <system>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <entry name="serial">1ca77ae6-a7dc-4176-842d-c19b0b6ffc82</entry>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <entry name="uuid">1ca77ae6-a7dc-4176-842d-c19b0b6ffc82</entry>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </system>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <os>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   </os>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <features>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   </features>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   <devices>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk.config"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:f9:dc:0e"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <target dev="tapd310411e-f4"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </interface>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/console.log" append="off"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </serial>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <video>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </video>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </rng>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:   </devices>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]: </domain>
May 28 14:09:12.055403 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Preparing to wait for external event network-vif-plugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-407309817',display_name='tempest-TestServerVolumeAttachmentScenario-server-407309817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testservervolumeattachmentscenario-server-407309817',id=37,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZfOfyM7W/rUhU1urnNBqiL6frM26EP1oog9qgPHSiazxukV9bdCe2c2cVzfv4eHFqcU6gxo6Y/nrdUQSSh8CQdxH/1+D+86X+hhFTCUQzWOX9MNfNDu5k84z479rrNvw==',key_name='tempest-keypair-1074101902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6cef3deefeb451d897a690dd0e2529b',ramdisk_id='',reservation_id='r-xiruct9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1229630570',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1229630570-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072a73099ec74dbd8f4253608d1d04f9',uuid=1ca77ae6-a7dc-4176-842d-c19b0b6ffc82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Converting VIF {"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=d310411e-f4f5-4d52-8377-6997e6441188,network=Network(61c829b2-42b5-4977-96f2-ec6fae6c3e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd310411e-f4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=d310411e-f4f5-4d52-8377-6997e6441188,network=Network(61c829b2-42b5-4977-96f2-ec6fae6c3e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd310411e-f4') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:12.059588 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:09:12.060166 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.060166 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63b6436c-1cc1-5571-912e-45c1d2ec8b41', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:12.060921 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.062067 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:12.066534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.066748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd310411e-f4, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:12.067119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd310411e-f4, col_values=(('qos', UUID('ffea0598-8a32-4952-86a5-ce8314200e46')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:12.067257 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd310411e-f4, col_values=(('external_ids', {'iface-id': 'd310411e-f4f5-4d52-8377-6997e6441188', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:dc:0e', 'vm-uuid': '1ca77ae6-a7dc-4176-842d-c19b0b6ffc82'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:12.068133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.069418 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:12.075224 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.076404 np0000001643 nova-compute[98269]: INFO os_vif [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=d310411e-f4f5-4d52-8377-6997e6441188,network=Network(61c829b2-42b5-4977-96f2-ec6fae6c3e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd310411e-f4')
May 28 14:09:12.220001 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:12.378899 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977352.3783362, d6202b83-7043-4c19-81b6-13f2e5c64fef => ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:09:12.381029 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a7747ace-8e04-4cf1-af6d-fc077740fc9d for instance d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:09:12.384737 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully detached device vdb from instance d6202b83-7043-4c19-81b6-13f2e5c64fef from the live domain config.
May 28 14:09:12.395220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:12.395531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:12.395778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:12.395975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:12.396123 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:12.399349 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Terminating instance
May 28 14:09:12.424650 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:09:12.424937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:12.425135 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:12.425627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:12.426270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7747ace-8e04-4cf1-af6d-fc077740fc9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:09:12.426270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b486e39-52bd-41f3-aad6-171ed70a071d (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b486e39-52bd-41f3-aad6-171ed70a071d (non-flash)
May 28 14:09:12.454035 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b486e39-52bd-41f3-aad6-171ed70a071d', '75')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:09:12.454035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '63')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:09:12.454921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d', '64')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:09:12.456427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801fc9a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:09:12.456427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:09:12.456427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flush multipath device 3300000006d9dae6b {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:09:12.490599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:09:12.537115 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:09:12.578092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:09:12.578283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:09:12.579495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:09:12.591288 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:09:12.591890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:09:12.605199 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:12.637805 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.40.100,3260]
May 28 14:09:12.637805 np0000001643 nova-compute[98269]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.40.100,3260] successful.
May 28 14:09:12.637805 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:12.653494 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:12.665297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:12.702377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.50.100,3260]
May 28 14:09:12.702377 np0000001643 nova-compute[98269]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-a7747ace-8e04-4cf1-af6d-fc077740fc9d, portal: 192.168.50.100,3260] successful.
May 28 14:09:12.702377 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:12.717246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:12.717246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:12.717246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== disconnect_volume: return (292ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:12.717416 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:09:12.727976 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.485s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:12.728591 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:09:12.905403 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:09:12.934622 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.936607 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.957492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.963594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.992484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:12.996926 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:13.224789 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e3e15158-2438-4e11-b260-36ca509da766 req-85092677-c73a-491c-ad73-6613cf6a0126 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:13.225281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3e15158-2438-4e11-b260-36ca509da766 req-85092677-c73a-491c-ad73-6613cf6a0126 service nova] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:13.225281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3e15158-2438-4e11-b260-36ca509da766 req-85092677-c73a-491c-ad73-6613cf6a0126 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:13.225436 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3e15158-2438-4e11-b260-36ca509da766 req-85092677-c73a-491c-ad73-6613cf6a0126 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:13.225710 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e3e15158-2438-4e11-b260-36ca509da766 req-85092677-c73a-491c-ad73-6613cf6a0126 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] No waiting events found dispatching network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:13.226030 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e3e15158-2438-4e11-b260-36ca509da766 req-85092677-c73a-491c-ad73-6613cf6a0126 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:09:13.229116 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999732942999799 future=<Future at 0x71a75c23cfe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:13.235047 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:09:13.235267 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:09:13.235609 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:13.236139 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:13.237975 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Instance destroyed successfully.
May 28 14:09:13.239092 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lazy-loading 'resources' on Instance uuid 3f2b70b6-0378-4920-b040-12ac657d6ca5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:13.284422 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'flavor' on Instance uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:13.354663 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d64d4218444093a2b86cfdda17f742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161531d31b404ab1bc2c6c340124f03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:09:13.608614 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:13.608614 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:13.608779 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No VIF found with MAC fa:16:3e:f9:dc:0e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:09:13.610200 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Using config drive
May 28 14:09:13.740752 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:09:13.748636 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1682159225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testservervolumeattachscenariooldversion-server-1682159',id=35,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJVLiSohUhwiXqYkEOtEEf3c/LnHoK725ydBJrynWKvR15yEmPJgvA6oWwp3mEpPEvFfnxz5vbepsP2GhxfPUrN8H3Z1UpxYW5wwS2fHxX2r+VHx8Ts2T8t5jXHE3ktHw==',key_name='tempest-keypair-1102347540',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:08:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e6508d9982d4947a5e5ec3f5c04580c',ramdisk_id='',reservation_id='r-avwzg5p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fa84ba4c848478ebc210aed12edd83f',uuid=3f2b70b6-0378-4920-b040-12ac657d6ca5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:09:13.749405 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Converting VIF {"id": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "address": "fa:16:3e:28:6b:45", "network": {"id": "4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-872951102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e6508d9982d4947a5e5ec3f5c04580c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b89c9c-68", "ovs_interfaceid": "e8b89c9c-681a-4b69-aa59-d76d57ac6ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:13.750873 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:6b:45,bridge_name='br-int',has_traffic_filtering=True,id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe,network=Network(4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b89c9c-68') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:13.751157 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:6b:45,bridge_name='br-int',has_traffic_filtering=True,id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe,network=Network(4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b89c9c-68') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:09:13.751806 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0013702250003007066 future=<Future at 0x71a78048f470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:13.755469 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Emitting event <LifecycleEvent: 1779977338.750284, 90b0ea10-2b38-4907-aa11-02454a817a01 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:13.755691 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] VM Stopped (Lifecycle Event)
May 28 14:09:13.758567 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:13.759191 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.470403341999827 future=<Future at 0x71a75c23cfe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:13.759748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:13.760086 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.468614828999762 future=<Future at 0x71a75c23cfe0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:13.760360 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b89c9c-68, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:13.761470 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:13.762667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:13.769568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:13.771245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:13.771500 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ae912cb-3527-4299-943e-042eae68111c) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:13.773264 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:13.773398 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:13.780304 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:13.782580 np0000001643 nova-compute[98269]: INFO os_vif [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:6b:45,bridge_name='br-int',has_traffic_filtering=True,id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe,network=Network(4cdfbd7d-4cda-43d2-ac1b-a4e69c9f0ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b89c9c-68')
May 28 14:09:13.782956 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Deleting instance files /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5_del
May 28 14:09:13.783838 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Deletion of /opt/stack/data/nova/instances/3f2b70b6-0378-4920-b040-12ac657d6ca5_del complete
May 28 14:09:13.954512 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Successfully created port: 3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:09:14.115824 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:14.253328 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:09:14.264502 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 90b0ea10-2b38-4907-aa11-02454a817a01] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:14.295358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8ad03c04-1427-49bf-8b5d-5e31ebd3f4cb tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.798s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:14.297365 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 14:09:14.298614 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:09:14.301252 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:09:14.302797 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:09:14.304557 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:14.450770 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Creating config drive at /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk.config
May 28 14:09:14.456166 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp56wuux_6 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:14.486288 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:14.520156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp56wuux_6" returned: 0 in 0.063s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:14.537466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:14.586367 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7d758359-3261-4d22-9c58-9eb10255734e req-5cc4fc95-5850-4b28-86c4-4d5856ab17b2 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:14.586898 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d758359-3261-4d22-9c58-9eb10255734e req-5cc4fc95-5850-4b28-86c4-4d5856ab17b2 service nova] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:14.587859 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d758359-3261-4d22-9c58-9eb10255734e req-5cc4fc95-5850-4b28-86c4-4d5856ab17b2 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:14.588052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d758359-3261-4d22-9c58-9eb10255734e req-5cc4fc95-5850-4b28-86c4-4d5856ab17b2 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:14.588336 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7d758359-3261-4d22-9c58-9eb10255734e req-5cc4fc95-5850-4b28-86c4-4d5856ab17b2 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] No waiting events found dispatching network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:14.588849 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-7d758359-3261-4d22-9c58-9eb10255734e req-5cc4fc95-5850-4b28-86c4-4d5856ab17b2 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received unexpected event network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 for instance with vm_state building and task_state block_device_mapping.
May 28 14:09:14.605748 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:14.798001 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Successfully updated port: 3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:09:15.070652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.102956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.104119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.199701 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.272736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:09:15.273989 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:09:15.274258 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Creating image(s)
May 28 14:09:15.279283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:15.279533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "/opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:15.280006 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "/opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:15.280644 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:15.285539 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:15.288575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:15.306984 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:15.307146 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquired lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:15.307434 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:09:15.321764 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:15.324263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] Acquiring lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:15.324263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:15.324653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:15.325393 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] No waiting events found dispatching network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:15.325572 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-unplugged-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:09:15.325738 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Received event network-vif-deleted-e8b89c9c-681a-4b69-aa59-d76d57ac6ffe {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:15.326173 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Neutron deleted interface e8b89c9c-681a-4b69-aa59-d76d57ac6ffe; detaching it from the instance and deleting it from the info cache
May 28 14:09:15.334926 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-257d7336-0073-4c29-8859-6d8d2399aade req-25e8971d-070f-43df-974a-5a9909176865 service nova] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Detach interface failed, port_id=e8b89c9c-681a-4b69-aa59-d76d57ac6ffe, reason: Instance 3f2b70b6-0378-4920-b040-12ac657d6ca5 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:09:15.389225 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:15.389609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:15.390008 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:15.390419 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:15.392960 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:09:15.393299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:15.475568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.480269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.483832 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:15.484768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.486582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:15.510687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:15.563061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk 1073741824" returned: 0 in 0.076s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:15.563751 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:15.564561 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:15.647002 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:15.676582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.112s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:15.677113 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:09:15.677395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:15.789109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:15.789655 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Cannot resize image /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:09:15.790155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:09:15.790389 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:09:15.791082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:15.791082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:15.791082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:15.928885 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:15.987953 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977355.9875853, 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:15.988099 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] VM Started (Lifecycle Event)
May 28 14:09:16.114014 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:16.150769 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Took 1.85 seconds to deallocate network for instance.
May 28 14:09:16.290512 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Updating instance_info_cache with network_info: [{"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:16.492308 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:16.494470 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977356.4941795, 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:16.494651 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] VM Paused (Lifecycle Event)
May 28 14:09:16.657609 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-changed-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:16.657979 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:16.658159 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Refreshing instance network info cache due to event network-changed-3fe90435-7ff4-48c5-a628-b59a9de38910. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:16.658728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:16.658933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Acquiring lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:16.793135 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Releasing lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:16.793525 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Instance network_info: |[{"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:09:16.794172 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Acquired lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:16.794242 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Refreshing network info cache for port 3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:16.797121 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Start _get_guest_xml network_info=[{"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:09:16.799785 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:09:16.801278 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-339817763', uuid='4a2e0c16-dd30-4f2b-a453-8febf9221c03'), owner=OwnerMeta(userid='53d64d4218444093a2b86cfdda17f742', username='tempest-VolumesBackupsTest-654288917-project-member', projectid='161531d31b404ab1bc2c6c340124f03d', projectname='tempest-VolumesBackupsTest-654288917'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977356.8007967) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:09:16.802803 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:09:16.803189 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:09:16.804093 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:09:16.804627 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:09:16.805509 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:09:16.805618 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:09:16.807026 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:09:16.807026 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:09:16.807026 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:09:16.807026 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:09:16.807026 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:09:16.807191 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:09:16.807338 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:09:16.807643 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:09:16.807906 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:09:16.807958 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:09:16.818916 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-339817763',display_name='tempest-VolumesBackupsTest-instance-339817763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesbackupstest-instance-339817763',id=38,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw3+ysJ+EVW96rU9YP/zkligz7yP96hPgDkPaWNE6GNSAbB+hbghNeKd8h0sJDO2CM58Hc/uymcJ4H7RWntABHvuVHYCAy0qQPT/4e1E6Ows1ajJiF6JcWvEm8mvR1i/g==',key_name='tempest-keypair-1898169288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161531d31b404ab1bc2c6c340124f03d',ramdisk_id='',reservation_id='r-bobc4ry7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-654288917',owner_user_name='tempest-VolumesBackupsTest-654288917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d64d4218444093a2b86cfdda17f742',uuid=4a2e0c16-dd30-4f2b-a453-8febf9221c03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:09:16.819144 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converting VIF {"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:16.819986 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=3fe90435-7ff4-48c5-a628-b59a9de38910,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe90435-7f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:16.820841 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a2e0c16-dd30-4f2b-a453-8febf9221c03 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:16.998286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:16.999627 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:17.174633 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:17.174853 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:17.298571 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:17.323735 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] End _get_guest_xml xml=<domain type="qemu">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <uuid>4a2e0c16-dd30-4f2b-a453-8febf9221c03</uuid>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <name>instance-00000026</name>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesBackupsTest-instance-339817763</nova:name>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:09:16</nova:creationTime>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:user uuid="53d64d4218444093a2b86cfdda17f742">tempest-VolumesBackupsTest-654288917-project-member</nova:user>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:project uuid="161531d31b404ab1bc2c6c340124f03d">tempest-VolumesBackupsTest-654288917</nova:project>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         <nova:port uuid="3fe90435-7ff4-48c5-a628-b59a9de38910">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <system>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <entry name="serial">4a2e0c16-dd30-4f2b-a453-8febf9221c03</entry>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <entry name="uuid">4a2e0c16-dd30-4f2b-a453-8febf9221c03</entry>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </system>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <os>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   </os>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <features>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   </features>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   <devices>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk.config"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:e0:a2:59"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <target dev="tap3fe90435-7f"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </interface>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/console.log" append="off"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </serial>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <video>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </video>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </rng>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:   </devices>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]: </domain>
May 28 14:09:17.323735 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:09:17.325379 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Preparing to wait for external event network-vif-plugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:09:17.325379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:17.325379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:17.325379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:17.325379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-339817763',display_name='tempest-VolumesBackupsTest-instance-339817763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesbackupstest-instance-339817763',id=38,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw3+ysJ+EVW96rU9YP/zkligz7yP96hPgDkPaWNE6GNSAbB+hbghNeKd8h0sJDO2CM58Hc/uymcJ4H7RWntABHvuVHYCAy0qQPT/4e1E6Ows1ajJiF6JcWvEm8mvR1i/g==',key_name='tempest-keypair-1898169288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161531d31b404ab1bc2c6c340124f03d',ramdisk_id='',reservation_id='r-bobc4ry7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-654288917',owner_user_name='tempest-VolumesBackupsTest-654288917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d64d4218444093a2b86cfdda17f742',uuid=4a2e0c16-dd30-4f2b-a453-8febf9221c03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:09:17.325379 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converting VIF {"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:17.326024 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=3fe90435-7ff4-48c5-a628-b59a9de38910,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe90435-7f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:17.326303 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=3fe90435-7ff4-48c5-a628-b59a9de38910,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe90435-7f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:09:17.326789 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:17.327121 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:17.327434 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:09:17.328428 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:17.328675 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68fc4114-1cb8-5b4d-8122-bb51581afd0b', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:17.330735 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:17.331324 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:17.333876 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:17.333876 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fe90435-7f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:17.334667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fe90435-7f, col_values=(('qos', UUID('ba94f2ef-91a5-4715-b974-7f35bd425e8d')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:17.334667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fe90435-7f, col_values=(('external_ids', {'iface-id': '3fe90435-7ff4-48c5-a628-b59a9de38910', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a2:59', 'vm-uuid': '4a2e0c16-dd30-4f2b-a453-8febf9221c03'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:17.335591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:17.336341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:17.342473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:17.343352 np0000001643 nova-compute[98269]: INFO os_vif [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=3fe90435-7ff4-48c5-a628-b59a9de38910,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe90435-7f')
May 28 14:09:17.416650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0133675f-0296-459c-977f-074ad1216441" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:17.417535 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:17.501749 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:09:17.634176 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:17.680299 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:17.780171 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Updated VIF entry in instance network info cache for port 3fe90435-7ff4-48c5-a628-b59a9de38910. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:09:17.780603 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Updating instance_info_cache with network_info: [{"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:17.920357 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:09:18.187188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.529s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:18.236814 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Deleted allocations for instance 3f2b70b6-0378-4920-b040-12ac657d6ca5
May 28 14:09:18.282623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Releasing lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:18.282735 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-vif-plugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:18.282900 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:18.283032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:18.283260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:18.283260 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Processing event network-vif-plugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:09:18.283472 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-vif-plugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:18.283551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:18.283679 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:18.283797 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:18.284378 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:09:18.284575 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] No waiting events found dispatching network-vif-plugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:18.284710 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-aff752c9-4496-49b9-b22b-505ad02595c5 req-5599c288-6bd4-43cc-a3f5-0602d0b8b665 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received unexpected event network-vif-plugged-d310411e-f4f5-4d52-8377-6997e6441188 for instance with vm_state building and task_state spawning.
May 28 14:09:18.286903 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977358.286638, 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:18.287213 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] VM Resumed (Lifecycle Event)
May 28 14:09:18.288045 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:09:18.290891 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Instance spawned successfully.
May 28 14:09:18.291534 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:09:18.493585 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:18.493998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:18.499178 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:09:18.499178 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Claim successful on node np0000001643
May 28 14:09:18.791099 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:18.793773 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:18.801216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:18.801428 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:18.801898 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:18.802283 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:18.802637 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:18.802958 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:18.858091 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:18.858227 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:18.858296 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No VIF found with MAC fa:16:3e:e0:a2:59, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:09:18.858754 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Using config drive
May 28 14:09:19.247548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-36506974-1ca2-4d12-a9da-27fd06569c00 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273 tempest-TestServerVolumeAttachScenarioOldVersion-2004318273-project-member] Lock "3f2b70b6-0378-4920-b040-12ac657d6ca5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.852s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:19.282415 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:19.282627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:19.299526 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:09:19.309852 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Took 10.11 seconds to spawn the instance on the hypervisor.
May 28 14:09:19.310087 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:19.369221 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:19.550795 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Creating config drive at /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk.config
May 28 14:09:19.551352 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:19.559223 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphwz_urws {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:19.628399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphwz_urws" returned: 0 in 0.068s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:19.784617 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:09:19.830995 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Took 15.65 seconds to build instance.
May 28 14:09:20.111709 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:20.111709 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:20.118730 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:20.148569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:20.150312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:20.266978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:20.339153 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.170s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:20.373976 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:20.389868 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-31f54c63-c4a0-4436-9aed-fdb7c646ccec req-c7e6b53a-7167-483e-b29c-48ac6a6dd2c5 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-plugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:20.390492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-31f54c63-c4a0-4436-9aed-fdb7c646ccec req-c7e6b53a-7167-483e-b29c-48ac6a6dd2c5 service nova] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:20.390492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-31f54c63-c4a0-4436-9aed-fdb7c646ccec req-c7e6b53a-7167-483e-b29c-48ac6a6dd2c5 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:20.392152 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-31f54c63-c4a0-4436-9aed-fdb7c646ccec req-c7e6b53a-7167-483e-b29c-48ac6a6dd2c5 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:20.392416 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-31f54c63-c4a0-4436-9aed-fdb7c646ccec req-c7e6b53a-7167-483e-b29c-48ac6a6dd2c5 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Processing event network-vif-plugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:09:20.594543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:20.603249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:20.613037 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:20.629916 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:20.947192 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-changed-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:20.947397 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Refreshing instance network info cache due to event network-changed-d310411e-f4f5-4d52-8377-6997e6441188. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:20.947622 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] Acquiring lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:20.947738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] Acquired lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:20.947894 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Refreshing network info cache for port d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:21.124737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.631s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:21.125433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.756s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:21.125632 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:09:21.132566 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:09:21.132691 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Claim successful on node np0000001643
May 28 14:09:21.187175 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:09:21.187938 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977361.187574, 4a2e0c16-dd30-4f2b-a453-8febf9221c03 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:21.189369 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] VM Started (Lifecycle Event)
May 28 14:09:21.194510 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:09:21.196577 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Instance spawned successfully.
May 28 14:09:21.196958 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:09:21.454743 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:21.632100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:09:21.632732 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:09:21.632732 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:21.632952 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:21.691723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:21.698464 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:21.708581 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81cf50caaafd43ffae63aff9c9258528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4618bb9b554fb8af8f26aae95c016a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:09:21.711692 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:21.711808 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:21.712197 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:21.712529 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:21.712842 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:21.713145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:21.744278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:21.912842 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:22.139327 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:09:22.203067 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:09:22.203518 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977362.2032704, 4a2e0c16-dd30-4f2b-a453-8febf9221c03 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:22.203659 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] VM Paused (Lifecycle Event)
May 28 14:09:22.218769 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Took 6.95 seconds to spawn the instance on the hypervisor.
May 28 14:09:22.218920 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:22.246494 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Updated VIF entry in instance network info cache for port d310411e-f4f5-4d52-8377-6997e6441188. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:09:22.247098 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Updating instance_info_cache with network_info: [{"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:22.322467 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Successfully created port: b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:09:22.336549 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:22.468473 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f3f0211-ebd0-44a4-ba87-0072aa0c304c req-91245c5b-4a25-46d1-80df-15af17595aa8 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-plugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:22.468653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f3f0211-ebd0-44a4-ba87-0072aa0c304c req-91245c5b-4a25-46d1-80df-15af17595aa8 service nova] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:22.469116 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f3f0211-ebd0-44a4-ba87-0072aa0c304c req-91245c5b-4a25-46d1-80df-15af17595aa8 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:22.469305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f3f0211-ebd0-44a4-ba87-0072aa0c304c req-91245c5b-4a25-46d1-80df-15af17595aa8 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:22.469543 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f3f0211-ebd0-44a4-ba87-0072aa0c304c req-91245c5b-4a25-46d1-80df-15af17595aa8 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] No waiting events found dispatching network-vif-plugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:22.469719 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2f3f0211-ebd0-44a4-ba87-0072aa0c304c req-91245c5b-4a25-46d1-80df-15af17595aa8 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received unexpected event network-vif-plugged-3fe90435-7ff4-48c5-a628-b59a9de38910 for instance with vm_state active and task_state None.
May 28 14:09:22.643147 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:09:22.706967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:22.708933 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977362.7086723, 4a2e0c16-dd30-4f2b-a453-8febf9221c03 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:22.709076 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] VM Resumed (Lifecycle Event)
May 28 14:09:22.737780 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Took 12.54 seconds to build instance.
May 28 14:09:22.750247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-749dd041-82e0-4814-9180-ddf043594177 req-5e5a1fc4-cd3a-4f2d-b8a3-e7be83e60290 service nova] Releasing lock "refresh_cache-1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:22.760419 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:22.760705 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:22.994758 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Successfully updated port: b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:09:23.056839 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-changed-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:23.058260 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Refreshing instance network info cache due to event network-changed-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:23.058544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] Acquiring lock "refresh_cache-0133675f-0296-459c-977f-074ad1216441" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:23.058700 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] Acquired lock "refresh_cache-0133675f-0296-459c-977f-074ad1216441" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:23.058858 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Refreshing network info cache for port b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:23.149979 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Booting with volume b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 at /dev/vda
May 28 14:09:23.208917 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:23.215634 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:23.217956 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:23.221993 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:09:23.241424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5664deb5-bd09-4e5b-9471-6229d562cea2 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.056s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:23.249637 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:23.269694 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:23.295754 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:09:23.296077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:09:23.305816 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:09:23.309142 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942'] 
May 28 14:09:23.309142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:09:23.309479 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:09:23.309616 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:23.309925 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Updating existing volume attachment record: 4a6e45f0-14f2-4f84-a458-2b23e1ec8356 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:09:23.496911 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "refresh_cache-0133675f-0296-459c-977f-074ad1216441" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:23.561334 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:23.693132 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:23.790784 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.666s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:23.791271 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:09:24.208492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:24.298396 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:09:24.299029 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:09:24.299366 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:24.299635 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:24.374020 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:24.460930 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad96e52e071f4b3b9057ec1a411058b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061e1b7a86244ea1b9be96940816b397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:09:24.553476 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:24.593513 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-changed-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:24.594069 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Refreshing instance network info cache due to event network-changed-3fe90435-7ff4-48c5-a628-b59a9de38910. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:24.594300 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] Acquiring lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:24.594466 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] Acquired lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:24.594650 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Refreshing network info cache for port 3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:24.801855 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:09:24.879405 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-599ab8ba-0e8f-4dc6-bd5d-02785783779b req-32f536a6-b9db-4d34-b79d-9b37bce20b06 service nova] Releasing lock "refresh_cache-0133675f-0296-459c-977f-074ad1216441" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:24.880201 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquired lock "refresh_cache-0133675f-0296-459c-977f-074ad1216441" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:24.880496 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:09:25.098377 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:25.223658 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Successfully created port: f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:09:25.305808 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:09:25.344438 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:25.344912 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:09:25.458550 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:25.479873 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:09:25.483026 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:09:25.483026 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Creating image(s)
May 28 14:09:25.483026 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:09:25.483026 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Ensure instance console log exists: /opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:09:25.483706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:25.484286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:25.485551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:25.810067 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Booting with volume 4977f462-5866-4abc-9b09-8f7ea2ac690f at /dev/vda
May 28 14:09:25.827586 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:25.827586 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:25.827586 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:25.827937 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:09:25.828104 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:09:25.873426 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:25.887868 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:09:25.917276 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:25.935034 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:25.967125 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:09:25.967923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:09:25.981867 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:09:25.983819 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:febe:b08b', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942'] 
May 28 14:09:25.984047 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:09:25.984213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:09:25.984809 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:25.985148 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Updating existing volume attachment record: fbc1b581-de0c-40e8-874d-dcbbbbe1c4c6 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:09:25.992348 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Successfully updated port: f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:09:26.079704 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-changed-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:26.079910 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Refreshing instance network info cache due to event network-changed-f0706fd7-168f-43db-bc84-aadec652fb18. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:26.080214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] Acquiring lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:26.080293 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] Acquired lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:26.080761 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Refreshing network info cache for port f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:26.106033 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:26.214165 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Updated VIF entry in instance network info cache for port 3fe90435-7ff4-48c5-a628-b59a9de38910. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:09:26.216312 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Updating instance_info_cache with network_info: [{"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:26.272729 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Updating instance_info_cache with network_info: [{"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:26.496383 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:26.588929 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:26.670990 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:26.718800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-66ba8fba-ae43-48fe-97b7-53973eff5690 req-956eccb3-9893-4df9-83ab-66f4b4bd185e service nova] Releasing lock "refresh_cache-4a2e0c16-dd30-4f2b-a453-8febf9221c03" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:26.774715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Releasing lock "refresh_cache-0133675f-0296-459c-977f-074ad1216441" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:26.775851 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Instance network_info: |[{"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:09:26.775851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Start _get_guest_xml network_info=[{"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '4a6e45f0-14f2-4f84-a458-2b23e1ec8356', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0133675f-0296-459c-977f-074ad1216441', 'attached_at': '', 'detached_at': '', 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'serial': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'multiattach': True}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:09:26.783128 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:09:26.784407 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-2051518679', uuid='0133675f-0296-459c-977f-074ad1216441'), owner=OwnerMeta(userid='81cf50caaafd43ffae63aff9c9258528', username='tempest-AttachVolumeMultiAttachTest-1067442384-project-member', projectid='ac4618bb9b554fb8af8f26aae95c016a', projectname='tempest-AttachVolumeMultiAttachTest-1067442384'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977366.7839878) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:09:26.785752 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:09:26.786221 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:09:26.791349 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:09:26.791597 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:09:26.792951 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:09:26.793313 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:09:26.793508 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:09:26.793618 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:09:26.793771 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:09:26.793896 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:09:26.794045 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:09:26.794249 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:09:26.794401 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:09:26.803582 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:09:26.803582 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:09:26.803582 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:09:26.821617 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:09:26.822118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:26.822214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:26.822641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:26.822895 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:09:26.828184 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:26.828678 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:09:26.836541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:26.837646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:26.838124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:26.838364 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:09:26.838932 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:26.839174 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:09:26.855741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:09:26.855741 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:26.867050 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:09:26.867050 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0] added
May 28 14:09:26.878132 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:26.878132 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:09:26.878132 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:09:26.884197 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0] added
May 28 14:09:26.884197 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:09:26.884197 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:26.884197 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:26.884197 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:26.884197 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:26.884197 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:26.884557 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:09:26.884760 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0455(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:09:26.884968 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:09:26.895952 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:27.338675 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:27.399463 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f1d6c966-cbd8-43f9-8e2a-77ef972698d9 req-e878f854-0472-49d0-a4b1-618e524c89de service nova] Releasing lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:27.399857 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquired lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:27.400407 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:09:27.827051 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:27.827542 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:09:27.877111 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:09:27.885547 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:09:27.888971 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:09:27.888971 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:09:27.898318 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:09:27.898318 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:27.910646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:27.914646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:27.923479 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.923479 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.923479 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:27.923479 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.923479 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.923479 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:27.932905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.932905 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.932905 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:27.933411 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.933411 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.933411 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:27.964978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.40.100,3260]
May 28 14:09:27.964978 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.40.100,3260] successful.
May 28 14:09:27.964978 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:27.978284 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:27.989184 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:27.991071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.50.100,3260]
May 28 14:09:27.991071 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.50.100,3260] successful.
May 28 14:09:27.991071 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:27.997752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.997752 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.997752 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:27.997752 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:27.997752 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:27.999260 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('7', '-', '-', 0) found on session 76 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:09:27.999260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:09:28.006703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:28.020931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 76 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:28.021213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:09:28.023366 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:28.023366 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:28.023366 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:28.023366 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:28.023366 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:28.023535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:28.023535 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:28.023535 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:28.023535 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:28.023535 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:28.023859 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:28.024015 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:09:28.024765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] HCTL ('8', '-', '-', 0) found on session 77 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:09:28.024921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:09:28.041849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Searching for a device in session 77 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:28.041849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:09:28.161014 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:09:28.163532 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:09:28.163957 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Creating image(s)
May 28 14:09:28.164463 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:09:28.166465 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Ensure instance console log exists: /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:09:28.166465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:28.166465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:28.166465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:28.199611 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:28.229142 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004445120002856129 future=<Future at 0x71a75c23cfe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:28.230059 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] Emitting event <LifecycleEvent: 1779977353.2285955, 3f2b70b6-0378-4920-b040-12ac657d6ca5 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:28.230331 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:28.230513 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] VM Stopped (Lifecycle Event)
May 28 14:09:28.300267 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:28.454243 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Updating instance_info_cache with network_info: [{"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:28.733718 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70fed83e-ab93-4eeb-b745-f2b62d4c976d tempest-ServerActionsTestOtherA-354716614 tempest-ServerActionsTestOtherA-354716614-project-member] [instance: 3f2b70b6-0378-4920-b040-12ac657d6ca5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:28.826885 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:28.839754 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:09:28.956863 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Releasing lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:28.957179 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance network_info: |[{"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:09:28.958243 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Start _get_guest_xml network_info=[{"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'fbc1b581-de0c-40e8-874d-dcbbbbe1c4c6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd1db720f-ec51-4cb4-9ca9-60844350d239', 'attached_at': '', 'detached_at': '', 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'serial': '4977f462-5866-4abc-9b09-8f7ea2ac690f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:09:28.960895 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:09:28.962092 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1969542837', uuid='d1db720f-ec51-4cb4-9ca9-60844350d239'), owner=OwnerMeta(userid='ad96e52e071f4b3b9057ec1a411058b4', username='tempest-ServerActionsV293TestJSON-537604347-project-member', projectid='061e1b7a86244ea1b9be96940816b397', projectname='tempest-ServerActionsV293TestJSON-537604347'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977368.9617226) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:09:28.963514 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:09:28.963895 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:09:28.964942 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:09:28.965179 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:09:28.966300 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:09:28.966585 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:09:28.966790 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:09:28.967011 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:09:28.967154 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:09:28.967290 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:09:28.967387 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:09:28.967587 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:09:28.967754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:09:28.967865 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:09:28.968060 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:09:28.968241 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:09:28.982571 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:09:28.983004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:28.983004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:29.331869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:29.332032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:29.332214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:29.332432 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:09:29.564848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:29.858973 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Found WWN 3300000008a0657e2 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:09:29.859399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:29.859485 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000008a0657e2', 'path': '/dev/dm-0', 'multipath_id': '3300000008a0657e2'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:29.859637 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a0657e2', 'path': '/dev/dm-0', 'multipath_id': '3300000008a0657e2'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:09:29.860373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.877s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:29.861572 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:09:29.876490 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:29.876984 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:29.877219 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:09:29.879078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:29.881317 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:29.881317 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:09:29.892960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:09:29.892960 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:29.902924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:09:29.902924 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:29.911884 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f] added
May 28 14:09:29.911884 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:09:29.911884 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:29.911884 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:29.911884 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:29.911884 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:29.911884 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:29.912251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:09:29.912314 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:09:29.912507 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:09:29.917357 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f] added
May 28 14:09:29.917357 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:09:29.917357 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:29.917357 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:29.917357 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:09:29.917357 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:09:29.917357 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:29.917698 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:09:29.917756 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0378(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:09:29.917931 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:09:30.373598 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-2051518679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumemultiattachtest-server-2051518679',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-cfvzj9rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:23Z,user_data=None,user_id='81cf50caaafd43ffae63aff9c9258528',uuid=0133675f-0296-459c-977f-074ad1216441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:09:30.375247 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:30.376061 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5eba3ba-d4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:30.376912 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'pci_devices' on Instance uuid 0133675f-0296-459c-977f-074ad1216441 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:30.380052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:30.490474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:30.491129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:30.613389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:30.617663 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:30.734106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:30.734924 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:30.851156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:30.885005 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] End _get_guest_xml xml=<domain type="qemu">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <uuid>0133675f-0296-459c-977f-074ad1216441</uuid>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <name>instance-00000027</name>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-2051518679</nova:name>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:09:26</nova:creationTime>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:user uuid="81cf50caaafd43ffae63aff9c9258528">tempest-AttachVolumeMultiAttachTest-1067442384-project-member</nova:user>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:project uuid="ac4618bb9b554fb8af8f26aae95c016a">tempest-AttachVolumeMultiAttachTest-1067442384</nova:project>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         <nova:port uuid="b5eba3ba-d4a5-4992-8f6d-b608f4bef76b">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <system>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <entry name="serial">0133675f-0296-459c-977f-074ad1216441</entry>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <entry name="uuid">0133675f-0296-459c-977f-074ad1216441</entry>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </system>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <os>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   </os>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <features>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   </features>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   <devices>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441/disk.config"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <alias name="ua-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <serial>b23f2ec7-a74d-40b2-a47f-5bbec3950eb0</serial>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <shareable/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:bb:8c:ff"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <target dev="tapb5eba3ba-d4"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </interface>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441/console.log" append="off"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </serial>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <video>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </video>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </rng>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:   </devices>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]: </domain>
May 28 14:09:30.885005 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:09:30.889062 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:30.902681 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Preparing to wait for external event network-vif-plugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:09:30.904481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:30.906816 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0133675f-0296-459c-977f-074ad1216441-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:30.907418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:30.907861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:30.910342 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-2051518679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumemultiattachtest-server-2051518679',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-cfvzj9rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:23Z,user_data=None,user_id='81cf50caaafd43ffae63aff9c9258528',uuid=0133675f-0296-459c-977f-074ad1216441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:09:30.910768 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:30.912058 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5eba3ba-d4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:30.912437 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5eba3ba-d4') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:09:30.914734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:30.915222 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:30.915775 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:09:30.918130 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:09:30.921031 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:09:30.925885 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:30.928960 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f453f20b-6bb5-530b-8e38-1b839058e9d2', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:30.931999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:30.938786 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:09:30.939012 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:09:30.939012 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:30.942716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5eba3ba-d4, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:30.942716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5eba3ba-d4, col_values=(('qos', UUID('f15d85c8-6692-4468-8494-0f7bcd963176')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:30.942716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5eba3ba-d4, col_values=(('external_ids', {'iface-id': 'b5eba3ba-d4a5-4992-8f6d-b608f4bef76b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:8c:ff', 'vm-uuid': '0133675f-0296-459c-977f-074ad1216441'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:30.944243 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:09:30.946884 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:09:30.946884 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:30.951801 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:30.951801 np0000001643 nova-compute[98269]: INFO os_vif [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5eba3ba-d4')
May 28 14:09:30.960024 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:30.969478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:30.980205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.980205 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.980205 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.980205 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.980205 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:30.980633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.980633 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.980633 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.980633 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.980633 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:30.990095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.990095 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.990095 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.990095 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.990095 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:30.990391 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.990391 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:30.990391 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.990391 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:30.990391 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:31.008158 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.009395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.029012 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260]
May 28 14:09:31.029012 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260] successful.
May 28 14:09:31.029012 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:31.047125 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:31.052986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260]
May 28 14:09:31.052986 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260] successful.
May 28 14:09:31.052986 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.075496 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:31.076010 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:31.076487 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:31.076808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:09:31.080490 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] HCTL ('11', '-', '-', 0) found on session 78 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:09:31.080490 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:31.096782 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:31.096782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:31.097383 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:09:31.102642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] HCTL ('12', '-', '-', 0) found on session 79 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:09:31.102926 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:09:31.115021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching for a device in session 78 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:31.115328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:09:31.123289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching for a device in session 79 and hctl ['12', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:31.140947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.147537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.281144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.282139 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.405040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.411913 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:09:31.418490 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.529888 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.530878 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.641232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.648283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.755809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.756763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.878886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.886243 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:09:31.889692 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:31.949039 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:31.949822 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=11767MB free_disk=73.11843490600586GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:09:31.950155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:31.950511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:32.124175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching for a device in session 79 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:09:32.124355 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:09:32.483498 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:32.483644 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:32.483855 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] No VIF found with MAC fa:16:3e:bb:8c:ff, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:09:32.484343 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Using config drive
May 28 14:09:32.900924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Found WWN 3300000001ce0f605 for multipath device dm-6 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:09:32.901334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:32.901753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] <== connect_volume: return (3918ms) {'type': 'block', 'scsi_wwn': '3300000001ce0f605', 'path': '/dev/dm-6', 'multipath_id': '3300000001ce0f605'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:32.901815 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001ce0f605', 'path': '/dev/dm-6', 'multipath_id': '3300000001ce0f605'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:09:32.994416 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:33.047794 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 27823c45-9fce-41b2-923b-a5a907ef029c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.047894 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.048043 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0cb5afe2-5125-4261-b2f3-f0431bc65134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.048142 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 512a75c8-713d-418b-adc8-07b2bf513923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.048248 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d6202b83-7043-4c19-81b6-13f2e5c64fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.048345 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.048423 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.049811 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0133675f-0296-459c-977f-074ad1216441 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.049811 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d1db720f-ec51-4cb4-9ca9-60844350d239 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:09:33.049811 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:09:33.049811 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=2368MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:09:31 up 36 min,  2 users,  load average: 6.79, 7.27, 4.36\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_ac4618bb9b554fb8af8f26aae95c016a': '6', 'io_workload': '2', 'num_proj_c6cef3deefeb451d897a690dd0e2529b': '1', 'num_proj_161531d31b404ab1bc2c6c340124f03d': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_061e1b7a86244ea1b9be96940816b397': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:09:33.174919 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Creating config drive at /opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441/disk.config
May 28 14:09:33.181999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbrthcx0y {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:33.252220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbrthcx0y" returned: 0 in 0.069s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:33.408329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1969542837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionsv293testjson-server-1969542837',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWqUmazuWr5QAW+GKtq0415oQwe6/xm6gDlnVvRcqD/QtIWC8P3QDTb7VtkMt79wsvUYrKGtnMX+YVcnq7jhlbr4oQd5Vly4UXaqyN3WNt0Xd3z6c1g+S5TRBr8pq0wWw==',key_name='tempest-keypair-1994480753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='061e1b7a86244ea1b9be96940816b397',ramdisk_id='',reservation_id='r-eaidfmmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-537604347',owner_user_name='tempest-ServerActionsV293TestJSON-537604347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad96e52e071f4b3b9057ec1a411058b4',uuid=d1db720f-ec51-4cb4-9ca9-60844350d239,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:09:33.411473 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converting VIF {"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:33.411473 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:33.411473 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lazy-loading 'pci_devices' on Instance uuid d1db720f-ec51-4cb4-9ca9-60844350d239 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:33.635572 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:33.635886 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:33.738863 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.771970 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.868143 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.919080 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] End _get_guest_xml xml=<domain type="qemu">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <uuid>d1db720f-ec51-4cb4-9ca9-60844350d239</uuid>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <name>instance-00000028</name>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1969542837</nova:name>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:09:28</nova:creationTime>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:user uuid="ad96e52e071f4b3b9057ec1a411058b4">tempest-ServerActionsV293TestJSON-537604347-project-member</nova:user>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:project uuid="061e1b7a86244ea1b9be96940816b397">tempest-ServerActionsV293TestJSON-537604347</nova:project>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         <nova:port uuid="f0706fd7-168f-43db-bc84-aadec652fb18">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <system>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <entry name="serial">d1db720f-ec51-4cb4-9ca9-60844350d239</entry>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <entry name="uuid">d1db720f-ec51-4cb4-9ca9-60844350d239</entry>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </system>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <os>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   </os>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <features>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   </features>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   <devices>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <alias name="ua-4977f462-5866-4abc-9b09-8f7ea2ac690f"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-6"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <serial>4977f462-5866-4abc-9b09-8f7ea2ac690f</serial>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </disk>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:5b:b4:48"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <target dev="tapf0706fd7-16"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </interface>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/console.log" append="off"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </serial>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <video>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </video>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </rng>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:   </devices>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]: </domain>
May 28 14:09:33.919080 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:09:33.927332 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Preparing to wait for external event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:09:33.927332 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:33.927332 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:33.927332 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:33.927332 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1969542837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionsv293testjson-server-1969542837',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWqUmazuWr5QAW+GKtq0415oQwe6/xm6gDlnVvRcqD/QtIWC8P3QDTb7VtkMt79wsvUYrKGtnMX+YVcnq7jhlbr4oQd5Vly4UXaqyN3WNt0Xd3z6c1g+S5TRBr8pq0wWw==',key_name='tempest-keypair-1994480753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='061e1b7a86244ea1b9be96940816b397',ramdisk_id='',reservation_id='r-eaidfmmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-537604347',owner_user_name='tempest-ServerActionsV293TestJSON-537604347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad96e52e071f4b3b9057ec1a411058b4',uuid=d1db720f-ec51-4cb4-9ca9-60844350d239,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:09:33.927332 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converting VIF {"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:33.927332 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:33.928706 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:09:33.931865 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.932078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:33.932402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:09:33.933950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.937352 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cca9b2d-3e67-5eab-8ca0-2b651acc8eb6', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:33.940183 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.942147 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:33.944168 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.944434 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0706fd7-16, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:33.945134 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0706fd7-16, col_values=(('qos', UUID('323ceaaf-ac23-4a87-b8a0-c767e8500fd8')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:33.945547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0706fd7-16, col_values=(('external_ids', {'iface-id': 'f0706fd7-168f-43db-bc84-aadec652fb18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b4:48', 'vm-uuid': 'd1db720f-ec51-4cb4-9ca9-60844350d239'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:33.948255 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.949432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:33.953739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.955524 np0000001643 nova-compute[98269]: INFO os_vif [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16')
May 28 14:09:33.972801 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:33.978265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:34.139766 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:34.156495 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-97860230-7479-4546-a83a-2d1dd6bdf4d1 req-de25f4bb-d840-4686-9873-13012e11bfcf service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-vif-plugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:34.156495 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-97860230-7479-4546-a83a-2d1dd6bdf4d1 req-de25f4bb-d840-4686-9873-13012e11bfcf service nova] Acquiring lock "0133675f-0296-459c-977f-074ad1216441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:34.156495 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-97860230-7479-4546-a83a-2d1dd6bdf4d1 req-de25f4bb-d840-4686-9873-13012e11bfcf service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:34.157931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-97860230-7479-4546-a83a-2d1dd6bdf4d1 req-de25f4bb-d840-4686-9873-13012e11bfcf service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:34.157931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-97860230-7479-4546-a83a-2d1dd6bdf4d1 req-de25f4bb-d840-4686-9873-13012e11bfcf service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Processing event network-vif-plugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:09:34.567476 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:34.650440 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:09:34.650633 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.700s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:34.651201 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:09:34.703926 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977374.703462, 0133675f-0296-459c-977f-074ad1216441 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:34.704086 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] VM Started (Lifecycle Event)
May 28 14:09:34.705616 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:09:34.714300 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:09:34.719664 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0133675f-0296-459c-977f-074ad1216441] Instance spawned successfully.
May 28 14:09:34.721182 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:09:35.025880 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:35.207115 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:35.209898 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:35.231810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:35.231810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:35.231810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:35.231810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:35.231810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:35.231810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:35.484389 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:35.484389 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:09:35.484389 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No VIF found with MAC fa:16:3e:5b:b4:48, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:09:35.484780 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Using config drive
May 28 14:09:35.647228 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:09:35.647699 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.18 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:09:35.714539 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:09:35.714817 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977375.7144964, 0133675f-0296-459c-977f-074ad1216441 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:35.714817 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] VM Paused (Lifecycle Event)
May 28 14:09:35.745202 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Took 10.26 seconds to spawn the instance on the hypervisor.
May 28 14:09:35.745409 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:35.994093 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:36.155379 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Creating config drive at /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config
May 28 14:09:36.160018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvc1lcb9n {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:36.222056 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:36.228184 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977376.2278185, 0133675f-0296-459c-977f-074ad1216441 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:36.228392 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] VM Resumed (Lifecycle Event)
May 28 14:09:36.241751 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-710edaf6-dd16-4164-b23c-d13cd86cbf45 req-1a1bd4fd-f74b-4dd8-9c4c-c9da5f9aa4ef service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-vif-plugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:36.243972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvc1lcb9n" returned: 0 in 0.081s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:09:36.243972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-710edaf6-dd16-4164-b23c-d13cd86cbf45 req-1a1bd4fd-f74b-4dd8-9c4c-c9da5f9aa4ef service nova] Acquiring lock "0133675f-0296-459c-977f-074ad1216441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:36.243972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-710edaf6-dd16-4164-b23c-d13cd86cbf45 req-1a1bd4fd-f74b-4dd8-9c4c-c9da5f9aa4ef service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:36.243972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-710edaf6-dd16-4164-b23c-d13cd86cbf45 req-1a1bd4fd-f74b-4dd8-9c4c-c9da5f9aa4ef service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:36.243972 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-710edaf6-dd16-4164-b23c-d13cd86cbf45 req-1a1bd4fd-f74b-4dd8-9c4c-c9da5f9aa4ef service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] No waiting events found dispatching network-vif-plugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:36.243972 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-710edaf6-dd16-4164-b23c-d13cd86cbf45 req-1a1bd4fd-f74b-4dd8-9c4c-c9da5f9aa4ef service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received unexpected event network-vif-plugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b for instance with vm_state active and task_state None.
May 28 14:09:36.262401 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Took 17.84 seconds to build instance.
May 28 14:09:36.733664 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:36.739601 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0133675f-0296-459c-977f-074ad1216441] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:36.767776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-177da97f-6354-4b1b-aaec-0ab79fd02e53 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.350s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:36.776053 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:36.808078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:36.809532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:36.912429 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:37.145782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:37.150111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:37.174744 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:37.260301 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:37.745803 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977377.74541, d1db720f-ec51-4cb4-9ca9-60844350d239 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:37.746105 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] VM Started (Lifecycle Event)
May 28 14:09:37.861437 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-524dc03d-81d3-45ea-bcfc-63ec9fee78de req-4bb9467c-b9be-4b7f-91b9-336e464d3917 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:37.861992 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-524dc03d-81d3-45ea-bcfc-63ec9fee78de req-4bb9467c-b9be-4b7f-91b9-336e464d3917 service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:37.862255 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-524dc03d-81d3-45ea-bcfc-63ec9fee78de req-4bb9467c-b9be-4b7f-91b9-336e464d3917 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:37.862530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-524dc03d-81d3-45ea-bcfc-63ec9fee78de req-4bb9467c-b9be-4b7f-91b9-336e464d3917 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:37.862733 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-524dc03d-81d3-45ea-bcfc-63ec9fee78de req-4bb9467c-b9be-4b7f-91b9-336e464d3917 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Processing event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:09:37.863910 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:09:37.870857 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:09:37.876401 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance spawned successfully.
May 28 14:09:37.876825 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:09:38.249462 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:38.254566 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:38.393267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:38.393267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:38.393267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:38.393267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:38.393267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:38.393267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:09:38.754349 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:09:38.754766 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977378.7544901, d1db720f-ec51-4cb4-9ca9-60844350d239 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:38.754954 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] VM Paused (Lifecycle Event)
May 28 14:09:38.898697 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Took 10.74 seconds to spawn the instance on the hypervisor.
May 28 14:09:38.898806 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:38.947426 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:39.260550 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:39.264335 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977379.263564, d1db720f-ec51-4cb4-9ca9-60844350d239 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:39.264335 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] VM Resumed (Lifecycle Event)
May 28 14:09:39.413787 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Took 19.12 seconds to build instance.
May 28 14:09:39.572289 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:39.767675 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:39.772510 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:09:39.915519 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.633s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:39.984263 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2e54e5b1-48d8-4301-a838-ac310e6e0040 req-31b22e78-92da-4e2e-a60e-8d384ba02f01 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:39.985347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2e54e5b1-48d8-4301-a838-ac310e6e0040 req-31b22e78-92da-4e2e-a60e-8d384ba02f01 service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:39.985581 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2e54e5b1-48d8-4301-a838-ac310e6e0040 req-31b22e78-92da-4e2e-a60e-8d384ba02f01 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:39.985714 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2e54e5b1-48d8-4301-a838-ac310e6e0040 req-31b22e78-92da-4e2e-a60e-8d384ba02f01 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:39.985883 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2e54e5b1-48d8-4301-a838-ac310e6e0040 req-31b22e78-92da-4e2e-a60e-8d384ba02f01 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] No waiting events found dispatching network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:39.986074 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2e54e5b1-48d8-4301-a838-ac310e6e0040 req-31b22e78-92da-4e2e-a60e-8d384ba02f01 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received unexpected event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 for instance with vm_state active and task_state None.
May 28 14:09:41.073465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0133675f-0296-459c-977f-074ad1216441" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:41.073906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:41.073906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0133675f-0296-459c-977f-074ad1216441-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:41.074107 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:41.074171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:41.076875 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Terminating instance
May 28 14:09:41.580982 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:09:41.611500 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:41.613601 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:41.644195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:41.828750 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-16e7ea1d-8bf7-4f6f-a116-a1ebc3469423 req-c9082f12-1df2-4eac-834d-7adc63fa3514 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-vif-unplugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:41.828985 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-16e7ea1d-8bf7-4f6f-a116-a1ebc3469423 req-c9082f12-1df2-4eac-834d-7adc63fa3514 service nova] Acquiring lock "0133675f-0296-459c-977f-074ad1216441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:41.829119 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-16e7ea1d-8bf7-4f6f-a116-a1ebc3469423 req-c9082f12-1df2-4eac-834d-7adc63fa3514 service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:41.829307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-16e7ea1d-8bf7-4f6f-a116-a1ebc3469423 req-c9082f12-1df2-4eac-834d-7adc63fa3514 service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:41.829464 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-16e7ea1d-8bf7-4f6f-a116-a1ebc3469423 req-c9082f12-1df2-4eac-834d-7adc63fa3514 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] No waiting events found dispatching network-vif-unplugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:41.829611 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-16e7ea1d-8bf7-4f6f-a116-a1ebc3469423 req-c9082f12-1df2-4eac-834d-7adc63fa3514 service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-vif-unplugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:09:41.832299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:41.840711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:41.941579 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998771863000002 future=<Future at 0x71a75c7903b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:41.941849 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998119467999913 future=<Future at 0x71a75c7903b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:41.942316 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.997870404999958 future=<Future at 0x71a75c7903b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:41.948178 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0133675f-0296-459c-977f-074ad1216441] Instance destroyed successfully.
May 28 14:09:41.948802 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'resources' on Instance uuid 0133675f-0296-459c-977f-074ad1216441 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:42.090848 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-changed-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:42.091368 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Refreshing instance network info cache due to event network-changed-f0706fd7-168f-43db-bc84-aadec652fb18. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:42.091368 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] Acquiring lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:42.091368 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] Acquired lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:42.091547 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Refreshing network info cache for port f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:42.456643 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-2051518679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumemultiattachtest-server-2051518679',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:09:35Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-cfvzj9rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:09:36Z,user_data=None,user_id='81cf50caaafd43ffae63aff9c9258528',uuid=0133675f-0296-459c-977f-074ad1216441,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:09:42.457001 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "address": "fa:16:3e:bb:8c:ff", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5eba3ba-d4", "ovs_interfaceid": "b5eba3ba-d4a5-4992-8f6d-b608f4bef76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:42.457838 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5eba3ba-d4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:42.459015 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5eba3ba-d4') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:09:42.461604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:42.461604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5eba3ba-d4, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:42.471049 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:42.473005 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:42.473823 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:42.474626 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:42.474883 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f15d85c8-6692-4468-8494-0f7bcd963176) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:42.475682 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:42.476204 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:42.478640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:42.480729 np0000001643 nova-compute[98269]: INFO os_vif [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5eba3ba-d4')
May 28 14:09:42.544529 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:09:42.544529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:42.544529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:09:42.544529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:09:42.544529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:09:42.544529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:09:42.573115 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:42.573115 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:42.573115 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:42.573115 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:42.573115 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:42.573115 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:42.573115 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:09:42.573555 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:42.573555 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:09:42.573555 np0000001643 nova-compute[98269]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:42.573555 np0000001643 nova-compute[98269]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0 (non-flash)
May 28 14:09:42.573555 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:42.573555 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:09:42.573555 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:09:42.573555 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '79')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:09:42.573934 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', '76')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:09:42.574795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0', '77')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:09:42.578261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780dcf9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:09:42.579055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:09:42.579379 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flush multipath device 3300000008a0657e2 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:09:42.598086 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:42.650476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:09:42.691076 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:09:42.743537 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:09:42.743689 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:09:42.744886 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:09:42.758593 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:09:42.758771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:09:42.770969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:42.800547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.40.100,3260]
May 28 14:09:42.800547 np0000001643 nova-compute[98269]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.40.100,3260] successful.
May 28 14:09:42.800547 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:42.816422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:42.827275 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:42.863094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.50.100,3260]
May 28 14:09:42.863094 np0000001643 nova-compute[98269]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-b23f2ec7-a74d-40b2-a47f-5bbec3950eb0, portal: 192.168.50.100,3260] successful.
May 28 14:09:42.863094 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:42.880839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:09:42.881073 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:09:42.881243 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== disconnect_volume: return (338ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:42.881405 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:09:42.881729 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Deleting instance files /opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441_del
May 28 14:09:42.882249 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Deletion of /opt/stack/data/nova/instances/0133675f-0296-459c-977f-074ad1216441_del complete
May 28 14:09:42.993997 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:43.144995 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Updated VIF entry in instance network info cache for port f0706fd7-168f-43db-bc84-aadec652fb18. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:09:43.145368 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Updating instance_info_cache with network_info: [{"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:43.392565 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Took 1.81 seconds to destroy the instance on the hypervisor.
May 28 14:09:43.394212 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:09:43.394465 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 0133675f-0296-459c-977f-074ad1216441] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:09:43.394638 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0133675f-0296-459c-977f-074ad1216441] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:09:43.394951 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:43.484997 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:43.648963 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2d6ae695-520b-43d7-af61-734100eb032d req-9278e45a-402a-44d3-8dfd-ef375223248d service nova] Releasing lock "refresh_cache-d1db720f-ec51-4cb4-9ca9-60844350d239" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:09:43.913934 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-vif-unplugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:43.914465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] Acquiring lock "0133675f-0296-459c-977f-074ad1216441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:43.914611 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:43.914719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] Lock "0133675f-0296-459c-977f-074ad1216441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:43.914861 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] No waiting events found dispatching network-vif-unplugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:43.914994 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-vif-unplugged-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:09:43.915144 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Received event network-vif-deleted-b5eba3ba-d4a5-4992-8f6d-b608f4bef76b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:43.915247 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Neutron deleted interface b5eba3ba-d4a5-4992-8f6d-b608f4bef76b; detaching it from the instance and deleting it from the info cache
May 28 14:09:43.916629 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ba24c2-f958-4625-98b5-0642ede0389e req-0007155e-2c62-40c6-a816-6801320b09eb service nova] [instance: 0133675f-0296-459c-977f-074ad1216441] Detach interface failed, port_id=b5eba3ba-d4a5-4992-8f6d-b608f4bef76b, reason: Instance 0133675f-0296-459c-977f-074ad1216441 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:09:44.322257 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0133675f-0296-459c-977f-074ad1216441] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:44.377461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:44.587611 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:44.825233 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 0133675f-0296-459c-977f-074ad1216441] Took 1.43 seconds to deallocate network for instance.
May 28 14:09:45.383311 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Took 0.56 seconds to detach 1 volumes for instance.
May 28 14:09:45.888482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:45.888605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:46.133592 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:46.390935 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:46.391430 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:46.894211 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:47.403528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.513s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:47.475540 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocations for instance 0133675f-0296-459c-977f-074ad1216441
May 28 14:09:47.476602 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:48.485420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7b781f7f-c617-404e-b955-e3ae039d04ad tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0133675f-0296-459c-977f-074ad1216441" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.411s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:49.244335 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:49.591231 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:49.956437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:51.490594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:52.479569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:52.958298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:52.959269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:52.959539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:52.959743 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:52.959913 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:52.966206 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Terminating instance
May 28 14:09:53.472871 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:09:53.503891 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:53.508380 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:53.533868 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:53.546905 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:53.547633 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:53.722039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:53.730259 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:53.764780 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cb26d9a6-c73b-465b-b0ac-63139e6a4fe2 req-b95b94fc-b88a-4cd6-a66b-6b66f84369fe service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:53.767260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cb26d9a6-c73b-465b-b0ac-63139e6a4fe2 req-b95b94fc-b88a-4cd6-a66b-6b66f84369fe service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:53.767260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cb26d9a6-c73b-465b-b0ac-63139e6a4fe2 req-b95b94fc-b88a-4cd6-a66b-6b66f84369fe service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:53.768303 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cb26d9a6-c73b-465b-b0ac-63139e6a4fe2 req-b95b94fc-b88a-4cd6-a66b-6b66f84369fe service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:53.768816 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cb26d9a6-c73b-465b-b0ac-63139e6a4fe2 req-b95b94fc-b88a-4cd6-a66b-6b66f84369fe service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] No waiting events found dispatching network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:53.769193 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cb26d9a6-c73b-465b-b0ac-63139e6a4fe2 req-b95b94fc-b88a-4cd6-a66b-6b66f84369fe service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:09:53.820582 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:53.829961 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:53.855736 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999562636000064 future=<Future at 0x71a75c36e870 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:53.860054 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Instance destroyed successfully.
May 28 14:09:53.860552 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'resources' on Instance uuid d6202b83-7043-4c19-81b6-13f2e5c64fef {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:54.049412 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:09:54.364810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=32,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:08:34Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-zh8rv90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=d6202b83-7043-4c19-81b6-13f2e5c64fef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:09:54.364810 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "address": "fa:16:3e:be:b0:8b", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e595d6c-88", "ovs_interfaceid": "8e595d6c-8803-4a5b-9a05-b21d4c21b3d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:09:54.364810 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:09:54.364810 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:09:54.369200 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:54.370303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e595d6c-88, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:54.370662 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:54.371993 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:54.373591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:54.373832 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b62c6ab-b8e3-4340-8850-56b20834ead4) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:09:54.375484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:54.375484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:09:54.375484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:54.377622 np0000001643 nova-compute[98269]: INFO os_vif [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:b0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e595d6c-88')
May 28 14:09:54.380466 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Deleting instance files /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_del
May 28 14:09:54.386336 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Deletion of /opt/stack/data/nova/instances/d6202b83-7043-4c19-81b6-13f2e5c64fef_del complete
May 28 14:09:54.594927 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:54.614733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:54.615601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:54.619059 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:09:54.621993 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Claim successful on node np0000001643
May 28 14:09:54.893535 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 14:09:54.894076 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:09:54.894524 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:09:54.894703 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:09:54.895025 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:55.023962 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:55.581209 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-59a56815-5739-4c04-9362-daa217cf375f req-1b92b04c-d3a6-4baf-87dc-3250fb2cd871 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-deleted-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:55.581885 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-59a56815-5739-4c04-9362-daa217cf375f req-1b92b04c-d3a6-4baf-87dc-3250fb2cd871 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Neutron deleted interface 8e595d6c-8803-4a5b-9a05-b21d4c21b3d2; detaching it from the instance and deleting it from the info cache
May 28 14:09:55.584485 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-59a56815-5739-4c04-9362-daa217cf375f req-1b92b04c-d3a6-4baf-87dc-3250fb2cd871 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Detach interface failed, port_id=8e595d6c-8803-4a5b-9a05-b21d4c21b3d2, reason: Instance d6202b83-7043-4c19-81b6-13f2e5c64fef could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:09:55.837106 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b04c1904-0e4b-4e66-b54c-4a7811242ebc req-56ec17d3-22fc-48b3-848b-b1a428a7ee16 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:55.837483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b04c1904-0e4b-4e66-b54c-4a7811242ebc req-56ec17d3-22fc-48b3-848b-b1a428a7ee16 service nova] Acquiring lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:55.837716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b04c1904-0e4b-4e66-b54c-4a7811242ebc req-56ec17d3-22fc-48b3-848b-b1a428a7ee16 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:55.837769 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b04c1904-0e4b-4e66-b54c-4a7811242ebc req-56ec17d3-22fc-48b3-848b-b1a428a7ee16 service nova] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:55.837922 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b04c1904-0e4b-4e66-b54c-4a7811242ebc req-56ec17d3-22fc-48b3-848b-b1a428a7ee16 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] No waiting events found dispatching network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:09:55.838018 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b04c1904-0e4b-4e66-b54c-4a7811242ebc req-56ec17d3-22fc-48b3-848b-b1a428a7ee16 service nova] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Received event network-vif-unplugged-8e595d6c-8803-4a5b-9a05-b21d4c21b3d2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:09:56.016648 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:56.082214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:56.082461 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:56.212044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:56.212044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:56.519530 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Took 1.62 seconds to deallocate network for instance.
May 28 14:09:56.585147 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:56.717404 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:09:56.940288 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00033196599997609155 future=<Future at 0x71a75c7903b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:56.941085 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Emitting event <LifecycleEvent: 1779977381.939848, 0133675f-0296-459c-977f-074ad1216441 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:09:56.941258 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] VM Stopped (Lifecycle Event)
May 28 14:09:56.942733 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:56.942733 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=11.912594004999846 future=<Future at 0x71a75c36e870 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:56.942733 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=11.912486585999886 future=<Future at 0x71a75c36e870 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:09:57.026975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:57.094612 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.479s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:57.095610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.068s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:57.095868 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:09:57.284283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:57.447468 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6648ee9d-1189-400e-860e-f728af44db98 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: 0133675f-0296-459c-977f-074ad1216441] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:09:57.535281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:09:57.535281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:57.604608 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:09:57.605126 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:09:57.605504 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:57.605945 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:57.703844 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7b548159f00492b90645364206b5971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85522a95b1cc4a8191762582b962e162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:09:57.775346 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:09:57.775617 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:09:58.041910 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'flavor' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:09:58.107266 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:09:58.279935 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:09:58.334742 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Successfully created port: a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:09:58.612348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:09:58.790369 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.695s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:58.793182 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.509s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:09:58.796977 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:09:58.800208 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Claim successful on node np0000001643
May 28 14:09:58.879886 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocations for instance d6202b83-7043-4c19-81b6-13f2e5c64fef
May 28 14:09:59.052124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:09:59.057379 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Successfully updated port: a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:09:59.118432 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Booting with volume 2a227a47-2455-41cf-905a-58ae027e242b at /dev/vda
May 28 14:09:59.124961 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:09:59.126134 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing instance network info cache due to event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:09:59.126430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] Acquiring lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:59.126604 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] Acquired lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:09:59.126746 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:09:59.177568 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:09:59.190430 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:09:59.217229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:09:59.258899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:09:59.259110 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:09:59.267763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:09:59.269063 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe5b:b448', 'fe80::ac12:4fff:fead:8db2'] 
May 28 14:09:59.269181 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:09:59.269341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:09:59.269567 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:09:59.270215 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating existing volume attachment record: de97847a-51fc-45d2-8831-bbe8c72901d4 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:09:59.374990 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:59.560155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:09:59.595772 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:09:59.632114 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:09:59.697726 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:09:59.865307 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:09:59.890944 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-74431647-4eb8-458a-b84d-a37dbe4938d7 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "d6202b83-7043-4c19-81b6-13f2e5c64fef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.932s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:00.137990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:00.138983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:00.139172 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attaching volume 7e296d07-c7b1-4a0a-95fa-efe3387ecc29 to /dev/vdb
May 28 14:10:00.219563 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:00.231997 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:10:00.255826 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:00.306436 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:10:00.306728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:10:00.315511 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:10:00.316920 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fead:d3ed', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe5b:b448', 'fe80::ac12:4fff:fead:8db2'] 
May 28 14:10:00.317071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:10:00.317162 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:10:00.317435 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:00.317763 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Updating existing volume attachment record: 48101192-471c-4523-857b-0af334b4be5f {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:10:00.369064 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3307703a-6dce-47ae-95ea-40d089f9e6a7 req-fd0857fa-9ea7-424f-90fd-c8fb8718a3c6 service nova] Releasing lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:10:00.369972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquired lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:10:00.370237 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:10:00.434041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:00.434041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:00.434041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:00.434041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:00.434402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:00.440416 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Terminating instance
May 28 14:10:00.456192 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:10:00.456548 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:10:00.883040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:00.883389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:00.890626 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:10:00.891199 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:00.891428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:00.891950 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:00.892194 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:10:00.912534 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:00.913290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:00.914211 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:00.914473 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:00.914960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:00.915211 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:00.933509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:00.933509 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:00.937473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:00.937473 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:00.943616 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:10:00.955590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29] added
May 28 14:10:00.955590 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:00.955590 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:00.955590 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:00.955590 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:00.955590 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:00.955590 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:00.955847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:00.957119 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0416(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:00.957119 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:00.957265 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29] added
May 28 14:10:00.957265 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:00.957265 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:00.957265 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:00.957265 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:00.957265 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:00.957265 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:00.957595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:00.957779 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:00.957964 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:00.963354 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:10:00.976421 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:00.982184 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:10:00.988178 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.009044 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.191945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.201484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.211785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-712455db-fa64-4bc0-85fe-bd985042583d req-77e1f223-0600-4e3f-a0d8-429fdae6a366 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:01.212052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-712455db-fa64-4bc0-85fe-bd985042583d req-77e1f223-0600-4e3f-a0d8-429fdae6a366 service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:01.212294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-712455db-fa64-4bc0-85fe-bd985042583d req-77e1f223-0600-4e3f-a0d8-429fdae6a366 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:01.212456 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-712455db-fa64-4bc0-85fe-bd985042583d req-77e1f223-0600-4e3f-a0d8-429fdae6a366 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:01.212634 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-712455db-fa64-4bc0-85fe-bd985042583d req-77e1f223-0600-4e3f-a0d8-429fdae6a366 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] No waiting events found dispatching network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:01.212793 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-712455db-fa64-4bc0-85fe-bd985042583d req-77e1f223-0600-4e3f-a0d8-429fdae6a366 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:01.236212 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:01.274400 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.321685 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.326589 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99960196999973 future=<Future at 0x71a75c3e3800 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:01.335714 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Instance destroyed successfully.
May 28 14:10:01.337266 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'resources' on Instance uuid 512a75c8-713d-418b-adc8-07b2bf513923 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:01.388473 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'flavor' on Instance uuid 4a2e0c16-dd30-4f2b-a453-8febf9221c03 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:01.415217 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:10:01.418529 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:10:01.418802 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Creating image(s)
May 28 14:10:01.419114 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:10:01.419260 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Ensure instance console log exists: /opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:10:01.419515 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:01.419684 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:01.419817 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:01.472944 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating instance_info_cache with network_info: [{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:01.476324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.682s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:01.477098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:10:01.510343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.519390 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.735350 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.742461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.842464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=31,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:07:41Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-t5gyv8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=512a75c8-713d-418b-adc8-07b2bf513923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:10:01.842820 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "027666be-2507-4940-ae85-8c79ccf188b7", "address": "fa:16:3e:ad:d3:ed", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap027666be-25", "ovs_interfaceid": "027666be-2507-4940-ae85-8c79ccf188b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:01.843466 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:01.843852 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:10:01.845334 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.845667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap027666be-25, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:01.848004 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.851076 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:01.852085 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.852902 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12d6d604-6994-45bb-958a-960e227e4fe2) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:01.854038 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.854641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:01.855564 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:01.858118 np0000001643 nova-compute[98269]: INFO os_vif [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=027666be-2507-4940-ae85-8c79ccf188b7,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027666be-25')
May 28 14:10:01.858814 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Deleting instance files /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_del
May 28 14:10:01.870819 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Deletion of /opt/stack/data/nova/instances/512a75c8-713d-418b-adc8-07b2bf513923_del complete
May 28 14:10:01.892139 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Ignoring supplied device name: /dev/vdb
May 28 14:10:01.957247 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:01.960071 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:01.972788 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:01.972788 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:01.975410 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:01.975410 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:01.984847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Releasing lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:10:01.985167 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Instance network_info: |[{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:10:01.986168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Start _get_guest_xml network_info=[{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'de97847a-51fc-45d2-8831-bbe8c72901d4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f67c8d28-d6d9-4d52-960c-3d8e15622855', 'attached_at': '', 'detached_at': '', 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'serial': '2a227a47-2455-41cf-905a-58ae027e242b'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:10:01.989478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:01.992150 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:10:01.992150 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:10:01.992150 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:01.992150 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:01.995267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:01.997104 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:10:01.999643 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-219228408', uuid='f67c8d28-d6d9-4d52-960c-3d8e15622855'), owner=OwnerMeta(userid='a7b548159f00492b90645364206b5971', username='tempest-TestInstancesWithCinderVolumes-1781797632-project-member', projectid='85522a95b1cc4a8191762582b962e162', projectname='tempest-TestInstancesWithCinderVolumes-1781797632'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977401.9979656) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:10:02.002027 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:10:02.002418 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:10:02.003817 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:10:02.004079 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:10:02.005375 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:10:02.005682 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:10:02.005868 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:10:02.006003 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:10:02.006252 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:10:02.006425 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:10:02.006513 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:10:02.006776 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:10:02.006867 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:10:02.006986 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:10:02.007072 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:10:02.007238 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:10:02.020120 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.020120 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.020120 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.020120 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.020120 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:02.020441 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.020441 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.020441 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.020441 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.020441 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:02.022487 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.022487 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.022487 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.022487 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.022487 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:02.022668 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.022668 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.022668 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.022668 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.022668 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:02.026223 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:10:02.026717 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:02.027066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:02.065158 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.50.100,3260]
May 28 14:10:02.065158 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.50.100,3260] successful.
May 28 14:10:02.065158 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:02.078477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:02.079232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.40.100,3260]
May 28 14:10:02.079232 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.40.100,3260] successful.
May 28 14:10:02.079232 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:02.096040 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.097184 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:02.097797 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:02.097797 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:02.098795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] HCTL ('7', '-', '-', 0) found on session 82 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:02.098939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:02.108634 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '443210af2282478b862d252bfa3bb611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd0a26536e743c9a9eaeb956fc55b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:10:02.117912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.117912 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.117912 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.117912 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.117912 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.117912 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.117912 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:02.118197 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.118197 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:02.118197 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.118197 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:02.118197 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.118197 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:02.118197 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:02.118647 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:02.118816 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:02.119802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] HCTL ('8', '-', '-', 0) found on session 83 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:02.119976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:02.130066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Searching for a device in session 82 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:02.130263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:02.141852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Searching for a device in session 83 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:02.141852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:02.377376 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 14:10:02.378525 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:10:02.378525 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:10:02.378675 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:10:02.378822 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:02.397118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:02.481499 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:02.495034 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:10:02.704100 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Successfully created port: 2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:10:02.860723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-751a6fe0-11e0-4f01-be66-052148a4c90f req-3a4f8c30-0d4e-4c96-b213-4b321464883b service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-deleted-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:02.861075 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-751a6fe0-11e0-4f01-be66-052148a4c90f req-3a4f8c30-0d4e-4c96-b213-4b321464883b service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Neutron deleted interface 027666be-2507-4940-ae85-8c79ccf188b7; detaching it from the instance and deleting it from the info cache
May 28 14:10:02.862693 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-751a6fe0-11e0-4f01-be66-052148a4c90f req-3a4f8c30-0d4e-4c96-b213-4b321464883b service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Detach interface failed, port_id=027666be-2507-4940-ae85-8c79ccf188b7, reason: Instance 512a75c8-713d-418b-adc8-07b2bf513923 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:10:02.916503 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:10:03.001433 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:10:03.266104 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Successfully updated port: 2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:10:03.280955 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f592c8c1-499f-48aa-89a9-1c5a5aec4604 req-b2d59b98-8d77-441b-ac26-846e6200e052 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:03.281248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f592c8c1-499f-48aa-89a9-1c5a5aec4604 req-b2d59b98-8d77-441b-ac26-846e6200e052 service nova] Acquiring lock "512a75c8-713d-418b-adc8-07b2bf513923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:03.281462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f592c8c1-499f-48aa-89a9-1c5a5aec4604 req-b2d59b98-8d77-441b-ac26-846e6200e052 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:03.281594 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f592c8c1-499f-48aa-89a9-1c5a5aec4604 req-b2d59b98-8d77-441b-ac26-846e6200e052 service nova] Lock "512a75c8-713d-418b-adc8-07b2bf513923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:03.281722 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f592c8c1-499f-48aa-89a9-1c5a5aec4604 req-b2d59b98-8d77-441b-ac26-846e6200e052 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] No waiting events found dispatching network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:03.281834 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f592c8c1-499f-48aa-89a9-1c5a5aec4604 req-b2d59b98-8d77-441b-ac26-846e6200e052 service nova] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Received event network-vif-unplugged-027666be-2507-4940-ae85-8c79ccf188b7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:03.286655 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:03.497140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:03.497441 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:03.497740 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Attaching volume f68effdf-6a5b-4823-b648-2ea22694e77c to /dev/vdb
May 28 14:10:03.543759 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:03.557196 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:10:03.578279 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:03.618691 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:10:03.619093 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:10:03.627218 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:10:03.629034 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fecc:1634', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe5b:b448', 'fe80::ac12:4fff:fead:8db2'] 
May 28 14:10:03.629204 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:10:03.629404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:10:03.629850 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:03.630186 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Updating existing volume attachment record: 4b713439-c40e-4491-a021-f875cc16d4e4 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:10:03.768171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:10:03.768367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquired lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:10:03.768538 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:10:03.789064 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Took 1.41 seconds to deallocate network for instance.
May 28 14:10:03.932598 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Found WWN 3300000007aa7d4c7 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:10:03.933085 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:03.933085 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000007aa7d4c7', 'path': '/dev/dm-0', 'multipath_id': '3300000007aa7d4c7'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:03.933199 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007aa7d4c7', 'path': '/dev/dm-0', 'multipath_id': '3300000007aa7d4c7'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:10:03.933789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.907s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:03.934390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:10:03.937587 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'flavor' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:03.945583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:03.946105 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:03.946601 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:03.946838 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:03.947475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:03.947676 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:03.961986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:03.961986 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:03.962746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:03.962746 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:03.974983 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b] added
May 28 14:10:03.974983 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:03.974983 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:03.974983 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:03.974983 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:03.974983 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:03.974983 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:03.974983 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:03.975326 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:03.975326 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:03.979822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b] added
May 28 14:10:03.979822 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:03.979822 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:03.979822 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:03.979822 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:03.979822 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:03.979822 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:03.980071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:03.980139 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:03.980428 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:04.009826 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:10:04.011011 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:10:04.011208 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Creating image(s)
May 28 14:10:04.011721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "/opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:04.011925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "/opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:04.012436 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "/opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:04.012954 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:10:04.016134 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:10:04.017251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:04.111737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:04.112236 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:04.112803 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:04.113683 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:10:04.116935 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:10:04.117347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:04.190478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:10:04.190947 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:04.191146 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:04.208125 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:04.208802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:04.269435 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk 1073741824" returned: 0 in 0.060s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:04.269890 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:04.270259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:04.300925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:04.301460 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:04.378628 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:04.379064 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:10:04.379277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:04.400024 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:10:04.442918 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attempting to attach volume 7e296d07-c7b1-4a0a-95fa-efe3387ecc29 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:10:04.448396 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:10:04.448396 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:10:04.448396 np0000001643 nova-compute[98269]:   <alias name="ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29"/>
May 28 14:10:04.448396 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:10:04.448396 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:10:04.448396 np0000001643 nova-compute[98269]:   <serial>7e296d07-c7b1-4a0a-95fa-efe3387ecc29</serial>
May 28 14:10:04.448396 np0000001643 nova-compute[98269]: </disk>
May 28 14:10:04.448396 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:10:04.481927 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:04.482387 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Cannot resize image /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:10:04.482776 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:10:04.483045 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Ensure instance console log exists: /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:10:04.483422 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:04.483705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:04.483919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:04.597960 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:04.610322 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:04.762037 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating instance_info_cache with network_info: [{"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:04.875920 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:10:04.876195 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:10:04.975978 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:04.980851 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:04.990462 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:04.990462 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:04.997916 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:04.997916 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:05.006463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:05.013264 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.023916 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:05.030522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.030522 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.030522 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.030522 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.030522 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.030522 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.030522 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:05.030745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.030745 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.030745 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.030745 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.030745 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.030745 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.030745 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:05.063183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.50.100,3260]
May 28 14:10:05.063183 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.50.100,3260] successful.
May 28 14:10:05.063183 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:05.075931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:05.076271 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.40.100,3260]
May 28 14:10:05.076271 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.40.100,3260] successful.
May 28 14:10:05.076271 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:05.090581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.096491 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.096720 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:05.097099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:05.097294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:05.098370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] HCTL ('13', '-', '-', 0) found on session 84 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:05.098577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:05.111729 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:05.111729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:05.112210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:05.114615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] HCTL ('14', '-', '-', 0) found on session 85 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:05.114615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:05.116055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 84 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:05.116190 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:05.128720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 85 and hctl ['14', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:05.264616 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Releasing lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:10:05.265021 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Instance network_info: |[{"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:10:05.267065 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Start _get_guest_xml network_info=[{"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:10:05.270811 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:10:05.272882 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1030993449', uuid='811bba84-3c9c-4ff7-b115-919041083aa2'), owner=OwnerMeta(userid='443210af2282478b862d252bfa3bb611', username='tempest-VolumeMultiattachTests-761556748-project-member', projectid='1bd0a26536e743c9a9eaeb956fc55b79', projectname='tempest-VolumeMultiattachTests-761556748'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977405.2722604) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:10:05.275701 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:10:05.277235 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:10:05.280844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:10:05.280991 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:10:05.282485 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:10:05.282485 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:10:05.282485 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:10:05.282485 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:10:05.282775 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:10:05.282775 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:10:05.282775 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:10:05.282872 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:10:05.282978 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:10:05.283091 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:10:05.283196 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:10:05.283331 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:10:05.297623 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1030993449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-1030993449',id=42,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV38pm1HbkUROW/tCJmf52xS6BdlTXdGhB7E70gTHtjkTPX7hag/5B9RTUqMwmX3Cqz3dEUOdWuIg74tj0p2z6baF7RtvsMHaZe0ZRHkLWYt3ZzcEeJB0m/zxo2iAwBQQ==',key_name='tempest-keypair-1772616094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-iq09fsc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=811bba84-3c9c-4ff7-b115-919041083aa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:10:05.298385 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:05.298603 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:5f,bridge_name='br-int',has_traffic_filtering=True,id=2d30b655-1e54-4e0b-aa01-e53b665fa3b7,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d30b655-1e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:05.299431 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'pci_devices' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:05.355189 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-changed-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:05.355621 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Refreshing instance network info cache due to event network-changed-2d30b655-1e54-4e0b-aa01-e53b665fa3b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:10:05.355692 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] Acquiring lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:10:05.355873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] Acquired lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:10:05.356025 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Refreshing network info cache for port 2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:10:05.379436 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:10:05.802700 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] End _get_guest_xml xml=<domain type="qemu">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <uuid>811bba84-3c9c-4ff7-b115-919041083aa2</uuid>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <name>instance-0000002a</name>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumeMultiattachTests-server-1030993449</nova:name>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:10:05</nova:creationTime>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:user uuid="443210af2282478b862d252bfa3bb611">tempest-VolumeMultiattachTests-761556748-project-member</nova:user>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:project uuid="1bd0a26536e743c9a9eaeb956fc55b79">tempest-VolumeMultiattachTests-761556748</nova:project>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         <nova:port uuid="2d30b655-1e54-4e0b-aa01-e53b665fa3b7">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <system>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <entry name="serial">811bba84-3c9c-4ff7-b115-919041083aa2</entry>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <entry name="uuid">811bba84-3c9c-4ff7-b115-919041083aa2</entry>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </system>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <os>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   </os>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <features>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   </features>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   <devices>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </disk>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk.config"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </disk>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:29:77:5f"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <target dev="tap2d30b655-1e"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </interface>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/console.log" append="off"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </serial>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <video>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </video>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </rng>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:   </devices>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]: </domain>
May 28 14:10:05.802700 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Preparing to wait for external event network-vif-plugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1030993449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-1030993449',id=42,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV38pm1HbkUROW/tCJmf52xS6BdlTXdGhB7E70gTHtjkTPX7hag/5B9RTUqMwmX3Cqz3dEUOdWuIg74tj0p2z6baF7RtvsMHaZe0ZRHkLWYt3ZzcEeJB0m/zxo2iAwBQQ==',key_name='tempest-keypair-1772616094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-iq09fsc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=811bba84-3c9c-4ff7-b115-919041083aa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:5f,bridge_name='br-int',has_traffic_filtering=True,id=2d30b655-1e54-4e0b-aa01-e53b665fa3b7,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d30b655-1e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:05.805937 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:5f,bridge_name='br-int',has_traffic_filtering=True,id=2d30b655-1e54-4e0b-aa01-e53b665fa3b7,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d30b655-1e') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:10:05.806613 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:05.806674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:05.806933 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:10:05.807979 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:05.808218 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6da5c1a-e053-5eb5-bf90-db63cb247f53', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:05.809188 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:05.810073 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:05.810255 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:05.812894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:05.813114 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d30b655-1e, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:05.813640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d30b655-1e, col_values=(('qos', UUID('b70fa13e-9677-4eb5-b116-b5fa8fe39945')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:05.813818 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d30b655-1e, col_values=(('external_ids', {'iface-id': '2d30b655-1e54-4e0b-aa01-e53b665fa3b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:77:5f', 'vm-uuid': '811bba84-3c9c-4ff7-b115-919041083aa2'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:05.815158 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:05.816595 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:05.821377 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:05.822461 np0000001643 nova-compute[98269]: INFO os_vif [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:77:5f,bridge_name='br-int',has_traffic_filtering=True,id=2d30b655-1e54-4e0b-aa01-e53b665fa3b7,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d30b655-1e')
May 28 14:10:05.858436 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:05.889595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.588s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:05.943785 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocations for instance 512a75c8-713d-418b-adc8-07b2bf513923
May 28 14:10:06.113397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:06.116478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:06.116478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:06.116478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No VIF found with MAC fa:16:3e:f9:dc:0e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:10:06.131714 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 85 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:06.131966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:06.141593 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:06.263752 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updated VIF entry in instance network info cache for port 2d30b655-1e54-4e0b-aa01-e53b665fa3b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:10:06.263935 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating instance_info_cache with network_info: [{"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:06.765846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-56dd969d-b8b4-430c-969d-e42d2c38a983 req-1d9a4bb3-3797-45fb-a49b-1f46e8d96eb5 service nova] Releasing lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:10:06.953097 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3dc8a1bd-04d5-43da-94c3-61c49dc1926d tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "512a75c8-713d-418b-adc8-07b2bf513923" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.519s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:06.964832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Found WWN 3300000008e253d82 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:10:06.965180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:06.965381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== connect_volume: return (4938ms) {'type': 'block', 'scsi_wwn': '3300000008e253d82', 'path': '/dev/dm-4', 'multipath_id': '3300000008e253d82'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:06.965559 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008e253d82', 'path': '/dev/dm-4', 'multipath_id': '3300000008e253d82'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:10:06.966360 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.775s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:06.966660 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:10:06.982860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:06.983655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:06.984116 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:06.984275 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:06.984766 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:06.985002 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:06.997464 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:06.997464 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:07.002475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:07.002475 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:07.010774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c] added
May 28 14:10:07.010774 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:07.010774 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:07.010774 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:07.010774 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:07.010774 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:07.010774 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:07.011037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:07.011177 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:07.011347 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:07.015041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c] added
May 28 14:10:07.015041 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:07.015041 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:07.015041 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:07.015041 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:07.015041 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:07.015041 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:07.015270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:07.015373 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:07.015543 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:07.342249 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:07.342732 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:07.342732 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:29:77:5f, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:10:07.343344 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Using config drive
May 28 14:10:07.473924 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-219228408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testinstanceswithcindervolumes-server-219228408',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH7WKiCvLLlt67MoRg4jrslxNcLiuk8yx+FQiVIPMzt4v4d7WOUOMukfeM/ff6ntJXgJWP1poFl3zDnKdZTJMGbeMLU67nCpTv6eVK+U11eYMfzpKFgN2GbBXP+tJuItw==',key_name='tempest-TestInstancesWithCinderVolumes-396621340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85522a95b1cc4a8191762582b962e162',ramdisk_id='',reservation_id='r-ad4cf94s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1781797632',owner_user_name='tempest-TestInstancesWithCinderVolumes-1781797632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:59Z,user_data=None,user_id='a7b548159f00492b90645364206b5971',uuid=f67c8d28-d6d9-4d52-960c-3d8e15622855,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:10:07.474380 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Converting VIF {"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:07.475051 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:b9:0b,bridge_name='br-int',has_traffic_filtering=True,id=a6ba104a-1f00-4e65-982b-42f716519f23,network=Network(4fe953ea-06e9-4457-a492-46039248ac68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ba104a-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:07.476057 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'pci_devices' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:07.664797 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d30a4a-67a6-49ab-a2a1-a239b87d6988 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.526s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:07.854127 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:07.979495 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] End _get_guest_xml xml=<domain type="qemu">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <uuid>f67c8d28-d6d9-4d52-960c-3d8e15622855</uuid>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <name>instance-00000029</name>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-219228408</nova:name>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:10:01</nova:creationTime>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:properties/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:user uuid="a7b548159f00492b90645364206b5971">tempest-TestInstancesWithCinderVolumes-1781797632-project-member</nova:user>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:project uuid="85522a95b1cc4a8191762582b962e162">tempest-TestInstancesWithCinderVolumes-1781797632</nova:project>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         <nova:port uuid="a6ba104a-1f00-4e65-982b-42f716519f23">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <system>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <entry name="serial">f67c8d28-d6d9-4d52-960c-3d8e15622855</entry>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <entry name="uuid">f67c8d28-d6d9-4d52-960c-3d8e15622855</entry>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </system>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <os>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   </os>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <features>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   </features>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   <devices>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855/disk.config"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </disk>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <alias name="ua-2a227a47-2455-41cf-905a-58ae027e242b"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-4"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <serial>2a227a47-2455-41cf-905a-58ae027e242b</serial>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </disk>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:a2:b9:0b"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <target dev="tapa6ba104a-1f"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </interface>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855/console.log" append="off"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </serial>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <video>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </video>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </rng>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:   </devices>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]: </domain>
May 28 14:10:07.979495 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:10:07.981329 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Preparing to wait for external event network-vif-plugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:10:07.981329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:07.981329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:07.981329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:07.981329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-219228408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testinstanceswithcindervolumes-server-219228408',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH7WKiCvLLlt67MoRg4jrslxNcLiuk8yx+FQiVIPMzt4v4d7WOUOMukfeM/ff6ntJXgJWP1poFl3zDnKdZTJMGbeMLU67nCpTv6eVK+U11eYMfzpKFgN2GbBXP+tJuItw==',key_name='tempest-TestInstancesWithCinderVolumes-396621340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85522a95b1cc4a8191762582b962e162',ramdisk_id='',reservation_id='r-ad4cf94s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1781797632',owner_user_name='tempest-TestInstancesWithCinderVolumes-1781797632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:09:59Z,user_data=None,user_id='a7b548159f00492b90645364206b5971',uuid=f67c8d28-d6d9-4d52-960c-3d8e15622855,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:10:07.981329 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Converting VIF {"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:07.981612 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:b9:0b,bridge_name='br-int',has_traffic_filtering=True,id=a6ba104a-1f00-4e65-982b-42f716519f23,network=Network(4fe953ea-06e9-4457-a492-46039248ac68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ba104a-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:07.982487 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:b9:0b,bridge_name='br-int',has_traffic_filtering=True,id=a6ba104a-1f00-4e65-982b-42f716519f23,network=Network(4fe953ea-06e9-4457-a492-46039248ac68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ba104a-1f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:10:07.982878 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:07.983091 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:07.983297 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:10:07.984139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:07.984379 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc853f9c-3fce-52bb-89ca-e7c40291ecac', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:07.985119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:07.985926 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:07.991934 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:07.994097 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:07.994278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6ba104a-1f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:07.994644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6ba104a-1f, col_values=(('qos', UUID('4b6ec3b2-cefe-4630-8d7d-cbe59058f398')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:07.994792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6ba104a-1f, col_values=(('external_ids', {'iface-id': 'a6ba104a-1f00-4e65-982b-42f716519f23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:b9:0b', 'vm-uuid': 'f67c8d28-d6d9-4d52-960c-3d8e15622855'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:07.995656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:07.997844 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:08.009433 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:08.010540 np0000001643 nova-compute[98269]: INFO os_vif [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:b9:0b,bridge_name='br-int',has_traffic_filtering=True,id=a6ba104a-1f00-4e65-982b-42f716519f23,network=Network(4fe953ea-06e9-4457-a492-46039248ac68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ba104a-1f')
May 28 14:10:08.011769 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:08.016862 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:08.036241 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Creating config drive at /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk.config
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:08.037481 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:08.037481 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:08.041506 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:08.041506 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.046781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdtygkc16 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:08.065482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.068807 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.088627 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.088986 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.089559 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.089738 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:08.108981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdtygkc16" returned: 0 in 0.062s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:08.140853 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.50.100,3260]
May 28 14:10:08.140853 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.50.100,3260] successful.
May 28 14:10:08.140853 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.149183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.40.100,3260]
May 28 14:10:08.149183 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.40.100,3260] successful.
May 28 14:10:08.149183 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.158468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.163796 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.177829 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.178197 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:08.178495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:08.179780 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:08.181762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] HCTL ('15', '-', '-', 0) found on session 86 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:08.181883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:08.191651 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:08.191651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:08.192345 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:08.192757 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] HCTL ('16', '-', '-', 0) found on session 87 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:08.192852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:08.204440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching for a device in session 86 and hctl ['15', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:08.213538 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching for a device in session 87 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:08.213538 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:08.643401 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:08.678681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:08.682112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:08.769640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:08.857763 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0014597990002584993 future=<Future at 0x71a75c36e870 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:08.857763 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:08.857763 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.46866255499981 future=<Future at 0x71a75c3e3800 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:08.857763 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.468578928999705 future=<Future at 0x71a75c3e3800 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:08.857763 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Emitting event <LifecycleEvent: 1779977393.8551443, d6202b83-7043-4c19-81b6-13f2e5c64fef => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:08.858243 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] VM Stopped (Lifecycle Event)
May 28 14:10:08.914967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bdcd0e2a-6a0e-4a43-a51b-1071cd7568a4 req-1215e61c-a4ba-43ab-a07e-cdacbe853afb service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-vif-plugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:08.914967 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bdcd0e2a-6a0e-4a43-a51b-1071cd7568a4 req-1215e61c-a4ba-43ab-a07e-cdacbe853afb service nova] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:08.914967 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bdcd0e2a-6a0e-4a43-a51b-1071cd7568a4 req-1215e61c-a4ba-43ab-a07e-cdacbe853afb service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:08.914967 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bdcd0e2a-6a0e-4a43-a51b-1071cd7568a4 req-1215e61c-a4ba-43ab-a07e-cdacbe853afb service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:08.914967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bdcd0e2a-6a0e-4a43-a51b-1071cd7568a4 req-1215e61c-a4ba-43ab-a07e-cdacbe853afb service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Processing event network-vif-plugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:10:08.988801 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:08.988972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:08.989150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:08.989270 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:08.989384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:08.991692 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Terminating instance
May 28 14:10:09.032894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.041687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.049759 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.071155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.078954 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.200903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching for a device in session 86 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:09.201094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:09.289263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:09.289780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:09.360864 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: d6202b83-7043-4c19-81b6-13f2e5c64fef] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:09.494711 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:10:09.508513 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:10:09.511977 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977409.5111399, 811bba84-3c9c-4ff7-b115-919041083aa2 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:09.512281 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] VM Started (Lifecycle Event)
May 28 14:10:09.514980 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:10:09.517892 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Instance spawned successfully.
May 28 14:10:09.518919 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:10:09.524042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.546180 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:09.546289 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:09.546388 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No VIF found with MAC fa:16:3e:a2:b9:0b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:10:09.546817 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Using config drive
May 28 14:10:09.554180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.600779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.711519 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0ff43f77-1910-4e8d-8fd7-841a7ac4cb9d req-0a5cf654-73b1-47e7-940a-ff0cfcdb86a4 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-vif-unplugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:09.712259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0ff43f77-1910-4e8d-8fd7-841a7ac4cb9d req-0a5cf654-73b1-47e7-940a-ff0cfcdb86a4 service nova] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:09.712259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0ff43f77-1910-4e8d-8fd7-841a7ac4cb9d req-0a5cf654-73b1-47e7-940a-ff0cfcdb86a4 service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:09.712259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0ff43f77-1910-4e8d-8fd7-841a7ac4cb9d req-0a5cf654-73b1-47e7-940a-ff0cfcdb86a4 service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:09.712259 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0ff43f77-1910-4e8d-8fd7-841a7ac4cb9d req-0a5cf654-73b1-47e7-940a-ff0cfcdb86a4 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] No waiting events found dispatching network-vif-unplugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:09.713072 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0ff43f77-1910-4e8d-8fd7-841a7ac4cb9d req-0a5cf654-73b1-47e7-940a-ff0cfcdb86a4 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-vif-unplugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:09.721469 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.733016 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:09.793582 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'flavor' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:09.832624 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Instance destroyed successfully.
May 28 14:10:09.833177 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'resources' on Instance uuid 0cb5afe2-5125-4261-b2f3-f0431bc65134 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:10.003621 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Found WWN 33000000073aa8f05 for multipath device dm-10 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:10:10.003621 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:10.003833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== connect_volume: return (5813ms) {'type': 'block', 'scsi_wwn': '33000000073aa8f05', 'path': '/dev/dm-10', 'multipath_id': '33000000073aa8f05'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:10.003975 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000073aa8f05', 'path': '/dev/dm-10', 'multipath_id': '33000000073aa8f05'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:10:10.007666 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'flavor' on Instance uuid 4a2e0c16-dd30-4f2b-a453-8febf9221c03 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:10.014751 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:10.017909 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:10:10.028618 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:10.030492 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:10.030872 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:10.031137 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:10.031427 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:10.031719 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:10.052187 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:10.174198 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Creating config drive at /opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855/disk.config
May 28 14:10:10.177656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6job5xpo {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:10.242019 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6job5xpo" returned: 0 in 0.064s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:10.336139 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-1',id=26,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:05:28Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-4yyq63oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=0cb5afe2-5125-4261-b2f3-f0431bc65134,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:10:10.336427 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "address": "fa:16:3e:cc:16:34", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11da0-3e", "ovs_interfaceid": "a6d11da0-3e5d-4d81-890b-33bfa2b1583d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:10.337093 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:16:34,bridge_name='br-int',has_traffic_filtering=True,id=a6d11da0-3e5d-4d81-890b-33bfa2b1583d,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11da0-3e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:10.337372 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:16:34,bridge_name='br-int',has_traffic_filtering=True,id=a6d11da0-3e5d-4d81-890b-33bfa2b1583d,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11da0-3e') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:10:10.339071 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.339409 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6d11da0-3e, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:10.340864 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.341848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:10.348637 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.349673 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.349872 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aa12b93-6cb4-4aa4-951c-1f3a45ad7049) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:10.351204 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.351890 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:10.360766 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.363272 np0000001643 nova-compute[98269]: INFO os_vif [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:16:34,bridge_name='br-int',has_traffic_filtering=True,id=a6d11da0-3e5d-4d81-890b-33bfa2b1583d,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11da0-3e')
May 28 14:10:10.363765 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Deleting instance files /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134_del
May 28 14:10:10.364628 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Deletion of /opt/stack/data/nova/instances/0cb5afe2-5125-4261-b2f3-f0431bc65134_del complete
May 28 14:10:10.511383 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Attempting to attach volume f68effdf-6a5b-4823-b648-2ea22694e77c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:10:10.513771 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:10:10.513771 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:10:10.513771 np0000001643 nova-compute[98269]:   <alias name="ua-f68effdf-6a5b-4823-b648-2ea22694e77c"/>
May 28 14:10:10.513771 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:10:10.513771 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:10:10.513771 np0000001643 nova-compute[98269]:   <serial>f68effdf-6a5b-4823-b648-2ea22694e77c</serial>
May 28 14:10:10.513771 np0000001643 nova-compute[98269]: </disk>
May 28 14:10:10.513771 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:10:10.522547 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:10:10.522547 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977410.5211062, 811bba84-3c9c-4ff7-b115-919041083aa2 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:10.522547 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] VM Paused (Lifecycle Event)
May 28 14:10:10.539681 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Took 6.53 seconds to spawn the instance on the hypervisor.
May 28 14:10:10.540053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:10.804209 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:10.839407 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.868269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.882002 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 14:10:10.884604 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:10:10.884767 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:10:10.884869 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:10:10.885258 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:10.991887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:10.999843 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6f1ea3d7-72f1-405b-a4e1-bfbb20b62fc9 req-72055c40-72ad-4f65-8a2f-4c3ceb3c3e59 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-vif-plugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:11.000132 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f1ea3d7-72f1-405b-a4e1-bfbb20b62fc9 req-72055c40-72ad-4f65-8a2f-4c3ceb3c3e59 service nova] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:11.000361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f1ea3d7-72f1-405b-a4e1-bfbb20b62fc9 req-72055c40-72ad-4f65-8a2f-4c3ceb3c3e59 service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:11.000506 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f1ea3d7-72f1-405b-a4e1-bfbb20b62fc9 req-72055c40-72ad-4f65-8a2f-4c3ceb3c3e59 service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:11.000634 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6f1ea3d7-72f1-405b-a4e1-bfbb20b62fc9 req-72055c40-72ad-4f65-8a2f-4c3ceb3c3e59 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] No waiting events found dispatching network-vif-plugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:11.000753 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6f1ea3d7-72f1-405b-a4e1-bfbb20b62fc9 req-72055c40-72ad-4f65-8a2f-4c3ceb3c3e59 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received unexpected event network-vif-plugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 for instance with vm_state active and task_state None.
May 28 14:10:11.016133 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:11.026147 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:11.031582 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977411.0302572, 811bba84-3c9c-4ff7-b115-919041083aa2 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:11.031582 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] VM Resumed (Lifecycle Event)
May 28 14:10:11.045811 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bedc6fd5-c812-41c3-868c-a228912bdaa7 req-531b7dcc-49fa-48ee-b926-79a075bf242b service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-vif-plugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:11.046034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bedc6fd5-c812-41c3-868c-a228912bdaa7 req-531b7dcc-49fa-48ee-b926-79a075bf242b service nova] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:11.046244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bedc6fd5-c812-41c3-868c-a228912bdaa7 req-531b7dcc-49fa-48ee-b926-79a075bf242b service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:11.046424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bedc6fd5-c812-41c3-868c-a228912bdaa7 req-531b7dcc-49fa-48ee-b926-79a075bf242b service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:11.046724 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bedc6fd5-c812-41c3-868c-a228912bdaa7 req-531b7dcc-49fa-48ee-b926-79a075bf242b service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Processing event network-vif-plugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:10:11.050872 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Took 13.83 seconds to build instance.
May 28 14:10:11.231177 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:11.234080 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:11.239697 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:11.259440 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:11.261181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:11.537770 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:11.542241 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:10:11.555722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.344s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:11.796840 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-abd153ff-ff30-40e0-9ca3-c2cb612673d2 req-b5c4d002-c19f-455e-b220-3b76ab68f395 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-vif-unplugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:11.800830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-abd153ff-ff30-40e0-9ca3-c2cb612673d2 req-b5c4d002-c19f-455e-b220-3b76ab68f395 service nova] Acquiring lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:11.800830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-abd153ff-ff30-40e0-9ca3-c2cb612673d2 req-b5c4d002-c19f-455e-b220-3b76ab68f395 service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:11.800830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-abd153ff-ff30-40e0-9ca3-c2cb612673d2 req-b5c4d002-c19f-455e-b220-3b76ab68f395 service nova] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:11.801172 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-abd153ff-ff30-40e0-9ca3-c2cb612673d2 req-b5c4d002-c19f-455e-b220-3b76ab68f395 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] No waiting events found dispatching network-vif-unplugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:11.802792 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-abd153ff-ff30-40e0-9ca3-c2cb612673d2 req-b5c4d002-c19f-455e-b220-3b76ab68f395 service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-vif-unplugged-a6d11da0-3e5d-4d81-890b-33bfa2b1583d for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:11.835034 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:10:11.838070 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:10:11.839569 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Instance spawned successfully.
May 28 14:10:11.841045 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:10:11.920041 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:11.922418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:11.922661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:11.922899 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attaching volume 6ca6f39a-a2e6-4d96-abda-6227942e3eb1 to /dev/vdc
May 28 14:10:11.984377 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:12.000859 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:10:12.029850 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:12.048539 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998776142999759 future=<Future at 0x71a7801e2c60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:12.049226 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977412.0485618, f67c8d28-d6d9-4d52-960c-3d8e15622855 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:12.049515 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] VM Started (Lifecycle Event)
May 28 14:10:12.083309 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:10:12.083623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:10:12.095192 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:10:12.097241 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe14:5545', 'fe80::3851:f7ff:fecf:2431', 'fe80::fc16:3eff:fecc:f3b8', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe5b:b448', 'fe80::ac12:4fff:fead:8db2', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fea2:b90b', 'fe80::c880:3aff:fe3c:d2d3'] 
May 28 14:10:12.097498 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:10:12.097564 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:10:12.098274 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:12.099966 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Updating existing volume attachment record: 80f88bc8-fd87-43c4-a58d-2c7f2c58f167 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:10:12.257232 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:12.257536 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:12.257789 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:12.258108 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No VIF found with MAC fa:16:3e:e0:a2:59, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:10:12.346563 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:12.346734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:12.347034 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:12.347187 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:12.347428 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:12.347679 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:10:12.423420 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Took 1.54 seconds to deallocate network for instance.
May 28 14:10:12.555147 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:12.557787 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:10:12.677278 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:10:12.677740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:12.677893 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:12.678439 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:12.678727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:10:12.696438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:12.697275 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:12.698169 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:12.698390 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:12.698800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:12.698999 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:12.713720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:12.713720 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:12.725415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:10:12.725415 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1] added
May 28 14:10:12.740478 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:12.740478 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:12.740478 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:12.744851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1] added
May 28 14:10:12.744851 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:10:12.744851 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:12.744851 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:12.744851 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:10:12.744851 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:10:12.744851 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:12.745337 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:10:12.745337 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0462(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:10:12.745463 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:10:12.856471 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Took 11.44 seconds to spawn the instance on the hypervisor.
May 28 14:10:12.856471 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:12.931213 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:12.931326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:13.060426 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:10:13.060752 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977413.0605342, f67c8d28-d6d9-4d52-960c-3d8e15622855 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:13.060885 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] VM Paused (Lifecycle Event)
May 28 14:10:13.080499 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-changed-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:13.080785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Refreshing instance network info cache due to event network-changed-2d30b655-1e54-4e0b-aa01-e53b665fa3b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:10:13.081059 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] Acquiring lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:10:13.081153 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] Acquired lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:10:13.081274 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Refreshing network info cache for port 2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:10:13.134014 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c4b92e1f-2888-4cad-a20f-80336ab737ee req-a10bb11a-8c68-4dd0-9604-7a77967ae1ed service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-vif-plugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:13.134487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c4b92e1f-2888-4cad-a20f-80336ab737ee req-a10bb11a-8c68-4dd0-9604-7a77967ae1ed service nova] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:13.134670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c4b92e1f-2888-4cad-a20f-80336ab737ee req-a10bb11a-8c68-4dd0-9604-7a77967ae1ed service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:13.135098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c4b92e1f-2888-4cad-a20f-80336ab737ee req-a10bb11a-8c68-4dd0-9604-7a77967ae1ed service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:13.136112 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c4b92e1f-2888-4cad-a20f-80336ab737ee req-a10bb11a-8c68-4dd0-9604-7a77967ae1ed service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] No waiting events found dispatching network-vif-plugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:13.136271 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-c4b92e1f-2888-4cad-a20f-80336ab737ee req-a10bb11a-8c68-4dd0-9604-7a77967ae1ed service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received unexpected event network-vif-plugged-a6ba104a-1f00-4e65-982b-42f716519f23 for instance with vm_state active and task_state None.
May 28 14:10:13.136423 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c4b92e1f-2888-4cad-a20f-80336ab737ee req-a10bb11a-8c68-4dd0-9604-7a77967ae1ed service nova] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Received event network-vif-deleted-a6d11da0-3e5d-4d81-890b-33bfa2b1583d {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:13.367325 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Took 18.81 seconds to build instance.
May 28 14:10:13.412380 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:10:13.412650 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:10:13.564455 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:13.570820 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977413.5703354, f67c8d28-d6d9-4d52-960c-3d8e15622855 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:13.570820 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] VM Resumed (Lifecycle Event)
May 28 14:10:13.584107 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:13.740354 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:10:13.745983 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:13.755954 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:13.755954 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:10:13.762058 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:10:13.762058 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.769892 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.777707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.789574 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.790416 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.799851 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:13.815471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7bc7950-082f-4871-9405-cf7f67630910 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.318s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:13.863514 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.40.100,3260]
May 28 14:10:13.863514 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.40.100,3260] successful.
May 28 14:10:13.863514 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.869731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.50.100,3260]
May 28 14:10:13.869731 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.50.100,3260] successful.
May 28 14:10:13.869731 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.873962 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.327s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:13.880749 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.891707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.913651 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:13.916325 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.930408 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:13.932414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:13.932414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.936147 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:13.936617 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:13.937084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.239s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:13.937167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:10:13.940583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] HCTL ('17', '-', '-', 0) found on session 88 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:13.940813 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:13.942131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] HCTL ('18', '-', '-', 0) found on session 89 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:10:13.942131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:10:13.994858 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Searching for a device in session 88 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:13.994858 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:13.994858 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Searching for a device in session 89 and hctl ['18', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:14.008777 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:14.075505 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:14.089623 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:10:14.250099 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updated VIF entry in instance network info cache for port 2d30b655-1e54-4e0b-aa01-e53b665fa3b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:10:14.250373 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating instance_info_cache with network_info: [{"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:14.437726 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.506s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:14.492595 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocations for instance 0cb5afe2-5125-4261-b2f3-f0431bc65134
May 28 14:10:14.601229 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:14.752645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-166d6921-d293-472d-8998-3665b438021f req-5dbde48d-0cfd-4d4b-9cac-049441babcac service nova] Releasing lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:10:14.972992 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Searching for a device in session 89 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:10:14.973397 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:10:15.351198 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:15.502046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-699df005-e77c-4cbf-9629-c6d785741589 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "0cb5afe2-5125-4261-b2f3-f0431bc65134" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.513s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:15.531162 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:15.531748 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing instance network info cache due to event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:10:15.531990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] Acquiring lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:10:15.532110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] Acquired lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:10:15.532219 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:10:15.719633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Found WWN 3300000007322a2ff for multipath device dm-11 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:10:15.721098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:10:15.721098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000007322a2ff', 'path': '/dev/dm-11', 'multipath_id': '3300000007322a2ff'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:15.722202 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007322a2ff', 'path': '/dev/dm-11', 'multipath_id': '3300000007322a2ff'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:10:15.727471 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'flavor' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:16.034964 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:16.231130 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attempting to attach volume 6ca6f39a-a2e6-4d96-abda-6227942e3eb1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:10:16.232668 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:10:16.232668 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:10:16.232668 np0000001643 nova-compute[98269]:   <alias name="ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1"/>
May 28 14:10:16.232668 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-11"/>
May 28 14:10:16.232668 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:10:16.232668 np0000001643 nova-compute[98269]:   <serial>6ca6f39a-a2e6-4d96-abda-6227942e3eb1</serial>
May 28 14:10:16.232668 np0000001643 nova-compute[98269]: </disk>
May 28 14:10:16.232668 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:10:16.326101 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004802600001312385 future=<Future at 0x71a75c3e3800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:16.326262 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:16.326419 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.72054477399979 future=<Future at 0x71a7801e2c60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:16.326640 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.720387510999899 future=<Future at 0x71a7801e2c60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:16.326979 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Emitting event <LifecycleEvent: 1779977401.3254762, 512a75c8-713d-418b-adc8-07b2bf513923 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:16.327146 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] VM Stopped (Lifecycle Event)
May 28 14:10:16.430980 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:16.433618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:16.436800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:16.437131 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:16.438375 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:16.438375 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:16.441347 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Terminating instance
May 28 14:10:16.612125 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updated VIF entry in instance network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:10:16.612125 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating instance_info_cache with network_info: [{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:16.838922 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: 512a75c8-713d-418b-adc8-07b2bf513923] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:16.946627 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:10:16.978892 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:16.981945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.010744 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.114420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40860617-9de0-47cd-bea3-d94213471945 req-c4b20c12-729e-46e0-a72a-82573d6ed683 service nova] Releasing lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:10:17.178009 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.185241 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.202605 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-02c9f816-1a7e-4981-a695-3ac3505cb686 req-7d416a34-61de-4fe3-9f84-49c7f678c54d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-vif-unplugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:17.202743 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-02c9f816-1a7e-4981-a695-3ac3505cb686 req-7d416a34-61de-4fe3-9f84-49c7f678c54d service nova] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:17.202897 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-02c9f816-1a7e-4981-a695-3ac3505cb686 req-7d416a34-61de-4fe3-9f84-49c7f678c54d service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:17.203064 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-02c9f816-1a7e-4981-a695-3ac3505cb686 req-7d416a34-61de-4fe3-9f84-49c7f678c54d service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:17.203236 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-02c9f816-1a7e-4981-a695-3ac3505cb686 req-7d416a34-61de-4fe3-9f84-49c7f678c54d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] No waiting events found dispatching network-vif-unplugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:17.203396 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-02c9f816-1a7e-4981-a695-3ac3505cb686 req-7d416a34-61de-4fe3-9f84-49c7f678c54d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-vif-unplugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:17.305596 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99870497999973 future=<Future at 0x71a75c14b800 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:17.313051 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Instance destroyed successfully.
May 28 14:10:17.313565 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'resources' on Instance uuid cfa684f7-1fb1-4e0f-bf60-3c42614b2670 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:17.599737 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:17.600227 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing instance network info cache due to event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:10:17.600227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] Acquiring lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:10:17.600227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] Acquired lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:10:17.600227 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:10:17.818963 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='multiattach-server-0',id=24,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdS+q+ARgQD1RV4VT0d7c7sPV5YAqwWVl3WBFCkwx5Rw3jppcIkc+EveAg+mNNgCdQD5W27GT4noIwa00Ffbu+DvLpuBce5SI6ptRSKIkJeu1tJpxi3fwve9lwTve9G+Q==',key_name='tempest-keypair-1805069586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:05:07Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-is2gkfif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81cf50caaafd43ffae63aff9c9258528',uuid=cfa684f7-1fb1-4e0f-bf60-3c42614b2670,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:10:17.819231 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "address": "fa:16:3e:cc:f3:b8", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f757d6-e1", "ovs_interfaceid": "c7f757d6-e1c6-43c4-be67-443fe29dcb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:17.820019 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f3:b8,bridge_name='br-int',has_traffic_filtering=True,id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f757d6-e1') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:17.820326 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f3:b8,bridge_name='br-int',has_traffic_filtering=True,id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f757d6-e1') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:10:17.822779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.822779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7f757d6-e1, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:17.830280 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.831742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:17.832414 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.832601 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f668bd54-39e3-4387-aa27-321bd09b1443) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:17.833169 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.833779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:17.834281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:17.838474 np0000001643 nova-compute[98269]: INFO os_vif [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f3:b8,bridge_name='br-int',has_traffic_filtering=True,id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f757d6-e1')
May 28 14:10:17.838474 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Deleting instance files /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670_del
May 28 14:10:17.838474 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Deletion of /opt/stack/data/nova/instances/cfa684f7-1fb1-4e0f-bf60-3c42614b2670_del complete
May 28 14:10:17.947055 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:17.947570 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:17.947702 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:17.947763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:10:17.947903 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] No VIF found with MAC fa:16:3e:f9:dc:0e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:10:18.103730 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:18.346432 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 14:10:18.347354 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:10:18.347486 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:10:18.347575 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:10:18.347764 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:18.479487 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:18.483876 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:10:18.651484 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Rebuilding instance
May 28 14:10:18.711539 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updated VIF entry in instance network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:10:18.711957 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating instance_info_cache with network_info: [{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:18.851345 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:18.926879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f36d7ce0-a684-448e-a105-f0a4a40d3d6c req-2b7ff981-8927-4a13-9407-605bcaa75f52 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-vif-deleted-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:18.928832 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-f36d7ce0-a684-448e-a105-f0a4a40d3d6c req-2b7ff981-8927-4a13-9407-605bcaa75f52 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Neutron deleted interface c7f757d6-e1c6-43c4-be67-443fe29dcb8a; detaching it from the instance and deleting it from the info cache
May 28 14:10:18.932335 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f36d7ce0-a684-448e-a105-f0a4a40d3d6c req-2b7ff981-8927-4a13-9407-605bcaa75f52 service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Detach interface failed, port_id=c7f757d6-e1c6-43c4-be67-443fe29dcb8a, reason: Instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:10:19.216659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-35ac5d70-8156-4e11-a833-fd78e2e2fc11 req-d4bae476-79c5-45b2-a4fb-fdd23c2c9730 service nova] Releasing lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:10:19.290857 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-710011cc-c20f-4c32-8dbe-131dbf1a95ef req-0b85a66f-c0e9-4cc0-b675-44098947339d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-vif-unplugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:19.294950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-710011cc-c20f-4c32-8dbe-131dbf1a95ef req-0b85a66f-c0e9-4cc0-b675-44098947339d service nova] Acquiring lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:19.295262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-710011cc-c20f-4c32-8dbe-131dbf1a95ef req-0b85a66f-c0e9-4cc0-b675-44098947339d service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:19.295494 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-710011cc-c20f-4c32-8dbe-131dbf1a95ef req-0b85a66f-c0e9-4cc0-b675-44098947339d service nova] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:19.298573 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-710011cc-c20f-4c32-8dbe-131dbf1a95ef req-0b85a66f-c0e9-4cc0-b675-44098947339d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] No waiting events found dispatching network-vif-unplugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:19.298573 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-710011cc-c20f-4c32-8dbe-131dbf1a95ef req-0b85a66f-c0e9-4cc0-b675-44098947339d service nova] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Received event network-vif-unplugged-c7f757d6-e1c6-43c4-be67-443fe29dcb8a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:19.345969 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:10:19.518604 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eee72f70-c047-4112-a500-20b07e7e60c1 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.596s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:19.604564 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:19.849275 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Took 1.50 seconds to deallocate network for instance.
May 28 14:10:19.890765 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:19.896526 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:19.919947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:19.923359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:19.929184 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:19.966152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.182008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.200359 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.218608 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.993394564000027 future=<Future at 0x71a75c257c80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:20.220809 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance destroyed successfully.
May 28 14:10:20.229590 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance destroyed successfully.
May 28 14:10:20.231003 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-196826295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionsv293testjson-server-1969542837',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWqUmazuWr5QAW+GKtq0415oQwe6/xm6gDlnVvRcqD/QtIWC8P3QDTb7VtkMt79wsvUYrKGtnMX+YVcnq7jhlbr4oQd5Vly4UXaqyN3WNt0Xd3z6c1g+S5TRBr8pq0wWw==',key_name='tempest-keypair-1994480753',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:09:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='061e1b7a86244ea1b9be96940816b397',ramdisk_id='',reservation_id='r-eaidfmmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-537604347',owner_user_name='tempest-ServerActionsV293TestJSON-537604347-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad96e52e071f4b3b9057ec1a411058b4',uuid=d1db720f-ec51-4cb4-9ca9-60844350d239,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:10:20.231328 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converting VIF {"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:20.232118 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:20.232118 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:10:20.233106 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.233188 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0706fd7-16, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:20.234856 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.236297 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:20.236965 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.237479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.237959 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=323ceaaf-ac23-4a87-b8a0-c767e8500fd8) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:20.240262 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.240750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:20.241406 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:20.243521 np0000001643 nova-compute[98269]: INFO os_vif [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16')
May 28 14:10:20.244688 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:10:20.245175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:20.245175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:20.245558 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:10:20.245888 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:10:20.246725 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:10:20.287262 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:10:20.287741 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb', '90')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:10:20.287741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '78')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:10:20.289863 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '79')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:10:20.293322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c170c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'): ({'sdg'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:10:20.293322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:10:20.294928 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Flush multipath device 3300000001ce0f605 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:10:20.358794 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:20.358794 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:20.439336 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Detaching volume 6ca6f39a-a2e6-4d96-abda-6227942e3eb1
May 28 14:10:20.504842 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attempting to driver detach volume 6ca6f39a-a2e6-4d96-abda-6227942e3eb1 from mountpoint /dev/vdc
May 28 14:10:20.518862 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Found disk vdc by alias ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:10:20.520840 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Found disk vdc by alias ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:10:20.521547 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Attempting to detach device vdc from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:10:20.521547 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:10:20.521547 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:10:20.521547 np0000001643 nova-compute[98269]:   <alias name="ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1"/>
May 28 14:10:20.521547 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-11"/>
May 28 14:10:20.521547 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:10:20.521547 np0000001643 nova-compute[98269]:   <serial>6ca6f39a-a2e6-4d96-abda-6227942e3eb1</serial>
May 28 14:10:20.521547 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:10:20.521547 np0000001643 nova-compute[98269]: </disk>
May 28 14:10:20.521547 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:10:20.533163 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Successfully detached device vdc from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the persistent domain config.
May 28 14:10:20.533400 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] (1/8): Attempting to detach device vdc with device alias ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:10:20.534265 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:10:20.534265 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:10:20.534265 np0000001643 nova-compute[98269]:   <alias name="ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1"/>
May 28 14:10:20.534265 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-11"/>
May 28 14:10:20.534265 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:10:20.534265 np0000001643 nova-compute[98269]:   <serial>6ca6f39a-a2e6-4d96-abda-6227942e3eb1</serial>
May 28 14:10:20.534265 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:10:20.534265 np0000001643 nova-compute[98269]: </disk>
May 28 14:10:20.534265 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:10:20.908106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:10:20.909832 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:10:21.017208 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:21.019086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:21.019586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:21.019819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:21.019999 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] No waiting events found dispatching network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:21.020135 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received unexpected event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 for instance with vm_state active and task_state rebuilding.
May 28 14:10:21.020239 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:21.020405 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:21.020906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:21.021087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:21.023732 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] No waiting events found dispatching network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:21.023732 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9a2e00bb-8e23-4d1c-b231-38633ffb09c3 req-d292e2e5-12c5-4b00-bcb5-8c1c1ca1628a service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received unexpected event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 for instance with vm_state active and task_state rebuilding.
May 28 14:10:21.214468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977421.21398, 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 => ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:10:21.215859 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 for instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:10:21.219129 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Successfully detached device vdc from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the live domain config.
May 28 14:10:21.220330 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:10:21.220663 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:21.220826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:21.413090 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:10:21.922030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.564s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:21.973676 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocations for instance cfa684f7-1fb1-4e0f-bf60-3c42614b2670
May 28 14:10:22.983733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-edce0791-5398-47db-bd3c-37bad45b2282 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "cfa684f7-1fb1-4e0f-bf60-3c42614b2670" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.547s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:24.343694 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:24.346254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:24.346254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:24.346254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:24.346254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:24.347124 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Terminating instance
May 28 14:10:24.605498 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:24.851167 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:10:24.875061 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:24.875061 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:24.902840 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:24.905363 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:24.934190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:24.942099 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.036796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-423d21fa-a785-4f9b-9090-fdf001505858 req-70058005-f740-4fdb-9a7d-ecfa10ebab29 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:25.036796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-423d21fa-a785-4f9b-9090-fdf001505858 req-70058005-f740-4fdb-9a7d-ecfa10ebab29 service nova] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:25.036796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-423d21fa-a785-4f9b-9090-fdf001505858 req-70058005-f740-4fdb-9a7d-ecfa10ebab29 service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:25.036796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-423d21fa-a785-4f9b-9090-fdf001505858 req-70058005-f740-4fdb-9a7d-ecfa10ebab29 service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:25.036796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-423d21fa-a785-4f9b-9090-fdf001505858 req-70058005-f740-4fdb-9a7d-ecfa10ebab29 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] No waiting events found dispatching network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:25.036796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-423d21fa-a785-4f9b-9090-fdf001505858 req-70058005-f740-4fdb-9a7d-ecfa10ebab29 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:25.180748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.187963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.206891 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999706865000007 future=<Future at 0x71a75c16ede0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:25.208121 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Instance destroyed successfully.
May 28 14:10:25.208556 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lazy-loading 'resources' on Instance uuid 27823c45-9fce-41b2-923b-a5a907ef029c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:25.240986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.714058 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-55580316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumemultiattachtest-server-55580316',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:04:49Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac4618bb9b554fb8af8f26aae95c016a',ramdisk_id='',reservation_id='r-raywm34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-AttachVolumeMultiAttachTest-1067442384',owner_user_name='tempest-AttachVolumeMultiAttachTest-1067442384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:04:49Z,user_data=None,user_id='81cf50caaafd43ffae63aff9c9258528',uuid=27823c45-9fce-41b2-923b-a5a907ef029c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:10:25.714608 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converting VIF {"id": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "address": "fa:16:3e:14:55:45", "network": {"id": "8500a35b-96b5-4686-b87f-986c689566b1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1234743871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac4618bb9b554fb8af8f26aae95c016a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511a4a6-e6", "ovs_interfaceid": "2511a4a6-e6ab-4e66-b913-c5837539cdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:10:25.714912 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:55:45,bridge_name='br-int',has_traffic_filtering=True,id=2511a4a6-e6ab-4e66-b913-c5837539cdfb,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511a4a6-e6') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:10:25.715165 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:55:45,bridge_name='br-int',has_traffic_filtering=True,id=2511a4a6-e6ab-4e66-b913-c5837539cdfb,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511a4a6-e6') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:10:25.716251 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.716534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2511a4a6-e6, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:25.727701 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.727701 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:25.728047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.728900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.729063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=420e44a4-428a-451d-854e-5eb1baa0b56c) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:10:25.730881 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.730881 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:10:25.732283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:25.734525 np0000001643 nova-compute[98269]: INFO os_vif [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:55:45,bridge_name='br-int',has_traffic_filtering=True,id=2511a4a6-e6ab-4e66-b913-c5837539cdfb,network=Network(8500a35b-96b5-4686-b87f-986c689566b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511a4a6-e6')
May 28 14:10:25.789940 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:10:25.790220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:25.790374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:26.827156 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:26.827745 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:26.827745 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:26.827840 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:26.827911 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:10:26.828177 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:10:27.047377 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003558960002010281 future=<Future at 0x71a7801e2c60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:27.047519 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:27.047631 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.256503178999992 future=<Future at 0x71a75c14b800 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:27.047719 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.256410586000129 future=<Future at 0x71a75c14b800 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:27.048019 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Emitting event <LifecycleEvent: 1779977412.0468285, 0cb5afe2-5125-4261-b2f3-f0431bc65134 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:27.048192 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] VM Stopped (Lifecycle Event)
May 28 14:10:27.107850 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c429308f-97fe-49e8-8f80-9612c88888b6 req-d5606877-dc14-4309-85c3-0d8506da744a service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:10:27.108869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c429308f-97fe-49e8-8f80-9612c88888b6 req-d5606877-dc14-4309-85c3-0d8506da744a service nova] Acquiring lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:27.108869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c429308f-97fe-49e8-8f80-9612c88888b6 req-d5606877-dc14-4309-85c3-0d8506da744a service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:27.108869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c429308f-97fe-49e8-8f80-9612c88888b6 req-d5606877-dc14-4309-85c3-0d8506da744a service nova] Lock "27823c45-9fce-41b2-923b-a5a907ef029c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:27.108869 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c429308f-97fe-49e8-8f80-9612c88888b6 req-d5606877-dc14-4309-85c3-0d8506da744a service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] No waiting events found dispatching network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:10:27.108869 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c429308f-97fe-49e8-8f80-9612c88888b6 req-d5606877-dc14-4309-85c3-0d8506da744a service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-unplugged-2511a4a6-e6ab-4e66-b913-c5837539cdfb for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:10:27.553045 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 0cb5afe2-5125-4261-b2f3-f0431bc65134] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:27.824022 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:27.824352 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:10:27.826720 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:27.827027 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:10:29.608400 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:29.826993 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:29.827237 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:30.332832 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:30.333070 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:30.333539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:30.333745 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:10:30.730845 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:31.381788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:31.504328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:31.504938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:31.598437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:31.610740 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:10:31.614719 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:10:31.619035 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:10:31.621627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:31.716310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:31.716754 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:31.810238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:31.810846 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:10:31.817300 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:31.918867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:31.919407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:32.013345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:32.013855 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:10:32.021502 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:10:32.023421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:32.072341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:10:32.072786 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12297MB free_disk=73.10624694824219GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:10:32.072981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:32.073381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:32.304738 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00045599400027640513 future=<Future at 0x71a75c14b800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:32.305119 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] Emitting event <LifecycleEvent: 1779977417.304079, cfa684f7-1fb1-4e0f-bf60-3c42614b2670 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:32.305279 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:32.305502 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] VM Stopped (Lifecycle Event)
May 28 14:10:32.306514 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=2.9046820989997286 future=<Future at 0x71a75c257c80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:32.306710 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=2.904443314999753 future=<Future at 0x71a75c257c80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:32.808060 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-96097ad8-6754-47d2-b663-fe838aba03fe tempest-AttachVolumeTestJSON-1658324310 tempest-AttachVolumeTestJSON-1658324310-project-member] [instance: cfa684f7-1fb1-4e0f-bf60-3c42614b2670] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:33.128234 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 27823c45-9fce-41b2-923b-a5a907ef029c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:10:33.128627 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:10:33.128627 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:10:33.128627 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d1db720f-ec51-4cb4-9ca9-60844350d239 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:10:33.128785 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance f67c8d28-d6d9-4d52-960c-3d8e15622855 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:10:33.128785 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 811bba84-3c9c-4ff7-b115-919041083aa2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:10:33.128967 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:10:33.129087 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:10:32 up 37 min,  2 users,  load average: 6.19, 7.07, 4.47\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_deleting': '1', 'num_os_type_None': '6', 'num_proj_ac4618bb9b554fb8af8f26aae95c016a': '1', 'io_workload': '1', 'num_task_None': '4', 'num_proj_c6cef3deefeb451d897a690dd0e2529b': '1', 'num_proj_161531d31b404ab1bc2c6c340124f03d': '1', 'num_task_rebuilding': '1', 'num_proj_061e1b7a86244ea1b9be96940816b397': '1', 'num_proj_85522a95b1cc4a8191762582b962e162': '1', 'num_proj_1bd0a26536e743c9a9eaeb956fc55b79': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:10:33.434049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:10:33.434316 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:10:33.937299 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:10:34.445745 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:10:34.446189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.373s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:34.446189 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:10:34.609113 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:35.211588 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00037201200029812753 future=<Future at 0x71a75c257c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:35.211963 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Emitting event <LifecycleEvent: 1779977420.211088, d1db720f-ec51-4cb4-9ca9-60844350d239 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:35.212097 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:35.212297 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] VM Stopped (Lifecycle Event)
May 28 14:10:35.212394 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.99418149100029 future=<Future at 0x71a75c16ede0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:35.213420 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=4.993152659000316 future=<Future at 0x71a75c16ede0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:35.715030 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:35.717167 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuilding, current DB power_state: 1, VM power_state: 4 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:10:35.732680 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:36.219934 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] During sync_power_state the instance has a pending task (rebuilding). Skip.
May 28 14:10:36.442169 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:10:36.442492 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.38 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:10:39.609946 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:40.207053 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004004039997198561 future=<Future at 0x71a75c16ede0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:40.208018 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Emitting event <LifecycleEvent: 1779977425.2065065, 27823c45-9fce-41b2-923b-a5a907ef029c => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:10:40.208163 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] VM Stopped (Lifecycle Event)
May 28 14:10:40.210409 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:10:40.711936 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:10:40.715353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:10:40.734363 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:41.216478 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 14:10:42.036190 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:10:44.611872 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:45.736181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:49.613190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:50.738524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:52.891707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:52.892150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:53.395232 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:54.210666 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:54.211128 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:54.400533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:54.614844 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:54.715079 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'flavor' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:10:55.474480 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:55.474927 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:55.474927 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attaching volume a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 to /dev/vdb
May 28 14:10:55.517141 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:55.529543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:10:55.550840 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:55.604206 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:10:55.604779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:10:55.613834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:10:55.615466 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fea2:b90b', 'fe80::c880:3aff:fe3c:d2d3'] 
May 28 14:10:55.615646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:10:55.615778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:10:55.616064 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:55.616370 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating existing volume attachment record: 6792e01a-8fda-4445-964b-6d75ae05227b {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:10:55.721342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:10:55.740870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:10:56.168780 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:10:56.169263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:56.169491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:10:56.789617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:10:56.790305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:10:56.790305 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attaching volume 1658ff1e-7492-4410-be02-f676b0a4c4a0 to /dev/vdb
May 28 14:10:56.839007 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:56.853182 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:10:56.877748 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:10:56.927549 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:10:56.927834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:10:56.937953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:10:56.939543 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fea2:b90b', 'fe80::c880:3aff:fe3c:d2d3'] 
May 28 14:10:56.939707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:10:56.939845 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:10:56.940145 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:10:56.940482 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating existing volume attachment record: 5e25147b-e6a3-4148-bb9d-a80275bcc993 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:10:57.495336 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:10:57.495819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1658ff1e-7492-4410-be02-f676b0a4c4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:10:57.496025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:00.742514 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:05.744329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:10.746749 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:10.747193 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:10.747193 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:11:10.747193 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:11:10.752641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:10.752885 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:11:15.753434 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:20.337359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:20.382090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:20.427123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:11:20.427409 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:11:20.429687 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:11:20.443171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:11:20.443580 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:20.457958 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.496941 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260]
May 28 14:11:20.496941 np0000001643 nova-compute[98269]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260] successful.
May 28 14:11:20.496941 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.519348 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.532377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.573618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260]
May 28 14:11:20.573618 np0000001643 nova-compute[98269]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260] successful.
May 28 14:11:20.573618 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.597195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.597545 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.352s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:20.597702 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] <== disconnect_volume: return (60353ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:20.597876 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:20.598360 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Deleting instance files /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239_del
May 28 14:11:20.598805 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 59.378s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:20.599284 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:11:20.599411 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:11:20.600146 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Deletion of /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239_del complete
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1 (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:20.631548 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:20.632160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb', '90')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:11:20.632160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', '89')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:20.632940 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1', '88')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:20.633806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c764b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1'): ({'sdl'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:11:20.633982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Removing multipathed devices sdm, sdl {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:11:20.634213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Flush multipath device 3300000007322a2ff {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:11:20.668318 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:20.718166 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:20.753963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:20.754237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:20.754370 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:11:20.754437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:11:20.754911 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:20.755089 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:11:20.756877 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:11:20.757056 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:11:20.758466 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:11:20.769408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:11:20.769615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:20.781351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.821577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.40.100,3260]
May 28 14:11:20.821577 np0000001643 nova-compute[98269]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.40.100,3260] successful.
May 28 14:11:20.821577 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.839655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.850889 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.896715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.50.100,3260]
May 28 14:11:20.896715 np0000001643 nova-compute[98269]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-6ca6f39a-a2e6-4d96-abda-6227942e3eb1, portal: 192.168.50.100,3260] successful.
May 28 14:11:20.896715 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.915386 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:20.915680 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:20.915822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] <== disconnect_volume: return (59695ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:20.915954 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:20.917812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 55.127s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:20.918123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ab3ae63-2f4c-42b6-8889-670d79255c71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:11:20.918282 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:20.945463 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71 (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:20.945786 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:20.945786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb', '90')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:11:20.946139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '35')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:20.946810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71', '36')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:20.947839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c754540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:11:20.948039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:11:20.948324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Flush multipath device 330000000ddd07c73 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:11:21.012956 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:21.054030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:21.101315 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:11:21.101604 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:11:21.102919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:11:21.115937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:11:21.116258 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:21.131496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.168605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.40.100,3260]
May 28 14:11:21.168605 np0000001643 nova-compute[98269]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.40.100,3260] successful.
May 28 14:11:21.168605 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.188007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.200897 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d1db720f-ec51-4cb4-9ca9-60844350d239 could not be found.
May 28 14:11:21.201659 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.202383 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:11:21.202818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:21.203021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:21.240852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.50.100,3260]
May 28 14:11:21.240852 np0000001643 nova-compute[98269]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-7ab3ae63-2f4c-42b6-8889-670d79255c71, portal: 192.168.50.100,3260] successful.
May 28 14:11:21.240852 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.257377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.257646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:21.257765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] <== disconnect_volume: return (55467ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:21.257955 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:21.258537 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Deleting instance files /opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c_del
May 28 14:11:21.259154 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 25.090s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:21.259606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:11:21.260574 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Deletion of /opt/stack/data/nova/instances/27823c45-9fce-41b2-923b-a5a907ef029c_del complete
May 28 14:11:21.272253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:21.273147 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:21.273507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:21.273796 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:21.274347 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:21.275513 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:21.288471 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:21.288471 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.294502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:21.294502 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.302268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34] added
May 28 14:11:21.302268 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:21.302268 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:21.302268 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:21.302268 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:21.302268 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:21.302268 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.302672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:21.302751 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:21.303002 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:21.310201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34] added
May 28 14:11:21.310201 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:21.310201 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:21.310201 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:21.310201 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:21.310201 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:21.310201 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:21.310471 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:21.310694 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:21.310861 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:21.493987 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'flavor' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:21.767316 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Took 56.92 seconds to destroy the instance on the hypervisor.
May 28 14:11:21.768204 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:11:21.768582 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:11:21.768696 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:11:21.768975 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:21.883997 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:22.100230 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:22.196100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5aff5278-5272-416c-896d-c094eaa859a1 req-edbde3b1-7c43-4a50-9c2e-58ef8a3dd3c5 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Received event network-vif-deleted-2511a4a6-e6ab-4e66-b913-c5837539cdfb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:22.196246 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-5aff5278-5272-416c-896d-c094eaa859a1 req-edbde3b1-7c43-4a50-9c2e-58ef8a3dd3c5 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Neutron deleted interface 2511a4a6-e6ab-4e66-b913-c5837539cdfb; detaching it from the instance and deleting it from the info cache
May 28 14:11:22.197861 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5aff5278-5272-416c-896d-c094eaa859a1 req-edbde3b1-7c43-4a50-9c2e-58ef8a3dd3c5 service nova] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Detach interface failed, port_id=2511a4a6-e6ab-4e66-b913-c5837539cdfb, reason: Instance 27823c45-9fce-41b2-923b-a5a907ef029c could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:11:22.303424 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:22.311388 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:22.318987 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:22.318987 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:22.327081 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:22.327081 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.333848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.342484 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.352344 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:22.360164 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.360164 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.360164 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.360164 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.360164 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.360164 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.360164 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.360164 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:22.360425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.360425 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.360425 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.360425 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.360425 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.360425 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.360425 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.360425 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:22.399608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.50.100,3260]
May 28 14:11:22.399608 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.50.100,3260] successful.
May 28 14:11:22.399608 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.408577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.40.100,3260]
May 28 14:11:22.408577 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.40.100,3260] successful.
May 28 14:11:22.408577 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.413855 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.421095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.431542 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.431876 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:22.432099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:22.432180 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:22.433276 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('9', '-', '-', 0) found on session 91 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:22.433386 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.439614 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:22.440037 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:22.440037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:22.440365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:22.441013 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('10', '-', '-', 0) found on session 92 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:22.441122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:22.447867 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 91 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:22.447867 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:22.458952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:22.501602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6bb4f688-55dc-449d-93ed-4e755055bb2a tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 62.581s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:22.644929 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:11:22.845575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:22.845575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:23.147306 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Took 1.38 seconds to deallocate network for instance.
May 28 14:11:23.348166 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Detaching volume 7e296d07-c7b1-4a0a-95fa-efe3387ecc29
May 28 14:11:23.392393 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Attempting to driver detach volume 7e296d07-c7b1-4a0a-95fa-efe3387ecc29 from mountpoint /dev/vdb
May 28 14:11:23.396689 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Found disk vdb by alias ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:11:23.397351 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Found disk vdb by alias ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:11:23.397462 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Attempting to detach device vdb from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:11:23.397704 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:11:23.397704 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:23.397704 np0000001643 nova-compute[98269]:   <alias name="ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29"/>
May 28 14:11:23.397704 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:11:23.397704 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:23.397704 np0000001643 nova-compute[98269]:   <serial>7e296d07-c7b1-4a0a-95fa-efe3387ecc29</serial>
May 28 14:11:23.397704 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:11:23.397704 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:23.397704 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:11:23.404968 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Successfully detached device vdb from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the persistent domain config.
May 28 14:11:23.405212 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] (1/8): Attempting to detach device vdb with device alias ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:11:23.405571 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:11:23.405571 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:23.405571 np0000001643 nova-compute[98269]:   <alias name="ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29"/>
May 28 14:11:23.405571 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:11:23.405571 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:23.405571 np0000001643 nova-compute[98269]:   <serial>7e296d07-c7b1-4a0a-95fa-efe3387ecc29</serial>
May 28 14:11:23.405571 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:11:23.405571 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:23.405571 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:11:23.457476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:23.457648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:23.704705 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: 27823c45-9fce-41b2-923b-a5a907ef029c] Took 0.56 seconds to detach 1 volumes for instance.
May 28 14:11:23.946427 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977483.9459593, 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 => ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:11:23.947510 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 for instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:11:23.950114 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Successfully detached device vdb from instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 from the live domain config.
May 28 14:11:23.951214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:11:23.951486 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:23.951607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:24.210891 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:24.211573 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:24.289387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found WWN 33000000070884b35 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:11:24.289672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:24.290004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== connect_volume: return (28120ms) {'type': 'block', 'scsi_wwn': '33000000070884b35', 'path': '/dev/dm-1', 'multipath_id': '33000000070884b35'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:24.290204 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000070884b35', 'path': '/dev/dm-1', 'multipath_id': '33000000070884b35'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:11:24.290458 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 26.794s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:24.290669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1658ff1e-7492-4410-be02-f676b0a4c4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:11:24.292820 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:24.301790 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:24.302790 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:24.303219 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:24.303418 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:24.304061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:24.305120 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:24.315224 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:24.315224 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:24.320349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:24.320349 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:24.329541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0] added
May 28 14:11:24.329541 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:24.329541 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:24.329541 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:24.329541 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:24.329541 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:24.329541 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:24.329835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:24.330000 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0266(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:24.330207 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:24.333604 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0] added
May 28 14:11:24.333604 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:24.333604 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:24.333604 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:24.333604 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:24.333604 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:24.333604 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:24.333777 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:24.333989 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:24.334168 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:24.569603 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:11:24.569814 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:11:24.795869 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attempting to attach volume a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:11:24.797179 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:11:24.797179 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:24.797179 np0000001643 nova-compute[98269]:   <alias name="ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34"/>
May 28 14:11:24.797179 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:11:24.797179 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:24.797179 np0000001643 nova-compute[98269]:   <serial>a5ab1a7e-e37b-480f-9a6e-4b84dd713f34</serial>
May 28 14:11:24.797179 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:24.797179 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:11:25.072609 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:11:25.330918 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:25.334556 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:25.347571 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:25.347571 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:25.352763 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:25.352763 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.361513 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.367489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.382908 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.383391 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.388623 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.388951 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:25.430848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.50.100,3260]
May 28 14:11:25.430848 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.50.100,3260] successful.
May 28 14:11:25.430848 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.443729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.448443 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.40.100,3260]
May 28 14:11:25.448443 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.40.100,3260] successful.
May 28 14:11:25.448443 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.463294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.463976 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.464475 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:25.464734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:25.464734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:25.466219 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] HCTL ('11', '-', '-', 0) found on session 93 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:25.466219 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.485242 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:25.485832 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:25.486366 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:25.486366 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:25.488751 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] HCTL ('12', '-', '-', 0) found on session 94 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:25.488751 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:25.488873 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 93 and hctl ['11', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:25.514286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 94 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:25.515558 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1658ff1e-7492-4410-be02-f676b0a4c4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:25.581702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.370s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:25.667782 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Deleted allocations for instance 27823c45-9fce-41b2-923b-a5a907ef029c
May 28 14:11:25.756194 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:26.434311 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:26.434768 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:26.434768 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:26.434768 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:29:77:5f, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:11:26.489610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 93 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:26.489765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1658ff1e-7492-4410-be02-f676b0a4c4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:26.677664 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4d2e0052-2740-4018-a196-c7cdb55e6711 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Lock "27823c45-9fce-41b2-923b-a5a907ef029c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 62.333s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:26.827015 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:26.827263 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:26.827381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:11:26.827668 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:11:27.318279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Found WWN 330000000ca460af1 for multipath device dm-2 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:11:27.318554 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:27.318703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== connect_volume: return (29823ms) {'type': 'block', 'scsi_wwn': '330000000ca460af1', 'path': '/dev/dm-2', 'multipath_id': '330000000ca460af1'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:27.318875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ca460af1', 'path': '/dev/dm-2', 'multipath_id': '330000000ca460af1'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:11:27.319554 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.116s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:27.319915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:11:27.320136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:11:27.321788 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'flavor' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.350806 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.351236 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '94')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:11:27.351236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:27.351866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:11:27.351866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:27.351866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:11:27.351866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c766fc0>, {}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:11:27.351866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Disconnecting from: [] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:27.352338 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.033s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:27.352542 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] <== disconnect_volume: return (6149ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:27.352613 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:27.354204 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.402s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:27.354312 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:11:27.354524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.386670 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29 (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:27.387005 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:27.387005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d42d3619-67b6-4c90-b286-3c290840f2cb', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '94')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:11:27.387321 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '83')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:27.388060 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29', '82')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:27.388994 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c3c65c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:11:27.389203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:11:27.389435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Flush multipath device 3300000007aa7d4c7 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:11:27.427044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:27.472679 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:27.514080 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:11:27.514331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:11:27.516691 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:11:27.529202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:11:27.529473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:27.541130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:27.575674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.40.100,3260]
May 28 14:11:27.575674 np0000001643 nova-compute[98269]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.40.100,3260] successful.
May 28 14:11:27.575674 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:27.600122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:27.615409 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:27.656176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.50.100,3260]
May 28 14:11:27.656176 np0000001643 nova-compute[98269]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-7e296d07-c7b1-4a0a-95fa-efe3387ecc29, portal: 192.168.50.100,3260] successful.
May 28 14:11:27.656176 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:27.675769 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:27.676055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:27.676348 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] <== disconnect_volume: return (3724ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:27.676663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:27.732749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:27.825977 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attempting to attach volume 1658ff1e-7492-4410-be02-f676b0a4c4a0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:11:27.827223 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:27.828240 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:11:27.828240 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:27.828240 np0000001643 nova-compute[98269]:   <alias name="ua-1658ff1e-7492-4410-be02-f676b0a4c4a0"/>
May 28 14:11:27.828240 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-2"/>
May 28 14:11:27.828240 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:27.828240 np0000001643 nova-compute[98269]:   <serial>1658ff1e-7492-4410-be02-f676b0a4c4a0</serial>
May 28 14:11:27.828240 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:27.828240 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:11:27.830030 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:27.830104 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:11:28.004881 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cbde91e4-72ca-41db-985d-00272dacc4ea tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.530s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:28.005947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.272s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:28.237660 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'flavor' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:28.509548 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:28.559368 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Preparing to wait for external event volume-reimaged-4977f462-5866-4abc-9b09-8f7ea2ac690f {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:11:28.560160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:28.560160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:28.560470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:28.827248 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:28.827981 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:11:29.249065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55e03733-b718-44ea-9391-2b852c018f1c tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.404s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:29.251265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:29.499599 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:29.499778 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:29.499864 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:29.500055 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No VIF found with MAC fa:16:3e:a2:b9:0b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:11:29.515019 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:30.329159 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:30.329470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:30.329678 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attaching volume 1003165e-0fe9-43e7-9f4a-f15cf89c7b85 to /dev/vdc
May 28 14:11:30.335937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:30.336146 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:30.337129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:30.337129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:30.337281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:30.339404 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Terminating instance
May 28 14:11:30.383181 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:30.396156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:11:30.423861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:30.472018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:11:30.472425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:11:30.482427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:11:30.484143 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef9:dc0e', 'fe80::208a:2dff:fe39:cd7d', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fea2:b90b', 'fe80::c880:3aff:fe3c:d2d3'] 
May 28 14:11:30.484919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:11:30.485089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:11:30.485441 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:30.485787 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating existing volume attachment record: ec6b6c3a-57ee-451a-846d-b1e74b38a314 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:11:30.758730 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:30.828179 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:30.848065 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:11:30.872239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:30.881428 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:30.906099 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:30.912212 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:30.933738 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:31.071420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e28b1a40-ba5d-40e2-9b3c-26403c6e4a37 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.281s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:31.119424 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '811bba84-3c9c-4ff7-b115-919041083aa2', 'attached_at': '', 'detached_at': '', 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'serial': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:11:31.123274 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:11:31.123742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:31.123959 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:31.215755 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c18de45-4585-418a-975a-3c37d65823c2 req-d877e1f9-e423-49a7-a50d-27c374fcc334 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-vif-unplugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:31.216180 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c18de45-4585-418a-975a-3c37d65823c2 req-d877e1f9-e423-49a7-a50d-27c374fcc334 service nova] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:31.216385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c18de45-4585-418a-975a-3c37d65823c2 req-d877e1f9-e423-49a7-a50d-27c374fcc334 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:31.216539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c18de45-4585-418a-975a-3c37d65823c2 req-d877e1f9-e423-49a7-a50d-27c374fcc334 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:31.216699 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c18de45-4585-418a-975a-3c37d65823c2 req-d877e1f9-e423-49a7-a50d-27c374fcc334 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] No waiting events found dispatching network-vif-unplugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:11:31.216784 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c18de45-4585-418a-975a-3c37d65823c2 req-d877e1f9-e423-49a7-a50d-27c374fcc334 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-vif-unplugged-d310411e-f4f5-4d52-8377-6997e6441188 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:11:31.226275 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999695074000101 future=<Future at 0x71a7803929c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:31.226905 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998327794000033 future=<Future at 0x71a7803929c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:31.227018 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998177614999804 future=<Future at 0x71a7803929c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:31.227908 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Instance destroyed successfully.
May 28 14:11:31.228180 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lazy-loading 'resources' on Instance uuid 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:31.339730 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:31.339995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:31.340231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:31.340424 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:11:31.595211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:31.595211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:31.731064 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-407309817',display_name='tempest-TestServerVolumeAttachmentScenario-server-407309817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testservervolumeattachmentscenario-server-407309817',id=37,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZfOfyM7W/rUhU1urnNBqiL6frM26EP1oog9qgPHSiazxukV9bdCe2c2cVzfv4eHFqcU6gxo6Y/nrdUQSSh8CQdxH/1+D+86X+hhFTCUQzWOX9MNfNDu5k84z479rrNvw==',key_name='tempest-keypair-1074101902',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:09:19Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6cef3deefeb451d897a690dd0e2529b',ramdisk_id='',reservation_id='r-xiruct9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1229630570',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1229630570-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072a73099ec74dbd8f4253608d1d04f9',uuid=1ca77ae6-a7dc-4176-842d-c19b0b6ffc82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:11:31.731253 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Converting VIF {"id": "d310411e-f4f5-4d52-8377-6997e6441188", "address": "fa:16:3e:f9:dc:0e", "network": {"id": "61c829b2-42b5-4977-96f2-ec6fae6c3e71", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-376876181-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6cef3deefeb451d897a690dd0e2529b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd310411e-f4", "ovs_interfaceid": "d310411e-f4f5-4d52-8377-6997e6441188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:11:31.732220 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=d310411e-f4f5-4d52-8377-6997e6441188,network=Network(61c829b2-42b5-4977-96f2-ec6fae6c3e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd310411e-f4') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:11:31.732594 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=d310411e-f4f5-4d52-8377-6997e6441188,network=Network(61c829b2-42b5-4977-96f2-ec6fae6c3e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd310411e-f4') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:11:31.734885 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:31.735125 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd310411e-f4, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:31.736348 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:31.737262 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:31.738040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:31.738217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffea0598-8a32-4952-86a5-ce8314200e46) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:31.738793 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:31.739387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:31.741409 np0000001643 nova-compute[98269]: INFO os_vif [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:dc:0e,bridge_name='br-int',has_traffic_filtering=True,id=d310411e-f4f5-4d52-8377-6997e6441188,network=Network(61c829b2-42b5-4977-96f2-ec6fae6c3e71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd310411e-f4')
May 28 14:11:31.741809 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Deleting instance files /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82_del
May 28 14:11:31.742799 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Deletion of /opt/stack/data/nova/instances/1ca77ae6-a7dc-4176-842d-c19b0b6ffc82_del complete
May 28 14:11:31.977727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.854s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:31.978729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:11:31.990661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:31.991556 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:31.992328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:31.992597 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:31.992943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:31.993494 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:32.006320 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:32.006320 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:32.012464 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:32.012464 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:32.019637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85] added
May 28 14:11:32.019637 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:32.019637 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:32.019637 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:32.019637 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:32.019637 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:32.019637 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:32.019637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:32.019930 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:32.019980 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:32.025705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:32.026114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:32.028058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85] added
May 28 14:11:32.028058 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:32.028058 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:32.028058 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:32.028058 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:32.028058 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:32.028058 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:32.028289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:32.028481 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:32.028637 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:32.096843 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Detaching volume f68effdf-6a5b-4823-b648-2ea22694e77c
May 28 14:11:32.138369 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Attempting to driver detach volume f68effdf-6a5b-4823-b648-2ea22694e77c from mountpoint /dev/vdb
May 28 14:11:32.143177 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Found disk vdb by alias ua-f68effdf-6a5b-4823-b648-2ea22694e77c {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:11:32.144623 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Found disk vdb by alias ua-f68effdf-6a5b-4823-b648-2ea22694e77c {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:11:32.144731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Attempting to detach device vdb from instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:11:32.145082 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:11:32.145082 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:32.145082 np0000001643 nova-compute[98269]:   <alias name="ua-f68effdf-6a5b-4823-b648-2ea22694e77c"/>
May 28 14:11:32.145082 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:11:32.145082 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:32.145082 np0000001643 nova-compute[98269]:   <serial>f68effdf-6a5b-4823-b648-2ea22694e77c</serial>
May 28 14:11:32.145082 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:11:32.145082 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:32.145082 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:11:32.150709 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully detached device vdb from instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 from the persistent domain config.
May 28 14:11:32.150825 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] (1/8): Attempting to detach device vdb with device alias ua-f68effdf-6a5b-4823-b648-2ea22694e77c from instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:11:32.151091 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:11:32.151091 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:32.151091 np0000001643 nova-compute[98269]:   <alias name="ua-f68effdf-6a5b-4823-b648-2ea22694e77c"/>
May 28 14:11:32.151091 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:11:32.151091 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:32.151091 np0000001643 nova-compute[98269]:   <serial>f68effdf-6a5b-4823-b648-2ea22694e77c</serial>
May 28 14:11:32.151091 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:11:32.151091 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:32.151091 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:11:32.249345 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 14:11:32.249972 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:11:32.250168 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:11:32.250288 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:11:32.250654 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:32.343004 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:32.371048 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:32.475913 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:32.476533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:32.531264 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'flavor' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:32.584180 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:32.584629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:11:32.588864 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:11:32.589019 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:11:32.590150 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid '1ca77ae6-a7dc-4176-842d-c19b0b6ffc82' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid '1ca77ae6-a7dc-4176-842d-c19b0b6ffc82' (instance-00000025)
May 28 14:11:32.592681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:32.705464 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:32.705944 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:32.757640 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977492.7567961, 4a2e0c16-dd30-4f2b-a453-8febf9221c03 => ua-f68effdf-6a5b-4823-b648-2ea22694e77c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:11:32.758051 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f68effdf-6a5b-4823-b648-2ea22694e77c for instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:11:32.761055 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully detached device vdb from instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 from the live domain config.
May 28 14:11:32.762512 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:11:32.763005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:32.763248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:32.802836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:32.802986 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:11:32.805514 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:11:32.807188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:32.856477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:32.856817 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12898MB free_disk=73.09247207641602GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:11:32.856965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:32.857513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:32.911536 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b91956fa-023c-4077-86fb-e523612949fa req-e7f289fb-f841-42f9-a05c-60b5511dba18 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-vif-deleted-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:32.911760 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-b91956fa-023c-4077-86fb-e523612949fa req-e7f289fb-f841-42f9-a05c-60b5511dba18 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Neutron deleted interface d310411e-f4f5-4d52-8377-6997e6441188; detaching it from the instance and deleting it from the info cache
May 28 14:11:32.913370 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b91956fa-023c-4077-86fb-e523612949fa req-e7f289fb-f841-42f9-a05c-60b5511dba18 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Detach interface failed, port_id=d310411e-f4f5-4d52-8377-6997e6441188, reason: Instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:11:33.020561 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:33.029114 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:33.034376 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:33.034376 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:33.042891 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:33.042891 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.050916 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.057589 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.074201 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.074923 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.079825 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.080262 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:33.123246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.40.100,3260]
May 28 14:11:33.123246 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.40.100,3260] successful.
May 28 14:11:33.123246 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.134466 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.142275 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.50.100,3260]
May 28 14:11:33.142275 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.50.100,3260] successful.
May 28 14:11:33.142275 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.155907 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:33.156890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:33.156890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:33.157275 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:33.158310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('17', '-', '-', 0) found on session 97 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:33.160730 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:33.179090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 97 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:33.179090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:33.183364 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('18', '-', '-', 0) found on session 98 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:33.183364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:33.203483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 98 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:33.203483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:33.303551 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cc00b614-d2a7-4160-8fad-1ecec5b341fd req-175eac70-0d13-4280-b659-c90ba02dcfc1 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-vif-unplugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:33.304218 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cc00b614-d2a7-4160-8fad-1ecec5b341fd req-175eac70-0d13-4280-b659-c90ba02dcfc1 service nova] Acquiring lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:33.304379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cc00b614-d2a7-4160-8fad-1ecec5b341fd req-175eac70-0d13-4280-b659-c90ba02dcfc1 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:33.304520 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cc00b614-d2a7-4160-8fad-1ecec5b341fd req-175eac70-0d13-4280-b659-c90ba02dcfc1 service nova] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:33.304676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cc00b614-d2a7-4160-8fad-1ecec5b341fd req-175eac70-0d13-4280-b659-c90ba02dcfc1 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] No waiting events found dispatching network-vif-unplugged-d310411e-f4f5-4d52-8377-6997e6441188 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:11:33.304803 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cc00b614-d2a7-4160-8fad-1ecec5b341fd req-175eac70-0d13-4280-b659-c90ba02dcfc1 service nova] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Received event network-vif-unplugged-d310411e-f4f5-4d52-8377-6997e6441188 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:11:33.331831 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:11:33.428024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:33.542604 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:33.834144 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Took 1.58 seconds to deallocate network for instance.
May 28 14:11:33.949907 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:11:33.950010 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:11:33.950161 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d1db720f-ec51-4cb4-9ca9-60844350d239 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:11:33.950322 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance f67c8d28-d6d9-4d52-960c-3d8e15622855 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:11:33.950384 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 811bba84-3c9c-4ff7-b115-919041083aa2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:11:33.950589 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:11:33.950759 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:11:32 up 38 min,  2 users,  load average: 2.94, 5.96, 4.25\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_161531d31b404ab1bc2c6c340124f03d': '1', 'io_workload': '1', 'num_proj_85522a95b1cc4a8191762582b962e162': '1', 'num_proj_1bd0a26536e743c9a9eaeb956fc55b79': '1', 'num_task_deleting': '1', 'num_proj_c6cef3deefeb451d897a690dd0e2529b': '1', 'num_task_rebuilding': '1', 'num_proj_061e1b7a86244ea1b9be96940816b397': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:11:33.993423 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:11:34.288862 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:11:34.289268 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:11:34.342641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:34.623158 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:34.629857 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:34.629975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:34.630380 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attaching volume c9e2c9d9-aff3-4702-9207-57b405b7054c to /dev/vdc
May 28 14:11:34.682318 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:34.698935 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:11:34.724318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:34.777266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:11:34.777578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:11:34.787711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:11:34.789321 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fee0:a259', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fea2:b90b', 'fe80::c880:3aff:fe3c:d2d3'] 
May 28 14:11:34.789535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:11:34.789749 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:11:34.790259 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:34.790490 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating existing volume attachment record: 4d26cc6c-d133-4f08-87c2-59b4eee991f3 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:11:34.796745 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:11:35.017463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found WWN 330000000543612c1 for multipath device dm-7 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:11:35.019216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:35.020228 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== connect_volume: return (3896ms) {'type': 'block', 'scsi_wwn': '330000000543612c1', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '330000000543612c1'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:35.026103 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000543612c1', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '330000000543612c1'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:11:35.026103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.258s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:35.026103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:11:35.026103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:11:35.030828 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:11:35.031034 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:11:35.035580 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: WARNING os_brick.encryptors.luks [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:35.068633 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:35.068633 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:35.069393 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:11:35.069393 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:11:35.070028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '87')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:35.070808 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x71a75c709730>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': '811bba84-3c9c-4ff7-b115-919041083aa2', 'attached_at': '', 'detached_at': '', 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'serial': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:11:35.070808 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] formatting encrypted volume /dev/dm-7 {{(pid=98269) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 14:11:35.071908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', '86')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:35.075625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778151bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'): ({'sdj'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:11:35.075625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Removing multipathed devices sdj, sdk {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:11:35.075625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Flush multipath device 33000000073aa8f05 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:11:35.113139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:35.163930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:35.218268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:11:35.218425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:11:35.220144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:11:35.234673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:11:35.234903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:35.248081 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.290040 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.40.100,3260]
May 28 14:11:35.290040 np0000001643 nova-compute[98269]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.40.100,3260] successful.
May 28 14:11:35.290040 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.307583 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:11:35.309626 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.451s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:35.310111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.967s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:35.310569 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:11:35.314943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.327014 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.367034 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.50.100,3260]
May 28 14:11:35.367034 np0000001643 nova-compute[98269]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, portal: 192.168.50.100,3260] successful.
May 28 14:11:35.367034 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.372392 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:11:35.372663 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9e2c9d9-aff3-4702-9207-57b405b7054c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:35.372848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:35.390143 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.390962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:35.390962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== disconnect_volume: return (2626ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:35.390962 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:35.393827 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.021s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:35.394087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9e2c9d9-aff3-4702-9207-57b405b7054c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:11:35.408748 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:35.411583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:35.412060 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:35.412343 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:35.412838 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:35.413118 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:35.429724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:35.429724 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.435774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:35.435774 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c] added
May 28 14:11:35.445876 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:35.445876 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:35.445876 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:35.450138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c] added
May 28 14:11:35.450138 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:35.450138 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:35.450138 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:35.450138 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:35.450138 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:35.450138 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:35.450138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:35.450644 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:35.450644 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:35.628760 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:11:35.629021 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:11:35.974640 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'flavor' on Instance uuid 4a2e0c16-dd30-4f2b-a453-8febf9221c03 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:36.132223 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:11:36.309710 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:36.310266 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:11:36.310603 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.52 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:11:36.396128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:36.446597 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:36.450886 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:36.462675 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:36.462675 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:36.473348 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:36.473348 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.485462 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.493490 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.508621 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.509126 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.517476 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.517791 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:36.568377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.40.100,3260]
May 28 14:11:36.568377 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.40.100,3260] successful.
May 28 14:11:36.568377 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.573906 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.50.100,3260]
May 28 14:11:36.573906 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.50.100,3260] successful.
May 28 14:11:36.573906 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.584283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.592897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.610069 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.610311 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:36.610600 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:36.610762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:36.613352 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] HCTL ('15', '-', '-', 0) found on session 99 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:36.613352 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.614917 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:36.615168 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:36.615384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:36.615529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:36.617023 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] HCTL ('16', '-', '-', 0) found on session 100 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:36.617023 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:36.638907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 99 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:36.638907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9e2c9d9-aff3-4702-9207-57b405b7054c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:36.639945 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.330s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:36.655632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Searching for a device in session 100 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:36.655632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c9e2c9d9-aff3-4702-9207-57b405b7054c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:36.714359 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Deleted allocations for instance 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82
May 28 14:11:36.739677 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:36.960700 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:36.981728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9b8c182-8b37-44be-82c3-bf44ad562ae6 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.388s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:36.983286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.023s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:36.983546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:36.983727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:36.983873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:36.987543 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Terminating instance
May 28 14:11:37.412933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:11:37.492305 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:11:37.517038 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:37.522059 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:37.544328 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:37.547265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:37.573547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:37.576271 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:37.724236 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b8d3838f-928c-48b2-89de-5d315679ff8d tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Lock "1ca77ae6-a7dc-4176-842d-c19b0b6ffc82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.388s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:37.783605 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7d9eaa31-fd2e-4d5e-99c4-a0eb3d66555b req-e2c37379-7dfb-473b-91f9-c486ed4ba3c4 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:37.784242 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d9eaa31-fd2e-4d5e-99c4-a0eb3d66555b req-e2c37379-7dfb-473b-91f9-c486ed4ba3c4 service nova] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:37.784459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d9eaa31-fd2e-4d5e-99c4-a0eb3d66555b req-e2c37379-7dfb-473b-91f9-c486ed4ba3c4 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:37.784662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d9eaa31-fd2e-4d5e-99c4-a0eb3d66555b req-e2c37379-7dfb-473b-91f9-c486ed4ba3c4 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:37.784818 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7d9eaa31-fd2e-4d5e-99c4-a0eb3d66555b req-e2c37379-7dfb-473b-91f9-c486ed4ba3c4 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] No waiting events found dispatching network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:11:37.785274 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7d9eaa31-fd2e-4d5e-99c4-a0eb3d66555b req-e2c37379-7dfb-473b-91f9-c486ed4ba3c4 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:11:37.842833 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999669465999887 future=<Future at 0x71a75c31c530 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:37.844293 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Instance destroyed successfully.
May 28 14:11:37.845571 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'resources' on Instance uuid 4a2e0c16-dd30-4f2b-a453-8febf9221c03 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:38.348458 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-339817763',display_name='tempest-VolumesBackupsTest-instance-339817763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesbackupstest-instance-339817763',id=38,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw3+ysJ+EVW96rU9YP/zkligz7yP96hPgDkPaWNE6GNSAbB+hbghNeKd8h0sJDO2CM58Hc/uymcJ4H7RWntABHvuVHYCAy0qQPT/4e1E6Ows1ajJiF6JcWvEm8mvR1i/g==',key_name='tempest-keypair-1898169288',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:09:22Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='161531d31b404ab1bc2c6c340124f03d',ramdisk_id='',reservation_id='r-bobc4ry7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-654288917',owner_user_name='tempest-VolumesBackupsTest-654288917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d64d4218444093a2b86cfdda17f742',uuid=4a2e0c16-dd30-4f2b-a453-8febf9221c03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:11:38.348733 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converting VIF {"id": "3fe90435-7ff4-48c5-a628-b59a9de38910", "address": "fa:16:3e:e0:a2:59", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe90435-7f", "ovs_interfaceid": "3fe90435-7ff4-48c5-a628-b59a9de38910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:11:38.349326 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=3fe90435-7ff4-48c5-a628-b59a9de38910,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe90435-7f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:11:38.349757 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=3fe90435-7ff4-48c5-a628-b59a9de38910,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe90435-7f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:11:38.352144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:38.352144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fe90435-7f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:38.353668 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:38.354850 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:38.355649 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:38.355649 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba94f2ef-91a5-4715-b974-7f35bd425e8d) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:38.356511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:38.356511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:38.357799 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:38.360548 np0000001643 nova-compute[98269]: INFO os_vif [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=3fe90435-7ff4-48c5-a628-b59a9de38910,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe90435-7f')
May 28 14:11:38.368077 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:11:38.368578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:38.368770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:38.431605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Found WWN 3300000005111871e for multipath device dm-8 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:11:38.431605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:38.431605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== connect_volume: return (3058ms) {'type': 'block', 'scsi_wwn': '3300000005111871e', 'path': '/dev/dm-8', 'multipath_id': '3300000005111871e'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:38.431605 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005111871e', 'path': '/dev/dm-8', 'multipath_id': '3300000005111871e'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:11:38.431605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.063s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:38.432198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68effdf-6a5b-4823-b648-2ea22694e77c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:11:38.432198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:11:38.434578 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'flavor' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:38.477720 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:38.478241 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:38.478241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '99')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:11:38.478763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:38.478763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:11:38.478763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:38.478763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68effdf-6a5b-4823-b648-2ea22694e77c') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:11:38.478928 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c3c4680>, {}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:11:38.479096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Disconnecting from: [] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:38.479322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:38.479439 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== disconnect_volume: return (110ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:38.479550 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:38.479814 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Deleting instance files /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03_del
May 28 14:11:38.481142 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Deletion of /opt/stack/data/nova/instances/4a2e0c16-dd30-4f2b-a453-8febf9221c03_del complete
May 28 14:11:38.941151 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attempting to attach volume c9e2c9d9-aff3-4702-9207-57b405b7054c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:11:38.942799 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:11:38.942799 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:38.942799 np0000001643 nova-compute[98269]:   <alias name="ua-c9e2c9d9-aff3-4702-9207-57b405b7054c"/>
May 28 14:11:38.942799 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-8"/>
May 28 14:11:38.942799 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:11:38.942799 np0000001643 nova-compute[98269]:   <serial>c9e2c9d9-aff3-4702-9207-57b405b7054c</serial>
May 28 14:11:38.942799 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:38.942799 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:11:38.990999 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Took 1.50 seconds to destroy the instance on the hypervisor.
May 28 14:11:38.991601 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:11:38.991901 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:11:38.992076 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:11:38.992813 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:39.056871 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:39.324957 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 req-8729882e-7525-4fce-b81c-6a83ec77db95 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event volume-reimaged-4977f462-5866-4abc-9b09-8f7ea2ac690f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:39.325179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 req-8729882e-7525-4fce-b81c-6a83ec77db95 service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:39.325349 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 req-8729882e-7525-4fce-b81c-6a83ec77db95 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:39.325544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 req-8729882e-7525-4fce-b81c-6a83ec77db95 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:39.325726 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 req-8729882e-7525-4fce-b81c-6a83ec77db95 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Processing event volume-reimaged-4977f462-5866-4abc-9b09-8f7ea2ac690f {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:11:39.326510 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance event wait completed in 10 seconds for volume-reimaged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:11:39.627099 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:39.768603 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:11:39.768603 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:11:39.768603 np0000001643 nova-compute[98269]:     <volume>1003165e-0fe9-43e7-9f4a-f15cf89c7b85</volume>
May 28 14:11:39.768603 np0000001643 nova-compute[98269]:   </usage>
May 28 14:11:39.768603 np0000001643 nova-compute[98269]: </secret>
May 28 14:11:39.768603 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:11:39.775156 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:39.831995 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Booting with volume 4977f462-5866-4abc-9b09-8f7ea2ac690f at /dev/vda
May 28 14:11:39.849700 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:39.849951 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] Acquiring lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:39.850178 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:39.850367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:39.850887 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] No waiting events found dispatching network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:11:39.851196 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-unplugged-3fe90435-7ff4-48c5-a628-b59a9de38910 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:11:39.851371 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Received event network-vif-deleted-3fe90435-7ff4-48c5-a628-b59a9de38910 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:39.851587 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Neutron deleted interface 3fe90435-7ff4-48c5-a628-b59a9de38910; detaching it from the instance and deleting it from the info cache
May 28 14:11:39.853611 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bac219c1-d008-4c3f-b383-b12a8ef3ccdf req-46dca662-8afd-47a8-affd-f020f4fb0001 service nova] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Detach interface failed, port_id=3fe90435-7ff4-48c5-a628-b59a9de38910, reason: Instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:11:39.871500 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:39.883648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:11:39.904526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:39.930063 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:39.930557 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:39.949697 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:11:39.950478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:11:39.958159 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:11:39.959786 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fea2:b90b', 'fe80::c880:3aff:fe3c:d2d3'] 
May 28 14:11:39.959972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:11:39.960188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:11:39.960855 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:39.961139 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Updating existing volume attachment record: 5da4e60b-b69e-402d-b646-8776bfb57487 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:11:40.102910 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:11:40.278153 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attempting to attach volume 1003165e-0fe9-43e7-9f4a-f15cf89c7b85 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:11:40.280428 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:   <alias name="ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85"/>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:   <serial>1003165e-0fe9-43e7-9f4a-f15cf89c7b85</serial>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="67d472f8-ef8a-43f2-bed1-7b7b500ef403"/>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:40.280428 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:11:40.434144 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:11:40.605121 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Took 1.61 seconds to deallocate network for instance.
May 28 14:11:40.622049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:40.622049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:40.622049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:40.622049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:40.622049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] No VIF found with MAC fa:16:3e:a2:b9:0b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:11:40.624704 np0000001643 nova-compute[98269]: WARNING nova.volume.cinder [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Attachment 4b713439-c40e-4491-a021-f875cc16d4e4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4b713439-c40e-4491-a021-f875cc16d4e4. (HTTP 404) (Request-ID: req-d1b007e3-3981-4a1e-a4bd-4977f397ce36)
May 28 14:11:40.625006 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Took 0.02 seconds to detach 1 volumes for instance.
May 28 14:11:40.984476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:40.984949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:40.988345 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:11:40.988478 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Claim successful on node np0000001643
May 28 14:11:41.133159 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:42.075374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:11:42.076388 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Creating image(s)
May 28 14:11:42.076701 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:11:42.076898 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Ensure instance console log exists: /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:11:42.077357 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:42.077570 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:42.077728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:42.078308 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Start _get_guest_xml network_info=[{"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T13:58:38Z,direct_url=<?>,disk_format='qcow2',id=1b08055e-7d23-4643-8d4a-4349e3da4086,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T13:58:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '5da4e60b-b69e-402d-b646-8776bfb57487', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd1db720f-ec51-4cb4-9ca9-60844350d239', 'attached_at': '', 'detached_at': '', 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'serial': '4977f462-5866-4abc-9b09-8f7ea2ac690f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:11:42.080911 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 14:11:42.082314 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='1b08055e-7d23-4643-8d4a-4349e3da4086', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-196826295', uuid='d1db720f-ec51-4cb4-9ca9-60844350d239'), owner=OwnerMeta(userid='ad96e52e071f4b3b9057ec1a411058b4', username='tempest-ServerActionsV293TestJSON-537604347-project-member', projectid='061e1b7a86244ea1b9be96940816b397', projectname='tempest-ServerActionsV293TestJSON-537604347'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977502.081891) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:11:42.083578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:11:42.084067 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:11:42.085583 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:11:42.085803 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:11:42.086978 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:11:42.087273 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T13:58:38Z,direct_url=<?>,disk_format='qcow2',id=1b08055e-7d23-4643-8d4a-4349e3da4086,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T13:58:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:11:42.087431 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:11:42.087604 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:11:42.087683 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:11:42.087788 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:11:42.087848 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:11:42.087976 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:11:42.088111 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:11:42.088228 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:11:42.088329 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:11:42.088520 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:11:42.088657 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1db720f-ec51-4cb4-9ca9-60844350d239 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:42.181753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-07534b74-e8d9-4c8c-8531-b8ace14e1a90 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.552s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:42.326688 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:11:42.327499 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:11:42.602325 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:11:42.602647 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:42.602943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:42.603336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:42.603584 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:11:42.615634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:42.616323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:42.617413 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:42.617413 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:42.617944 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:42.618183 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:42.633751 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:42.633751 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:42.635525 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:42.635525 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:42.648678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f] added
May 28 14:11:42.648678 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:42.648678 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:42.648678 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:42.648678 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:42.648678 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:42.648678 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:42.648957 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:42.649098 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:42.649242 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:42.653509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f] added
May 28 14:11:42.653509 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:42.653509 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:42.653509 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:42.653509 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:42.653509 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:42.653509 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:42.653767 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:42.653767 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:42.653905 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:42.668767 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:42.777392 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:42.777558 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:42.777725 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:42.777845 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:42.777981 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:29:77:5f, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:11:42.831148 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:11:43.337963 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.353s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:43.338853 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.205s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:43.339075 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:11:43.356375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:43.639000 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:11:43.639194 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:11:43.649629 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:43.654558 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:43.666248 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:43.666248 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:43.670491 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:43.670491 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.683812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.689578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.707609 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.709172 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:43.766469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260]
May 28 14:11:43.766469 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260] successful.
May 28 14:11:43.766469 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.766469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260]
May 28 14:11:43.766469 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260] successful.
May 28 14:11:43.766469 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.778548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.785536 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.798598 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.798896 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:43.799159 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:43.799343 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:43.801010 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] HCTL ('7', '-', '-', 0) found on session 101 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:43.801170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.809865 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:43.810255 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:43.810606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:43.810606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:43.812221 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] HCTL ('8', '-', '-', 0) found on session 102 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:43.812221 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:43.818947 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching for a device in session 101 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:43.818947 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:43.832599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching for a device in session 102 and hctl ['8', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:43.848387 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:11:43.848726 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:11:43.849433 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:43.849805 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:43.960789 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b666f3c9eb914e2dba854ed4e0d8fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1dc6979a244982823fef41c57d1c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:11:44.141751 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:11:44.350655 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:11:44.361701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-71837150-70de-4441-9f26-f70cc6c8fa5b tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:44.630774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:44.651595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.313s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:44.681476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:44.681657 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:44.722163 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Deleted allocations for instance 4a2e0c16-dd30-4f2b-a453-8febf9221c03
May 28 14:11:44.831194 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Searching for a device in session 102 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:44.831435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:44.832956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:44.853842 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:11:45.186881 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:45.199106 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Successfully created port: 4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:11:45.639913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Found WWN 3300000001ce0f605 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:11:45.640934 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:45.641209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000001ce0f605', 'path': '/dev/dm-0', 'multipath_id': '3300000001ce0f605'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:45.641412 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001ce0f605', 'path': '/dev/dm-0', 'multipath_id': '3300000001ce0f605'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:11:45.734138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-69c19765-ab43-4add-9d87-8dfba4c8f6ec tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "4a2e0c16-dd30-4f2b-a453-8febf9221c03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.751s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:45.765321 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Successfully updated port: 4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:11:45.812173 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:45.812329 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing instance network info cache due to event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:11:45.812537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] Acquiring lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:11:45.812652 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] Acquired lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:11:45.812782 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing network info cache for port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:11:45.863122 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:11:45.864272 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:11:45.864465 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Creating image(s)
May 28 14:11:45.864931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:45.865093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:45.865563 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:45.866704 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:11:45.870695 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:11:45.871801 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:45.967306 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:45.967938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:45.968630 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:45.969331 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:11:45.972106 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:11:45.972403 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:46.065315 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:46.065459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:46.133596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk 1073741824" returned: 0 in 0.068s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:46.134173 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:46.134608 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:46.150622 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-196826295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionsv293testjson-server-1969542837',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWqUmazuWr5QAW+GKtq0415oQwe6/xm6gDlnVvRcqD/QtIWC8P3QDTb7VtkMt79wsvUYrKGtnMX+YVcnq7jhlbr4oQd5Vly4UXaqyN3WNt0Xd3z6c1g+S5TRBr8pq0wWw==',key_name='tempest-keypair-1994480753',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:09:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='061e1b7a86244ea1b9be96940816b397',ramdisk_id='',reservation_id='r-eaidfmmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-537604347',owner_user_name='tempest-ServerActionsV293TestJSON-537604347-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad96e52e071f4b3b9057ec1a411058b4',uuid=d1db720f-ec51-4cb4-9ca9-60844350d239,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:11:46.150902 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converting VIF {"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:11:46.152406 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:11:46.156252 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] End _get_guest_xml xml=<domain type="qemu">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <uuid>d1db720f-ec51-4cb4-9ca9-60844350d239</uuid>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <name>instance-00000028</name>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServerActionsV293TestJSON-server-196826295</nova:name>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:11:42</nova:creationTime>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:image uuid="1b08055e-7d23-4643-8d4a-4349e3da4086">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:user uuid="ad96e52e071f4b3b9057ec1a411058b4">tempest-ServerActionsV293TestJSON-537604347-project-member</nova:user>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:project uuid="061e1b7a86244ea1b9be96940816b397">tempest-ServerActionsV293TestJSON-537604347</nova:project>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid="1b08055e-7d23-4643-8d4a-4349e3da4086"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         <nova:port uuid="f0706fd7-168f-43db-bc84-aadec652fb18">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <system>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <entry name="serial">d1db720f-ec51-4cb4-9ca9-60844350d239</entry>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <entry name="uuid">d1db720f-ec51-4cb4-9ca9-60844350d239</entry>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </system>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <os>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   </os>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <features>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   </features>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   <devices>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </disk>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <alias name="ua-4977f462-5866-4abc-9b09-8f7ea2ac690f"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <serial>4977f462-5866-4abc-9b09-8f7ea2ac690f</serial>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </disk>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:5b:b4:48"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <target dev="tapf0706fd7-16"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </interface>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/console.log" append="off"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </serial>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <video>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </video>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </rng>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:   </devices>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]: </domain>
May 28 14:11:46.156252 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:11:46.159706 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-196826295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionsv293testjson-server-1969542837',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWqUmazuWr5QAW+GKtq0415oQwe6/xm6gDlnVvRcqD/QtIWC8P3QDTb7VtkMt79wsvUYrKGtnMX+YVcnq7jhlbr4oQd5Vly4UXaqyN3WNt0Xd3z6c1g+S5TRBr8pq0wWw==',key_name='tempest-keypair-1994480753',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:09:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='061e1b7a86244ea1b9be96940816b397',ramdisk_id='',reservation_id='r-eaidfmmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-537604347',owner_user_name='tempest-ServerActionsV293TestJSON-537604347-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad96e52e071f4b3b9057ec1a411058b4',uuid=d1db720f-ec51-4cb4-9ca9-60844350d239,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:11:46.159706 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converting VIF {"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:11:46.159706 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:11:46.159706 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:11:46.159706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:46.160331 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:46.161063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:11:46.162509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:46.162755 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cca9b2d-3e67-5eab-8ca0-2b651acc8eb6', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:46.164139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:46.164733 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:46.166089 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:46.168613 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:46.168773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0706fd7-16, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:46.169230 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0706fd7-16, col_values=(('qos', UUID('e5699d09-9d96-41dd-b4f0-d3e50cd181da')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:46.169466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0706fd7-16, col_values=(('external_ids', {'iface-id': 'f0706fd7-168f-43db-bc84-aadec652fb18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b4:48', 'vm-uuid': 'd1db720f-ec51-4cb4-9ca9-60844350d239'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:46.172213 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:46.173620 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:46.183762 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:46.185492 np0000001643 nova-compute[98269]: INFO os_vif [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16')
May 28 14:11:46.192263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:46.225710 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00045565200025521335 future=<Future at 0x71a7803929c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:46.226428 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] Emitting event <LifecycleEvent: 1779977491.2251415, 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:11:46.226659 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:46.227071 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] VM Stopped (Lifecycle Event)
May 28 14:11:46.228523 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.612349563999942 future=<Future at 0x71a75c31c530 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:46.228819 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.612057129999812 future=<Future at 0x71a75c31c530 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:46.245508 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:46.245860 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:11:46.246103 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:46.270258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:11:46.318671 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:46.345887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:46.347487 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Cannot resize image /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:11:46.347487 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:11:46.347487 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Ensure instance console log exists: /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:11:46.347487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:46.347706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:46.347816 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:46.390154 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:11:46.585854 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:11:46.731140 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-dc72fe27-03fa-43d4-900d-0ab06be4003b tempest-VolumesActionsTest-1085038326 tempest-VolumesActionsTest-1085038326-project-member] [instance: 1ca77ae6-a7dc-4176-842d-c19b0b6ffc82] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:47.088365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f154c24-4656-4499-8cd7-d2b933fa169b req-3c1e8c42-6456-4f33-b7a3-8e1ab804a218 service nova] Releasing lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:11:47.088731 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquired lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:11:47.088906 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:11:47.255280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:47.255491 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:47.255735 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attaching volume 6bf236ce-2481-4271-bdde-7dd231fd31c0 to /dev/vdd
May 28 14:11:47.299766 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:47.309428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:11:47.331361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:47.387493 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:11:47.387801 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:11:47.398995 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:11:47.400115 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fea2:b90b', 'fe80::c880:3aff:fe3c:d2d3'] 
May 28 14:11:47.400241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:11:47.400294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:11:47.400558 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:47.400855 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating existing volume attachment record: 5c8eac53-dcaa-45ae-813f-ce99000ab4f2 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:11:47.533294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:47.533654 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:47.665110 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:11:47.706971 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:47.707144 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:47.707292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] No VIF found with MAC fa:16:3e:5b:b4:48, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:11:47.707870 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Using config drive
May 28 14:11:47.843366 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:47.957735 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:11:47.958108 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:47.958260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:47.958651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:47.958822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:11:47.972354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:47.972934 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:47.973333 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:47.973539 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:47.973913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:47.974147 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:47.986918 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:11:47.988269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:47.988269 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:47.994649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:11:47.994649 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:48.005216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0] added
May 28 14:11:48.005216 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:48.005216 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:48.005216 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:48.005216 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:48.005216 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:48.005216 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:48.005458 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:48.005623 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:48.005816 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:48.007992 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0] added
May 28 14:11:48.007992 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:11:48.007992 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:48.007992 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:48.007992 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:11:48.007992 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:11:48.007992 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:48.008241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:11:48.008498 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0343(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:11:48.008650 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:11:48.038937 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Detaching volume 1658ff1e-7492-4410-be02-f676b0a4c4a0
May 28 14:11:48.085064 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attempting to driver detach volume 1658ff1e-7492-4410-be02-f676b0a4c4a0 from mountpoint /dev/vdb
May 28 14:11:48.088724 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Found disk vdb by alias ua-1658ff1e-7492-4410-be02-f676b0a4c4a0 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:11:48.089844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Found disk vdb by alias ua-1658ff1e-7492-4410-be02-f676b0a4c4a0 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:11:48.089947 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Attempting to detach device vdb from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:11:48.090211 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:11:48.090211 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:48.090211 np0000001643 nova-compute[98269]:   <alias name="ua-1658ff1e-7492-4410-be02-f676b0a4c4a0"/>
May 28 14:11:48.090211 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-2"/>
May 28 14:11:48.090211 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:48.090211 np0000001643 nova-compute[98269]:   <serial>1658ff1e-7492-4410-be02-f676b0a4c4a0</serial>
May 28 14:11:48.090211 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:11:48.090211 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:48.090211 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:11:48.097790 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Successfully detached device vdb from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the persistent domain config.
May 28 14:11:48.097995 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] (1/8): Attempting to detach device vdb with device alias ua-1658ff1e-7492-4410-be02-f676b0a4c4a0 from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:11:48.098272 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:11:48.098272 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:48.098272 np0000001643 nova-compute[98269]:   <alias name="ua-1658ff1e-7492-4410-be02-f676b0a4c4a0"/>
May 28 14:11:48.098272 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-2"/>
May 28 14:11:48.098272 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:11:48.098272 np0000001643 nova-compute[98269]:   <serial>1658ff1e-7492-4410-be02-f676b0a4c4a0</serial>
May 28 14:11:48.098272 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:11:48.098272 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:48.098272 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:11:48.211602 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lazy-loading 'ec2_ids' on Instance uuid d1db720f-ec51-4cb4-9ca9-60844350d239 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:48.489630 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Releasing lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:11:48.489956 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance network_info: |[{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:11:48.491825 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Start _get_guest_xml network_info=[{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:11:48.495051 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:11:48.496299 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-497369381', uuid='3a1fb5dd-4075-4ede-aa93-8ceee595990a'), owner=OwnerMeta(userid='b666f3c9eb914e2dba854ed4e0d8fb20', username='tempest-AttachVolumeShelveTestJSON-1300734613-project-member', projectid='db1dc6979a244982823fef41c57d1c75', projectname='tempest-AttachVolumeShelveTestJSON-1300734613'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977508.4958572) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:11:48.497673 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:11:48.498139 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:11:48.499191 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:11:48.499379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:11:48.500434 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:11:48.500884 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:11:48.501072 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:11:48.501206 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:11:48.501401 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:11:48.501543 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:11:48.501693 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:11:48.501903 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:11:48.502036 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:11:48.502181 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:11:48.502300 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:11:48.502601 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:11:48.515986 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497369381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-497369381',id=43,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvW3mf2gcKHoDlonmj6X0h+rTiXWtySrcvIHOKBUyKPa21J2I+lToKgGAdfK0jVBMVoRFz8vmYwGZ4KVhrbr4QS7uPhQFIO9eMGkG2wFoouXKA59loNSF45jqwIl2GYcg==',key_name='tempest-keypair-1677477403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-28q854w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=3a1fb5dd-4075-4ede-aa93-8ceee595990a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:11:48.516187 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:11:48.516752 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:11:48.517264 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:48.695486 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977508.6950793, f67c8d28-d6d9-4d52-960c-3d8e15622855 => ua-1658ff1e-7492-4410-be02-f676b0a4c4a0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:11:48.696813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1658ff1e-7492-4410-be02-f676b0a4c4a0 for instance f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:11:48.699398 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Successfully detached device vdb from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the live domain config.
May 28 14:11:48.700120 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:11:48.700438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1658ff1e-7492-4410-be02-f676b0a4c4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:11:48.700705 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:11:48.717722 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Object Instance<d1db720f-ec51-4cb4-9ca9-60844350d239> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:11:48.717879 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lazy-loading 'keypairs' on Instance uuid d1db720f-ec51-4cb4-9ca9-60844350d239 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:49.006630 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:11:49.009476 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:11:49.020894 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] End _get_guest_xml xml=<domain type="qemu">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <uuid>3a1fb5dd-4075-4ede-aa93-8ceee595990a</uuid>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <name>instance-0000002b</name>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-497369381</nova:name>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:11:48</nova:creationTime>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:user uuid="b666f3c9eb914e2dba854ed4e0d8fb20">tempest-AttachVolumeShelveTestJSON-1300734613-project-member</nova:user>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:project uuid="db1dc6979a244982823fef41c57d1c75">tempest-AttachVolumeShelveTestJSON-1300734613</nova:project>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         <nova:port uuid="4e74ab1b-2352-4cb6-bb11-265aad5c70e7">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <system>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <entry name="serial">3a1fb5dd-4075-4ede-aa93-8ceee595990a</entry>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <entry name="uuid">3a1fb5dd-4075-4ede-aa93-8ceee595990a</entry>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </system>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <os>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   </os>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <features>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   </features>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   <devices>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </disk>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </disk>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:05:43:7f"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <target dev="tap4e74ab1b-23"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </interface>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/console.log" append="off"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </serial>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <video>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </video>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </rng>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:   </devices>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]: </domain>
May 28 14:11:49.020894 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Preparing to wait for external event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497369381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-497369381',id=43,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvW3mf2gcKHoDlonmj6X0h+rTiXWtySrcvIHOKBUyKPa21J2I+lToKgGAdfK0jVBMVoRFz8vmYwGZ4KVhrbr4QS7uPhQFIO9eMGkG2wFoouXKA59loNSF45jqwIl2GYcg==',key_name='tempest-keypair-1677477403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-28q854w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=3a1fb5dd-4075-4ede-aa93-8ceee595990a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:49.026373 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:49.027181 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:49.027181 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.030412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.030412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dafbd62-9cc1-5bdd-8885-d84e653cf70f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:11:49.030511 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:11:49.030511 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.033619 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:49.035656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.037782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.037913 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e74ab1b-23, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:49.038484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e74ab1b-23, col_values=(('qos', UUID('cec1c144-1df2-4f03-afc5-0ebe7822cbc3')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:49.038484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e74ab1b-23, col_values=(('external_ids', {'iface-id': '4e74ab1b-2352-4cb6-bb11-265aad5c70e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:43:7f', 'vm-uuid': '3a1fb5dd-4075-4ede-aa93-8ceee595990a'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:11:49.039167 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.041311 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:11:49.042963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.048611 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.052680 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.054033 np0000001643 nova-compute[98269]: INFO os_vif [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23')
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.069503 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.069987 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.075648 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.076047 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:49.134204 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.50.100,3260]
May 28 14:11:49.134204 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.50.100,3260] successful.
May 28 14:11:49.134204 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.147273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.40.100,3260]
May 28 14:11:49.147273 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.40.100,3260] successful.
May 28 14:11:49.147273 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.152963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.160853 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.177977 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.178347 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:49.178723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:49.178837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:49.181223 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('19', '-', '-', 0) found on session 103 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:49.181409 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:49.183488 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:49.183488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:11:49.184105 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('20', '-', '-', 0) found on session 104 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:11:49.185537 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:11:49.198421 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 103 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:49.198711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:49.203591 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 104 and hctl ['20', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:49.221254 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Object Instance<d1db720f-ec51-4cb4-9ca9-60844350d239> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:11:49.225056 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 14:11:49.363205 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Creating config drive at /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config
May 28 14:11:49.367947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzhspm3ip {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:49.423584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzhspm3ip" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:49.630556 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.838491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.873912 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:49.972667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:50.204534 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 104 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:11:50.205054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:11:50.233553 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:50.240706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:50.242904 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:50.266585 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:50.273044 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:50.575757 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:50.575897 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:50.576055 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No VIF found with MAC fa:16:3e:05:43:7f, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:11:50.576649 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Using config drive
May 28 14:11:50.613026 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977510.6124141, d1db720f-ec51-4cb4-9ca9-60844350d239 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:11:50.613191 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] VM Resumed (Lifecycle Event)
May 28 14:11:50.614356 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:11:50.614945 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:11:50.616892 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance spawned successfully.
May 28 14:11:50.617531 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:11:50.995795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found WWN 3300000009bea10b7 for multipath device dm-10 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:11:50.996298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:50.996701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000009bea10b7', 'path': '/dev/dm-10', 'multipath_id': '3300000009bea10b7'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:50.996851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009bea10b7', 'path': '/dev/dm-10', 'multipath_id': '3300000009bea10b7'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:11:50.997215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.296s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:11:50.997951 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1658ff1e-7492-4410-be02-f676b0a4c4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:11:50.998208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:11:50.999975 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:51.036021 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:11:51.036723 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '99')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:11:51.036723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '94')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:51.038166 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0', '93')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:11:51.039315 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c2c9800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:11:51.039558 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:11:51.039837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Flush multipath device 330000000ca460af1 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:11:51.078851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:51.084813 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:51.117972 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:51.125257 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:11:51.130228 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:51.130382 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:51.130780 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:51.131023 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:51.131375 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:51.131652 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:51.136363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:11:51.197463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:11:51.197796 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:11:51.200495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:11:51.216845 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:11:51.217186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:11:51.231417 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:51.267019 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Creating config drive at /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config
May 28 14:11:51.274147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_2turkly {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:11:51.288130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.40.100,3260]
May 28 14:11:51.288130 np0000001643 nova-compute[98269]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.40.100,3260] successful.
May 28 14:11:51.288130 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:51.317686 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:51.332238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_2turkly" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:11:51.337197 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:51.388915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.50.100,3260]
May 28 14:11:51.388915 np0000001643 nova-compute[98269]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-1658ff1e-7492-4410-be02-f676b0a4c4a0, portal: 192.168.50.100,3260] successful.
May 28 14:11:51.388915 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:51.413068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:11:51.413978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:11:51.413978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== disconnect_volume: return (2713ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:11:51.413978 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:11:51.504237 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attempting to attach volume 6bf236ce-2481-4271-bdde-7dd231fd31c0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:11:51.506172 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:11:51.506172 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:11:51.506172 np0000001643 nova-compute[98269]:   <alias name="ua-6bf236ce-2481-4271-bdde-7dd231fd31c0"/>
May 28 14:11:51.506172 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:11:51.506172 np0000001643 nova-compute[98269]:   <target dev="vdd" bus="virtio"/>
May 28 14:11:51.506172 np0000001643 nova-compute[98269]:   <serial>6bf236ce-2481-4271-bdde-7dd231fd31c0</serial>
May 28 14:11:51.506172 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:11:51.506172 np0000001643 nova-compute[98269]: </disk>
May 28 14:11:51.506172 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:11:51.629874 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 14:11:51.630344 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977511.6301103, d1db720f-ec51-4cb4-9ca9-60844350d239 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:11:51.630512 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] VM Started (Lifecycle Event)
May 28 14:11:51.640323 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:51.954580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:51.978818 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:52.017409 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'flavor' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:11:52.084425 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:52.133676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:52.136310 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:11:52.156474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:52.156474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:52.156474 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98269) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 14:11:52.266682 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:52.343797 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc7dce27-6007-4438-862e-cbd5d5aa16ae req-ef0ecd09-c7f7-4c10-8599-717daed7a350 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:52.344058 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc7dce27-6007-4438-862e-cbd5d5aa16ae req-ef0ecd09-c7f7-4c10-8599-717daed7a350 service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:52.344345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc7dce27-6007-4438-862e-cbd5d5aa16ae req-ef0ecd09-c7f7-4c10-8599-717daed7a350 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:52.344425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dc7dce27-6007-4438-862e-cbd5d5aa16ae req-ef0ecd09-c7f7-4c10-8599-717daed7a350 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:52.344592 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dc7dce27-6007-4438-862e-cbd5d5aa16ae req-ef0ecd09-c7f7-4c10-8599-717daed7a350 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Processing event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:11:52.381923 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:52.386364 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:52.388488 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:52.412693 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:52.721573 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a08b616e-c8b6-4bf1-b084-35156cc03fa3 req-58d20d6a-4a42-46ca-a133-1ea0c1fede54 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:52.721715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a08b616e-c8b6-4bf1-b084-35156cc03fa3 req-58d20d6a-4a42-46ca-a133-1ea0c1fede54 service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:52.721892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a08b616e-c8b6-4bf1-b084-35156cc03fa3 req-58d20d6a-4a42-46ca-a133-1ea0c1fede54 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:52.722088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a08b616e-c8b6-4bf1-b084-35156cc03fa3 req-58d20d6a-4a42-46ca-a133-1ea0c1fede54 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:52.722248 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a08b616e-c8b6-4bf1-b084-35156cc03fa3 req-58d20d6a-4a42-46ca-a133-1ea0c1fede54 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] No waiting events found dispatching network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:11:52.727397 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a08b616e-c8b6-4bf1-b084-35156cc03fa3 req-58d20d6a-4a42-46ca-a133-1ea0c1fede54 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received unexpected event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 for instance with vm_state active and task_state None.
May 28 14:11:52.841709 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004960659998687333 future=<Future at 0x71a75c31c530 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:52.841709 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:11:52.841923 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Emitting event <LifecycleEvent: 1779977497.8407652, 4a2e0c16-dd30-4f2b-a453-8febf9221c03 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:11:52.842157 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] VM Stopped (Lifecycle Event)
May 28 14:11:53.032602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3360038b-c40e-45e3-b0b9-276007f7d03a tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.499s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:53.073339 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977513.0729482, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:11:53.073514 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Started (Lifecycle Event)
May 28 14:11:53.076784 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:11:53.083524 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:11:53.087117 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance spawned successfully.
May 28 14:11:53.087867 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:11:53.173205 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-958eb5db-4cc3-4668-9b7f-8d0e114d9bd7 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.019s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:53.345796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: 4a2e0c16-dd30-4f2b-a453-8febf9221c03] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:53.382469 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:53.382716 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:53.382849 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:53.382993 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:53.383140 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:11:53.383286 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:29:77:5f, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:11:53.577001 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:53.578983 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:11:53.595966 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:53.596202 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:53.596618 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:53.596989 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:53.597373 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:53.598234 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:11:54.039987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:54.081427 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:11:54.081736 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977514.081531, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:11:54.081949 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Paused (Lifecycle Event)
May 28 14:11:54.105374 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Took 8.24 seconds to spawn the instance on the hypervisor.
May 28 14:11:54.106291 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:54.468534 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8666a5ae-71a1-4e3a-9537-515b9c477221 req-7a248f52-9713-4c4d-be17-6fa3d33ff9b2 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:54.469036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8666a5ae-71a1-4e3a-9537-515b9c477221 req-7a248f52-9713-4c4d-be17-6fa3d33ff9b2 service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:54.469500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8666a5ae-71a1-4e3a-9537-515b9c477221 req-7a248f52-9713-4c4d-be17-6fa3d33ff9b2 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:54.469500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8666a5ae-71a1-4e3a-9537-515b9c477221 req-7a248f52-9713-4c4d-be17-6fa3d33ff9b2 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:54.470879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8666a5ae-71a1-4e3a-9537-515b9c477221 req-7a248f52-9713-4c4d-be17-6fa3d33ff9b2 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] No waiting events found dispatching network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:11:54.470879 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8666a5ae-71a1-4e3a-9537-515b9c477221 req-7a248f52-9713-4c4d-be17-6fa3d33ff9b2 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received unexpected event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 for instance with vm_state active and task_state None.
May 28 14:11:54.586190 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:54.590235 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977514.5899541, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:11:54.591285 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Resumed (Lifecycle Event)
May 28 14:11:54.617253 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Took 13.68 seconds to build instance.
May 28 14:11:54.632668 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:54.809636 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f508001-c8a5-40d4-93da-729cd74da386 req-f5caac2c-1fe2-4588-886a-263ad69142b3 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:54.809923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f508001-c8a5-40d4-93da-729cd74da386 req-f5caac2c-1fe2-4588-886a-263ad69142b3 service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:54.810187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f508001-c8a5-40d4-93da-729cd74da386 req-f5caac2c-1fe2-4588-886a-263ad69142b3 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:54.810379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f508001-c8a5-40d4-93da-729cd74da386 req-f5caac2c-1fe2-4588-886a-263ad69142b3 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:54.810564 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f508001-c8a5-40d4-93da-729cd74da386 req-f5caac2c-1fe2-4588-886a-263ad69142b3 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] No waiting events found dispatching network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:11:54.810753 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-5f508001-c8a5-40d4-93da-729cd74da386 req-f5caac2c-1fe2-4588-886a-263ad69142b3 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received unexpected event network-vif-plugged-f0706fd7-168f-43db-bc84-aadec652fb18 for instance with vm_state active and task_state None.
May 28 14:11:54.957790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cb3ec7a9-885d-42bb-9468-184c9fc2e4ae tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.702s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:55.094880 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:11:55.099042 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:11:55.119004 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.188s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:11:56.151724 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:56.891206 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:11:56.891408 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing instance network info cache due to event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:11:56.891654 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] Acquiring lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:11:56.891760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] Acquired lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:11:56.891928 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing network info cache for port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:11:57.395680 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:57.852842 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:11:58.046413 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updated VIF entry in instance network info cache for port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:11:58.047260 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:11:58.550085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f71ad1f0-7fd1-42f6-bd51-7b05839b03ea req-a90d0e6b-fe17-49bd-b0af-bb7394de4d81 service nova] Releasing lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:11:58.806678 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:58.806840 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:59.040664 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:59.177583 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:59.309606 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:11:59.642104 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:11:59.864474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:11:59.864652 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:11:59.869828 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:11:59.870180 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Claim successful on node np0000001643
May 28 14:12:00.142381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:00.142612 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:00.645037 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Detaching volume c9e2c9d9-aff3-4702-9207-57b405b7054c
May 28 14:12:00.691708 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Attempting to driver detach volume c9e2c9d9-aff3-4702-9207-57b405b7054c from mountpoint /dev/vdc
May 28 14:12:00.696171 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Found disk vdc by alias ua-c9e2c9d9-aff3-4702-9207-57b405b7054c {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:12:00.697343 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Found disk vdc by alias ua-c9e2c9d9-aff3-4702-9207-57b405b7054c {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:12:00.697482 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Attempting to detach device vdc from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:12:00.697701 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:12:00.697701 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:12:00.697701 np0000001643 nova-compute[98269]:   <alias name="ua-c9e2c9d9-aff3-4702-9207-57b405b7054c"/>
May 28 14:12:00.697701 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-8"/>
May 28 14:12:00.697701 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:12:00.697701 np0000001643 nova-compute[98269]:   <serial>c9e2c9d9-aff3-4702-9207-57b405b7054c</serial>
May 28 14:12:00.697701 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:12:00.697701 np0000001643 nova-compute[98269]: </disk>
May 28 14:12:00.697701 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:12:00.706983 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Successfully detached device vdc from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the persistent domain config.
May 28 14:12:00.707170 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] (1/8): Attempting to detach device vdc with device alias ua-c9e2c9d9-aff3-4702-9207-57b405b7054c from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:12:00.707462 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:12:00.707462 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:12:00.707462 np0000001643 nova-compute[98269]:   <alias name="ua-c9e2c9d9-aff3-4702-9207-57b405b7054c"/>
May 28 14:12:00.707462 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-8"/>
May 28 14:12:00.707462 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:12:00.707462 np0000001643 nova-compute[98269]:   <serial>c9e2c9d9-aff3-4702-9207-57b405b7054c</serial>
May 28 14:12:00.707462 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:12:00.707462 np0000001643 nova-compute[98269]: </disk>
May 28 14:12:00.707462 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:12:01.254261 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:01.254421 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:01.454398 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977521.454038, f67c8d28-d6d9-4d52-960c-3d8e15622855 => ua-c9e2c9d9-aff3-4702-9207-57b405b7054c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:12:01.456257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-c9e2c9d9-aff3-4702-9207-57b405b7054c for instance f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:12:01.458974 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Successfully detached device vdc from instance f67c8d28-d6d9-4d52-960c-3d8e15622855 from the live domain config.
May 28 14:12:01.460546 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:12:01.460857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9e2c9d9-aff3-4702-9207-57b405b7054c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:01.461020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:01.461445 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:01.461803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9e2c9d9-aff3-4702-9207-57b405b7054c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:12:01.462030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0534d011-4f59-4b06-b020-7d9ebbcf9915 (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:12:01.498468 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0534d011-4f59-4b06-b020-7d9ebbcf9915 (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c (non-flash)
May 28 14:12:01.498968 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0534d011-4f59-4b06-b020-7d9ebbcf9915', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '99')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:12:01.498968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '99')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:12:01.500365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c', '100')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:12:01.502501 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778160d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c'): ({'sdk'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:12:01.502944 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Removing multipathed devices sdj, sdk {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:12:01.503310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Flush multipath device 3300000005111871e {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:12:01.541152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:12:01.582354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:12:01.637202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:12:01.637384 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:12:01.639624 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:12:01.654321 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:12:01.654789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:12:01.676170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:01.730609 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.40.100,3260]
May 28 14:12:01.730609 np0000001643 nova-compute[98269]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.40.100,3260] successful.
May 28 14:12:01.730609 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:01.758294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:01.759151 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:01.777681 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:01.835742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.50.100,3260]
May 28 14:12:01.835742 np0000001643 nova-compute[98269]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-c9e2c9d9-aff3-4702-9207-57b405b7054c, portal: 192.168.50.100,3260] successful.
May 28 14:12:01.835742 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:01.861215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:01.861506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:01.861672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== disconnect_volume: return (401ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:01.861957 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:12:02.272946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.408s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:02.273897 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:12:02.425225 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'flavor' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:02.788437 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:12:02.789001 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:12:02.789611 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:02.789611 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:02.911713 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '443210af2282478b862d252bfa3bb611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd0a26536e743c9a9eaeb956fc55b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:12:03.293187 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:12:03.433068 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-121b1065-d9ef-4701-8f34-71866b3ebdf0 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.290s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:03.592263 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Successfully created port: fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:12:03.797292 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:12:04.042184 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:04.311206 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Successfully updated port: fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:12:04.404987 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-changed-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:04.407484 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Refreshing instance network info cache due to event network-changed-fb468400-028e-4a16-89be-0bd979271e03. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:04.408696 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] Acquiring lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:04.409483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] Acquired lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:04.412158 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Refreshing network info cache for port fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:04.519389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:04.519663 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:04.636754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:04.814809 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:12:04.816637 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:04.817016 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:12:04.817360 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Creating image(s)
May 28 14:12:04.818023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:04.818254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "/opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:04.818882 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "/opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:04.819727 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:04.823495 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:04.825500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:04.917634 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:04.935100 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:04.935648 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:04.936354 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:04.936805 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:04.940672 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:04.941228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:05.027611 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:12:05.038474 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:12:05.063970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:05.064877 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:05.131713 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk 1073741824" returned: 0 in 0.066s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:05.131713 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:05.131713 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:05.228136 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:05.228842 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:12:05.229122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:05.259224 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:05.326728 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:05.327144 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Cannot resize image /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:12:05.330473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:12:05.330473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Ensure instance console log exists: /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:12:05.330473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:05.330473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:05.330473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:05.620402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:05.621351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:05.626572 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:12:05.626824 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Claim successful on node np0000001643
May 28 14:12:05.765988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa3b5a89-5c63-45a8-8bfa-a6a58b1591c2 req-670934dd-41bb-447c-85ad-2ce86694751f service nova] Releasing lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:05.768154 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquired lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:05.768154 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:12:05.902682 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:05.902682 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing instance network info cache due to event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:05.902682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] Acquiring lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:05.902682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] Acquired lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:05.902682 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:06.349183 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:12:06.374952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:06.374952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:06.374952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:06.374952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:06.374952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:06.380915 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Terminating instance
May 28 14:12:06.406485 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:06.490076 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:06.490264 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:06.490808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:06.490808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:06.491225 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] No waiting events found dispatching network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:06.491225 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received unexpected event network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 for instance with vm_state building and task_state spawning.
May 28 14:12:06.491324 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:06.491380 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing instance network info cache due to event network-changed-a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:06.491580 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] Acquiring lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:06.569367 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:06.760988 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Updating instance_info_cache with network_info: [{"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:06.885170 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:12:06.887365 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:06.924088 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:06.941589 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:06.943417 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:06.969485 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.100583 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:07.100938 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:07.106717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8b4df4db-aab7-4d58-b19c-2c3b6d27a40b req-ad5f5a0a-0a38-47f6-885a-a0875df5c0e6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-vif-unplugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:07.106717 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8b4df4db-aab7-4d58-b19c-2c3b6d27a40b req-ad5f5a0a-0a38-47f6-885a-a0875df5c0e6 service nova] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:07.106717 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8b4df4db-aab7-4d58-b19c-2c3b6d27a40b req-ad5f5a0a-0a38-47f6-885a-a0875df5c0e6 service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:07.106717 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8b4df4db-aab7-4d58-b19c-2c3b6d27a40b req-ad5f5a0a-0a38-47f6-885a-a0875df5c0e6 service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:07.106717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8b4df4db-aab7-4d58-b19c-2c3b6d27a40b req-ad5f5a0a-0a38-47f6-885a-a0875df5c0e6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] No waiting events found dispatching network-vif-unplugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:07.106717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8b4df4db-aab7-4d58-b19c-2c3b6d27a40b req-ad5f5a0a-0a38-47f6-885a-a0875df5c0e6 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-vif-unplugged-a6ba104a-1f00-4e65-982b-42f716519f23 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:12:07.132972 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updated VIF entry in instance network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:12:07.133246 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating instance_info_cache with network_info: [{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:07.218142 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.228067 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.248073 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99965495000015 future=<Future at 0x71a75c2831d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:07.248675 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999090482000156 future=<Future at 0x71a75c2831d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:07.249118 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998601575000066 future=<Future at 0x71a75c2831d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:07.250750 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Instance destroyed successfully.
May 28 14:12:07.251389 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lazy-loading 'resources' on Instance uuid f67c8d28-d6d9-4d52-960c-3d8e15622855 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:07.264498 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Releasing lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:07.264913 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Instance network_info: |[{"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:12:07.267293 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Start _get_guest_xml network_info=[{"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:12:07.271772 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:12:07.273208 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-44610843', uuid='8ad77d56-99f2-4c46-b41e-ff9b85a23e58'), owner=OwnerMeta(userid='443210af2282478b862d252bfa3bb611', username='tempest-VolumeMultiattachTests-761556748-project-member', projectid='1bd0a26536e743c9a9eaeb956fc55b79', projectname='tempest-VolumeMultiattachTests-761556748'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977527.2727683) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:12:07.277781 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:12:07.277970 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:12:07.279038 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:12:07.279325 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:12:07.282274 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:12:07.282274 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:12:07.282274 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:12:07.282758 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:12:07.282758 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:12:07.282758 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:12:07.282758 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:12:07.282875 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:12:07.284754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:12:07.284754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:12:07.284754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:12:07.284754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:12:07.296294 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-44610843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-44610843',id=44,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV38pm1HbkUROW/tCJmf52xS6BdlTXdGhB7E70gTHtjkTPX7hag/5B9RTUqMwmX3Cqz3dEUOdWuIg74tj0p2z6baF7RtvsMHaZe0ZRHkLWYt3ZzcEeJB0m/zxo2iAwBQQ==',key_name='tempest-keypair-1772616094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-10qvtph5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=8ad77d56-99f2-4c46-b41e-ff9b85a23e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:12:07.296741 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:07.297025 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:03:48,bridge_name='br-int',has_traffic_filtering=True,id=fb468400-028e-4a16-89be-0bd979271e03,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb468400-02') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:07.297743 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:07.603730 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:07.636165 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cd6fbfe5-3263-400b-a984-a00268f8cc88 req-4db459f4-a80a-4c6a-9f64-eec8473abc34 service nova] Releasing lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:07.636705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] Acquired lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:07.636941 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Refreshing network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:07.755350 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-219228408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testinstanceswithcindervolumes-server-219228408',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH7WKiCvLLlt67MoRg4jrslxNcLiuk8yx+FQiVIPMzt4v4d7WOUOMukfeM/ff6ntJXgJWP1poFl3zDnKdZTJMGbeMLU67nCpTv6eVK+U11eYMfzpKFgN2GbBXP+tJuItw==',key_name='tempest-TestInstancesWithCinderVolumes-396621340',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:10:12Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85522a95b1cc4a8191762582b962e162',ramdisk_id='',reservation_id='r-ad4cf94s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1781797632',owner_user_name='tempest-TestInstancesWithCinderVolumes-1781797632-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:10:13Z,user_data=None,user_id='a7b548159f00492b90645364206b5971',uuid=f67c8d28-d6d9-4d52-960c-3d8e15622855,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:12:07.755634 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Converting VIF {"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:07.756072 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:b9:0b,bridge_name='br-int',has_traffic_filtering=True,id=a6ba104a-1f00-4e65-982b-42f716519f23,network=Network(4fe953ea-06e9-4457-a492-46039248ac68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ba104a-1f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:07.756363 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:b9:0b,bridge_name='br-int',has_traffic_filtering=True,id=a6ba104a-1f00-4e65-982b-42f716519f23,network=Network(4fe953ea-06e9-4457-a492-46039248ac68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ba104a-1f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:12:07.757763 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.758028 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6ba104a-1f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:07.765675 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.766483 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:07.766785 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.767764 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.768164 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b6ec3b2-cefe-4630-8d7d-cbe59058f398) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:07.768828 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.769654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:07.771624 np0000001643 nova-compute[98269]: INFO os_vif [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:b9:0b,bridge_name='br-int',has_traffic_filtering=True,id=a6ba104a-1f00-4e65-982b-42f716519f23,network=Network(4fe953ea-06e9-4457-a492-46039248ac68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ba104a-1f')
May 28 14:12:07.773343 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:12:07.773859 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:07.774067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:07.775281 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:07.775740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a227a47-2455-41cf-905a-58ae027e242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:12:07.776314 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:12:07.801748 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] End _get_guest_xml xml=<domain type="qemu">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <uuid>8ad77d56-99f2-4c46-b41e-ff9b85a23e58</uuid>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <name>instance-0000002c</name>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumeMultiattachTests-server-44610843</nova:name>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:12:07</nova:creationTime>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:user uuid="443210af2282478b862d252bfa3bb611">tempest-VolumeMultiattachTests-761556748-project-member</nova:user>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:project uuid="1bd0a26536e743c9a9eaeb956fc55b79">tempest-VolumeMultiattachTests-761556748</nova:project>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         <nova:port uuid="fb468400-028e-4a16-89be-0bd979271e03">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <system>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <entry name="serial">8ad77d56-99f2-4c46-b41e-ff9b85a23e58</entry>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <entry name="uuid">8ad77d56-99f2-4c46-b41e-ff9b85a23e58</entry>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </system>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <os>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   </os>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <features>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   </features>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   <devices>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </disk>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk.config"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </disk>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:7c:03:48"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <target dev="tapfb468400-02"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </interface>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/console.log" append="off"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </serial>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <video>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </video>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </rng>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:   </devices>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]: </domain>
May 28 14:12:07.801748 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Preparing to wait for external event network-vif-plugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-44610843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-44610843',id=44,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV38pm1HbkUROW/tCJmf52xS6BdlTXdGhB7E70gTHtjkTPX7hag/5B9RTUqMwmX3Cqz3dEUOdWuIg74tj0p2z6baF7RtvsMHaZe0ZRHkLWYt3ZzcEeJB0m/zxo2iAwBQQ==',key_name='tempest-keypair-1772616094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-10qvtph5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=8ad77d56-99f2-4c46-b41e-ff9b85a23e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:03:48,bridge_name='br-int',has_traffic_filtering=True,id=fb468400-028e-4a16-89be-0bd979271e03,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb468400-02') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:07.804640 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:03:48,bridge_name='br-int',has_traffic_filtering=True,id=fb468400-028e-4a16-89be-0bd979271e03,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb468400-02') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:12:07.805655 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.805877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:07.806047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:12:07.809237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.809542 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f4eece2-e049-5ee6-a499-0d8fbf2aaf3f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0534d011-4f59-4b06-b020-7d9ebbcf9915 (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:07.811993 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsi session list stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0534d011-4f59-4b06-b020-7d9ebbcf9915 (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:07.812414 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:07.812812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0534d011-4f59-4b06-b020-7d9ebbcf9915', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:12:07.812812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '85')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:12:07.813757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:07.816224 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b', '84')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:12:07.816625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.819120 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb468400-02, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:07.819611 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb468400-02, col_values=(('qos', UUID('a790adc7-8aa7-480e-b557-99e1e3c950e0')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:07.819790 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb468400-02, col_values=(('external_ids', {'iface-id': 'fb468400-028e-4a16-89be-0bd979271e03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:03:48', 'vm-uuid': '8ad77d56-99f2-4c46-b41e-ff9b85a23e58'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:07.822397 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:07.823427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780185300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'): ({'sdh'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:12:07.823678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:12:07.823901 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Flush multipath device 3300000008e253d82 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:12:07.827105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:07.828205 np0000001643 nova-compute[98269]: INFO os_vif [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:03:48,bridge_name='br-int',has_traffic_filtering=True,id=fb468400-028e-4a16-89be-0bd979271e03,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb468400-02')
May 28 14:12:07.883844 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:12:07.949957 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:12:08.016424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:12:08.017194 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:12:08.022276 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:12:08.036740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:12:08.037526 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:12:08.053666 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:08.091438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.40.100,3260]
May 28 14:12:08.091438 np0000001643 nova-compute[98269]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.40.100,3260] successful.
May 28 14:12:08.091438 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:08.111555 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.490s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:08.111883 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:12:08.116545 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:08.133074 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:08.139321 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:08.175075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.50.100,3260]
May 28 14:12:08.175075 np0000001643 nova-compute[98269]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-2a227a47-2455-41cf-905a-58ae027e242b, portal: 192.168.50.100,3260] successful.
May 28 14:12:08.175075 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:08.198021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:08.198330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:08.198524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] <== disconnect_volume: return (424ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:08.198672 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:12:08.199244 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Deleting instance files /opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855_del
May 28 14:12:08.199672 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Deletion of /opt/stack/data/nova/instances/f67c8d28-d6d9-4d52-960c-3d8e15622855_del complete
May 28 14:12:08.539291 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:08.619430 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:12:08.619430 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:12:08.620109 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:08.620399 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:08.708674 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updated VIF entry in instance network info cache for port a6ba104a-1f00-4e65-982b-42f716519f23. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:12:08.708674 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating instance_info_cache with network_info: [{"id": "a6ba104a-1f00-4e65-982b-42f716519f23", "address": "fa:16:3e:a2:b9:0b", "network": {"id": "4fe953ea-06e9-4457-a492-46039248ac68", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-743395832-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85522a95b1cc4a8191762582b962e162", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ba104a-1f", "ovs_interfaceid": "a6ba104a-1f00-4e65-982b-42f716519f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:08.714866 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Took 1.83 seconds to destroy the instance on the hypervisor.
May 28 14:12:08.716216 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:12:08.716216 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:12:08.716216 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:12:08.716216 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:08.721931 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62dd681b2bbe4147af5e6cd596c6d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a6b1dd5a2f47bdbea499915e31b2f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:12:08.863439 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:09.123172 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:12:09.187649 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e44e0c4d-abf6-4248-b792-f57d3a683b39 req-c33f025f-7262-4d6e-8dad-df5913850e7b service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-vif-unplugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:09.192929 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e44e0c4d-abf6-4248-b792-f57d3a683b39 req-c33f025f-7262-4d6e-8dad-df5913850e7b service nova] Acquiring lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:09.193130 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e44e0c4d-abf6-4248-b792-f57d3a683b39 req-c33f025f-7262-4d6e-8dad-df5913850e7b service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:09.193341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e44e0c4d-abf6-4248-b792-f57d3a683b39 req-c33f025f-7262-4d6e-8dad-df5913850e7b service nova] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:09.193574 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e44e0c4d-abf6-4248-b792-f57d3a683b39 req-c33f025f-7262-4d6e-8dad-df5913850e7b service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] No waiting events found dispatching network-vif-unplugged-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:09.193787 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e44e0c4d-abf6-4248-b792-f57d3a683b39 req-c33f025f-7262-4d6e-8dad-df5913850e7b service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-vif-unplugged-a6ba104a-1f00-4e65-982b-42f716519f23 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:12:09.198742 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9539a2b6-2ce5-468b-bd56-8bdd8dee1e1c req-5cd501d2-de9d-403b-8236-ee96d82ce93a service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Received event network-vif-deleted-a6ba104a-1f00-4e65-982b-42f716519f23 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:09.198972 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-9539a2b6-2ce5-468b-bd56-8bdd8dee1e1c req-5cd501d2-de9d-403b-8236-ee96d82ce93a service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Neutron deleted interface a6ba104a-1f00-4e65-982b-42f716519f23; detaching it from the instance and deleting it from the info cache
May 28 14:12:09.203475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9539a2b6-2ce5-468b-bd56-8bdd8dee1e1c req-5cd501d2-de9d-403b-8236-ee96d82ce93a service nova] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Detach interface failed, port_id=a6ba104a-1f00-4e65-982b-42f716519f23, reason: Instance f67c8d28-d6d9-4d52-960c-3d8e15622855 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:12:09.212244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f975cdba-649b-4155-b363-e388c75caa83 req-b6f045a2-a895-4f44-8f46-7fd950666154 service nova] Releasing lock "refresh_cache-f67c8d28-d6d9-4d52-960c-3d8e15622855" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:09.349963 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Successfully created port: ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:12:09.352509 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:09.352765 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:09.352874 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:7c:03:48, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:12:09.353355 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Using config drive
May 28 14:12:09.630845 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:12:09.633433 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:09.639107 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:09.859649 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:09.969897 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Successfully updated port: ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:12:10.011235 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Creating config drive at /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk.config
May 28 14:12:10.015691 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwvdylpja {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:10.039126 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-changed-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:10.039310 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing instance network info cache due to event network-changed-ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:10.042786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:10.042947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:10.043168 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing network info cache for port ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:10.077047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwvdylpja" returned: 0 in 0.061s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:10.134156 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Booting with volume 92f77984-c5a1-486b-ac27-897f5399e7ce at /dev/vda
May 28 14:12:10.138070 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Took 1.42 seconds to deallocate network for instance.
May 28 14:12:10.186896 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:10.199292 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:12:10.221435 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:10.278902 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:12:10.279279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:12:10.289846 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:12:10.291270 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe5b:b448', 'fe80::ac12:4fff:fead:8db2', 'fe80::fc16:3eff:fe05:437f', 'fe80::64c0:f7ff:fe14:ca9b'] 
May 28 14:12:10.291439 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:12:10.291598 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:12:10.291925 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:10.292221 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating existing volume attachment record: ae44429c-3f40-47f5-a052-6baf95df2365 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:12:10.472760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:10.549776 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:10.574058 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:10.601479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:10.604797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:10.660204 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:12:10.717027 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Took 0.58 seconds to detach 1 volumes for instance.
May 28 14:12:10.719783 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:10.791758 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:10.888357 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:11.238635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:11.238635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:11.282188 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-plugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:11.282584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:11.282809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:11.283027 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:11.283241 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Processing event network-vif-plugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:12:11.283469 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-plugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:11.283807 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:11.283807 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:11.283959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:11.284096 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] No waiting events found dispatching network-vif-plugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:11.284679 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-74ccedd0-fcd9-4eb0-82f6-7ec61c2b3d8d req-85002d07-df07-4a92-a9e4-b9238d3dc2d7 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received unexpected event network-vif-plugged-fb468400-028e-4a16-89be-0bd979271e03 for instance with vm_state building and task_state spawning.
May 28 14:12:11.392054 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2fd9bf56-2c2f-41ef-a6d3-e01db6bcf34e req-bae30c81-583f-4c4e-8e25-f494154f8f3c service nova] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:11.393542 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:11.393542 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:12:11.509545 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977531.5090704, 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:11.510348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:12:11.510348 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] VM Started (Lifecycle Event)
May 28 14:12:11.514253 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:12:11.521474 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Instance spawned successfully.
May 28 14:12:11.521474 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:12:11.635656 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:11.635656 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:11.965487 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:12:12.016723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:12.019036 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:12:12.029086 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:12.029287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:12.029872 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:12.030229 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:12.030581 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:12.030898 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:12.137085 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:12.176028 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:12.323808 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:12.420062 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:12:12.421146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:12:12.421420 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Creating image(s)
May 28 14:12:12.422645 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:12:12.422645 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Ensure instance console log exists: /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:12:12.422906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:12.423120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:12.423301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:12.521585 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:12:12.521849 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977532.5216036, 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:12.522033 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] VM Paused (Lifecycle Event)
May 28 14:12:12.535708 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Took 7.72 seconds to spawn the instance on the hypervisor.
May 28 14:12:12.535931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:12.647659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.413s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:12.712368 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Deleted allocations for instance f67c8d28-d6d9-4d52-960c-3d8e15622855
May 28 14:12:12.831284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:12.831284 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance network_info: |[{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:12:12.831284 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Start _get_guest_xml network_info=[{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'ae44429c-3f40-47f5-a052-6baf95df2365', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d', 'attached_at': '', 'detached_at': '', 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'serial': '92f77984-c5a1-486b-ac27-897f5399e7ce'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:12:12.831284 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:12:12.831284 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1246116858', uuid='9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d'), owner=OwnerMeta(userid='62dd681b2bbe4147af5e6cd596c6d668', username='tempest-TestShelveInstance-596826550-project-member', projectid='52a6b1dd5a2f47bdbea499915e31b2f3', projectname='tempest-TestShelveInstance-596826550'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977532.8303082) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:12:12.831726 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:12.832678 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:12:12.833123 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:12:12.834081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:12:12.834287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:12:12.835260 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:12:12.835606 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:12:12.835790 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:12:12.835946 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:12:12.836112 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:12:12.836245 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:12:12.836395 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:12:12.836607 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:12:12.836755 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:12:12.836926 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:12:12.837073 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:12:12.837233 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:12:12.847845 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:12:12.848251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:12.848392 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:12.848733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:12.848989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:12:12.861658 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:12.862277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:12.862510 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:12:12.863141 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:12.863750 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:12.864045 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:12:12.877045 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:12:12.877045 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:12.881743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:12:12.881743 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:12.889670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce] added
May 28 14:12:12.889670 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:12:12.889670 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:12:12.889670 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:12:12.889670 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:12:12.889670 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:12:12.889670 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:12.890051 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:12:12.891302 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:12:12.891302 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:12:12.892728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce] added
May 28 14:12:12.892728 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:12:12.892728 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:12:12.892728 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:12:12.892728 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:12:12.892728 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:12:12.892728 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:12.893086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:12:12.893086 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:12:12.893286 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:12:13.025287 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:13.029525 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977533.0290084, 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:13.029706 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] VM Resumed (Lifecycle Event)
May 28 14:12:13.044333 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Took 13.23 seconds to build instance.
May 28 14:12:13.532464 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:13.535096 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:12:13.548470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.739s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:13.722036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-642222ca-9c99-4919-9d69-e41a6de50617 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Lock "f67c8d28-d6d9-4d52-960c-3d8e15622855" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.349s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:13.891092 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:12:13.893804 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:12:13.906646 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:12:13.906646 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:12:13.914187 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:12:13.914187 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:13.923973 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:13.929477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.945963 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.946370 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.953488 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:13.953813 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:14.002436 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260]
May 28 14:12:14.002436 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260] successful.
May 28 14:12:14.002436 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:14.015032 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260]
May 28 14:12:14.015032 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260] successful.
May 28 14:12:14.015032 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:14.016134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:14.033651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.046528 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:14.046528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:12:14.047594 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] HCTL ('11', '-', '-', 0) found on session 106 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:12:14.047594 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:12:14.051686 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-changed-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:14.051686 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Refreshing instance network info cache due to event network-changed-2d30b655-1e54-4e0b-aa01-e53b665fa3b7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:14.051686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] Acquiring lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:14.051788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] Acquired lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:14.052161 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Refreshing network info cache for port 2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:14.065565 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:14.070492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:14.070492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:12:14.070492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching for a device in session 106 and hctl ['11', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:12:14.072889 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] HCTL ('12', '-', '-', 0) found on session 107 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:12:14.072889 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:12:14.097660 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching for a device in session 107 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:12:14.097660 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:12:14.554836 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:14.640157 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:14.890887 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:15.057114 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updated VIF entry in instance network info cache for port 2d30b655-1e54-4e0b-aa01-e53b665fa3b7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:12:15.057455 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating instance_info_cache with network_info: [{"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:15.070641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching for a device in session 106 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:12:15.070823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:12:15.560032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-75c83855-3e46-4c3c-9495-10e7789756bf req-79ed4b84-a246-4131-adf2-6358a421b5a7 service nova] Releasing lock "refresh_cache-811bba84-3c9c-4ff7-b115-919041083aa2" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:15.883721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Found WWN 330000000e6a27b75 for multipath device dm-2 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:12:15.883721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:15.883721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000e6a27b75', 'path': '/dev/dm-2', 'multipath_id': '330000000e6a27b75'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:15.883721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e6a27b75', 'path': '/dev/dm-2', 'multipath_id': '330000000e6a27b75'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:12:16.132646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-changed-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:16.133141 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Refreshing instance network info cache due to event network-changed-fb468400-028e-4a16-89be-0bd979271e03. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:16.133306 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] Acquiring lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:16.133399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] Acquired lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:16.133726 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Refreshing network info cache for port fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:16.389310 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1246116858',display_name='tempest-TestShelveInstance-server-1246116858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testshelveinstance-server-1246116858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/vQiaxyXS8LEGTF8uoCSUGZqkfvB9GkU+ffz3e+h07cS1mFxJ4cYTb5c2JNnEqAwvcU+QKwKkWk0ibNRSKDeH0r43SQ2edTw2WLX4etfwJJ8B9KEKLabOcoF075PLjtQ==',key_name='tempest-TestShelveInstance-1312651833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52a6b1dd5a2f47bdbea499915e31b2f3',ramdisk_id='',reservation_id='r-nq05f8am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-596826550',owner_user_name='tempest-TestShelveInstance-596826550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:10Z,user_data=None,user_id='62dd681b2bbe4147af5e6cd596c6d668',uuid=9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:12:16.389310 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converting VIF {"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:16.389310 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:16.389310 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:16.635761 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:16.894029 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] End _get_guest_xml xml=<domain type="qemu">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <uuid>9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d</uuid>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <name>instance-0000002d</name>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestShelveInstance-server-1246116858</nova:name>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:12:12</nova:creationTime>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:user uuid="62dd681b2bbe4147af5e6cd596c6d668">tempest-TestShelveInstance-596826550-project-member</nova:user>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:project uuid="52a6b1dd5a2f47bdbea499915e31b2f3">tempest-TestShelveInstance-596826550</nova:project>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         <nova:port uuid="ab278e65-373b-410c-a01b-71df629acfca">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <system>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <entry name="serial">9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d</entry>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <entry name="uuid">9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d</entry>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </system>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <os>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   </os>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <features>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   </features>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   <devices>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </disk>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <alias name="ua-92f77984-c5a1-486b-ac27-897f5399e7ce"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-2"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <serial>92f77984-c5a1-486b-ac27-897f5399e7ce</serial>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </disk>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:cc:b4:8d"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <target dev="tapab278e65-37"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </interface>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/console.log" append="off"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </serial>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <video>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </video>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </rng>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:   </devices>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]: </domain>
May 28 14:12:16.894029 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Preparing to wait for external event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1246116858',display_name='tempest-TestShelveInstance-server-1246116858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testshelveinstance-server-1246116858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/vQiaxyXS8LEGTF8uoCSUGZqkfvB9GkU+ffz3e+h07cS1mFxJ4cYTb5c2JNnEqAwvcU+QKwKkWk0ibNRSKDeH0r43SQ2edTw2WLX4etfwJJ8B9KEKLabOcoF075PLjtQ==',key_name='tempest-TestShelveInstance-1312651833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52a6b1dd5a2f47bdbea499915e31b2f3',ramdisk_id='',reservation_id='r-nq05f8am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-596826550',owner_user_name='tempest-TestShelveInstance-596826550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:10Z,user_data=None,user_id='62dd681b2bbe4147af5e6cd596c6d668',uuid=9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converting VIF {"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:16.899215 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:12:16.900594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:16.900825 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:16.901074 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:12:16.901748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:16.901930 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd504811b-290f-5114-a6ff-9518bb532e66', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:16.905594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:16.906407 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:16.910573 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:16.910773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab278e65-37, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:16.911121 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab278e65-37, col_values=(('qos', UUID('4cc6589b-e835-453a-ad89-eafe12f39a15')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:16.911304 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab278e65-37, col_values=(('external_ids', {'iface-id': 'ab278e65-373b-410c-a01b-71df629acfca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:b4:8d', 'vm-uuid': '9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:16.915643 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:16.917043 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:16.920307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:16.922261 np0000001643 nova-compute[98269]: INFO os_vif [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37')
May 28 14:12:16.957096 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:17.149321 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Updated VIF entry in instance network info cache for port fb468400-028e-4a16-89be-0bd979271e03. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:12:17.149701 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Updating instance_info_cache with network_info: [{"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:17.652582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34f35bab-9af7-4ee1-8e6c-474853c93a67 req-9ac55cf6-163d-461e-a129-01a1d532d86c service nova] Releasing lock "refresh_cache-8ad77d56-99f2-4c46-b41e-ff9b85a23e58" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:18.442564 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:18.443036 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:18.443298 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] No VIF found with MAC fa:16:3e:cc:b4:8d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:12:18.444641 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Using config drive
May 28 14:12:18.954597 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:19.067742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:19.121153 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Creating config drive at /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config
May 28 14:12:19.124274 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpalwkxw6m {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:19.188470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpalwkxw6m" returned: 0 in 0.064s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:19.628507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:19.655484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:19.658622 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:19.777406 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:19.909313 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-13dff2d1-bc60-4d35-bf9c-140a5bdeb38b req-48c99ec9-247e-42c2-a32a-0092d1fd0bf1 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:19.909779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13dff2d1-bc60-4d35-bf9c-140a5bdeb38b req-48c99ec9-247e-42c2-a32a-0092d1fd0bf1 service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:19.910124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13dff2d1-bc60-4d35-bf9c-140a5bdeb38b req-48c99ec9-247e-42c2-a32a-0092d1fd0bf1 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:19.910796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13dff2d1-bc60-4d35-bf9c-140a5bdeb38b req-48c99ec9-247e-42c2-a32a-0092d1fd0bf1 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:19.911850 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-13dff2d1-bc60-4d35-bf9c-140a5bdeb38b req-48c99ec9-247e-42c2-a32a-0092d1fd0bf1 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Processing event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:12:20.066206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:20.069247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:20.073794 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:20.093205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:20.632905 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977540.6322603, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:20.633105 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Started (Lifecycle Event)
May 28 14:12:20.634413 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:12:20.638046 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:12:20.642885 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance spawned successfully.
May 28 14:12:20.642885 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:12:21.137538 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:21.139878 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:12:21.154247 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:21.154391 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:21.154706 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:21.154929 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:21.155161 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:21.155744 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:12:21.330407 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:21.642752 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:12:21.642925 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977541.6426165, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:21.643249 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Paused (Lifecycle Event)
May 28 14:12:21.665281 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Took 9.24 seconds to spawn the instance on the hypervisor.
May 28 14:12:21.665281 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:21.920405 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:22.005886 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8dd70020-d29a-48eb-887e-624732199038 req-47c32ffb-5614-418c-91fc-c2c279fa6017 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:22.006922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dd70020-d29a-48eb-887e-624732199038 req-47c32ffb-5614-418c-91fc-c2c279fa6017 service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:22.007578 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dd70020-d29a-48eb-887e-624732199038 req-47c32ffb-5614-418c-91fc-c2c279fa6017 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:22.007653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dd70020-d29a-48eb-887e-624732199038 req-47c32ffb-5614-418c-91fc-c2c279fa6017 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:22.007860 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8dd70020-d29a-48eb-887e-624732199038 req-47c32ffb-5614-418c-91fc-c2c279fa6017 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] No waiting events found dispatching network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:22.008058 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-8dd70020-d29a-48eb-887e-624732199038 req-47c32ffb-5614-418c-91fc-c2c279fa6017 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received unexpected event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca for instance with vm_state active and task_state None.
May 28 14:12:22.145894 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:22.148752 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977542.1484687, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:22.148904 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Resumed (Lifecycle Event)
May 28 14:12:22.174671 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Took 16.63 seconds to build instance.
May 28 14:12:22.248144 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.000403203999667312 future=<Future at 0x71a75c2831d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:22.248563 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Emitting event <LifecycleEvent: 1779977527.247636, f67c8d28-d6d9-4d52-960c-3d8e15622855 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:22.248751 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] VM Stopped (Lifecycle Event)
May 28 14:12:22.251876 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:22.651316 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:22.654521 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:12:22.675985 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.156s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:22.755154 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: f67c8d28-d6d9-4d52-960c-3d8e15622855] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:23.294206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:24.094387 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-changed-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:24.094556 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing instance network info cache due to event network-changed-ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:24.094819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:24.094941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:24.095174 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing network info cache for port ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:24.597574 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:24.659945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:24.974721 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:25.133024 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updated VIF entry in instance network info cache for port ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:12:25.133339 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:25.635623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-40d0573b-9548-4ae7-906b-f368e9fb695e req-a851f2dc-3e06-4b70-8c56-215b7a78b27f service nova] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:26.827603 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:26.828150 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:12:26.933328 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:28.827022 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:28.827553 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:28.827553 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:12:28.827669 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:12:29.660588 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:29.765383 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:29.765635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:29.765880 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:29.766016 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:29.766166 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:29.768936 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Terminating instance
May 28 14:12:29.827460 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:29.827937 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:29.828313 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:12:30.273360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:12:30.296164 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:30.321351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:30.325639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:30.349201 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:30.466272 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-021e49b3-a438-4110-b7ee-c7e136306dd4 req-a0480447-811b-4dcd-acf6-f60645171719 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:30.466912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-021e49b3-a438-4110-b7ee-c7e136306dd4 req-a0480447-811b-4dcd-acf6-f60645171719 service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:30.467006 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-021e49b3-a438-4110-b7ee-c7e136306dd4 req-a0480447-811b-4dcd-acf6-f60645171719 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:30.467698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-021e49b3-a438-4110-b7ee-c7e136306dd4 req-a0480447-811b-4dcd-acf6-f60645171719 service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:30.467698 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-021e49b3-a438-4110-b7ee-c7e136306dd4 req-a0480447-811b-4dcd-acf6-f60645171719 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] No waiting events found dispatching network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:30.467698 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-021e49b3-a438-4110-b7ee-c7e136306dd4 req-a0480447-811b-4dcd-acf6-f60645171719 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:12:30.583158 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:30.600968 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999669436000204 future=<Future at 0x71a75c23de50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:30.601580 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999122772000192 future=<Future at 0x71a75c23de50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:30.601965 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998660204000316 future=<Future at 0x71a75c23de50 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:30.602681 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Instance destroyed successfully.
May 28 14:12:30.603777 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lazy-loading 'resources' on Instance uuid d1db720f-ec51-4cb4-9ca9-60844350d239 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:30.827424 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:31.106298 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-196826295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serveractionsv293testjson-server-1969542837',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWqUmazuWr5QAW+GKtq0415oQwe6/xm6gDlnVvRcqD/QtIWC8P3QDTb7VtkMt79wsvUYrKGtnMX+YVcnq7jhlbr4oQd5Vly4UXaqyN3WNt0Xd3z6c1g+S5TRBr8pq0wWw==',key_name='tempest-keypair-1994480753',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:11:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='061e1b7a86244ea1b9be96940816b397',ramdisk_id='',reservation_id='r-eaidfmmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1b08055e-7d23-4643-8d4a-4349e3da4086',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-537604347',owner_user_name='tempest-ServerActionsV293TestJSON-537604347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:11:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad96e52e071f4b3b9057ec1a411058b4',uuid=d1db720f-ec51-4cb4-9ca9-60844350d239,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:12:31.106298 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converting VIF {"id": "f0706fd7-168f-43db-bc84-aadec652fb18", "address": "fa:16:3e:5b:b4:48", "network": {"id": "0be77066-66e8-46cb-97ea-b793f3914fe7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-109187953-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "061e1b7a86244ea1b9be96940816b397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0706fd7-16", "ovs_interfaceid": "f0706fd7-168f-43db-bc84-aadec652fb18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:31.106908 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:31.110353 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:12:31.110353 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:31.110353 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0706fd7-16, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:31.110903 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:31.111640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:31.112910 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:31.116654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:31.116987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5699d09-9d96-41dd-b4f0-d3e50cd181da) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:31.117674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:31.118214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:31.119773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:31.123262 np0000001643 nova-compute[98269]: INFO os_vif [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=f0706fd7-168f-43db-bc84-aadec652fb18,network=Network(0be77066-66e8-46cb-97ea-b793f3914fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0706fd7-16')
May 28 14:12:31.128224 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:12:31.128639 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:31.128824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:31.129734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:31.130215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4977f462-5866-4abc-9b09-8f7ea2ac690f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:12:31.130535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e18f0d-039e-4de4-8687-4af46d1b3d12 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e18f0d-039e-4de4-8687-4af46d1b3d12 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:31.161293 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsi session list stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e18f0d-039e-4de4-8687-4af46d1b3d12 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e18f0d-039e-4de4-8687-4af46d1b3d12 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:31.161661 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:31.161661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e18f0d-039e-4de4-8687-4af46d1b3d12', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e18f0d-039e-4de4-8687-4af46d1b3d12', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:12:31.162086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '102')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:12:31.163024 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f', '101')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:12:31.164403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778153100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:12:31.164690 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:12:31.165044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Flush multipath device 3300000001ce0f605 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:12:31.219173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:12:31.268188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:12:31.322417 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:12:31.322417 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:12:31.323435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:12:31.332983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:31.332983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:31.332983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:31.332983 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:12:31.341374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:12:31.341374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:12:31.353670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:31.388039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260]
May 28 14:12:31.388039 np0000001643 nova-compute[98269]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.40.100,3260] successful.
May 28 14:12:31.388039 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:31.408468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:31.421625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:31.460266 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260]
May 28 14:12:31.460266 np0000001643 nova-compute[98269]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-4977f462-5866-4abc-9b09-8f7ea2ac690f, portal: 192.168.50.100,3260] successful.
May 28 14:12:31.460266 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:31.478435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:31.478781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:31.478955 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] <== disconnect_volume: return (350ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:31.479082 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:12:31.479383 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Deleting instance files /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239_del
May 28 14:12:31.480265 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Deletion of /opt/stack/data/nova/instances/d1db720f-ec51-4cb4-9ca9-60844350d239_del complete
May 28 14:12:31.987375 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Took 1.71 seconds to destroy the instance on the hypervisor.
May 28 14:12:31.988077 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:12:31.988435 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:12:31.988562 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:12:31.988759 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:32.061455 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:32.372472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:32.489005 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:32.492562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:32.540905 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-244fa82c-60b3-4f35-875d-f1abf4ac74c5 req-8b5b7741-c4d9-4dae-a91e-10d8e93b274d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:32.544785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-244fa82c-60b3-4f35-875d-f1abf4ac74c5 req-8b5b7741-c4d9-4dae-a91e-10d8e93b274d service nova] Acquiring lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:32.544785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-244fa82c-60b3-4f35-875d-f1abf4ac74c5 req-8b5b7741-c4d9-4dae-a91e-10d8e93b274d service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:32.544785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-244fa82c-60b3-4f35-875d-f1abf4ac74c5 req-8b5b7741-c4d9-4dae-a91e-10d8e93b274d service nova] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:32.544785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-244fa82c-60b3-4f35-875d-f1abf4ac74c5 req-8b5b7741-c4d9-4dae-a91e-10d8e93b274d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] No waiting events found dispatching network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:32.544785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-244fa82c-60b3-4f35-875d-f1abf4ac74c5 req-8b5b7741-c4d9-4dae-a91e-10d8e93b274d service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-unplugged-f0706fd7-168f-43db-bc84-aadec652fb18 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:12:32.584679 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:32.585239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:12:32.585379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-7 (vdc) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:12:32.585770 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-10 (vdd) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:12:32.591637 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:32.632218 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-926dd1d3-2494-4fed-990c-b5f466e3b22e req-d9096250-12ab-4957-a3c5-e5e4fed746f0 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Received event network-vif-deleted-f0706fd7-168f-43db-bc84-aadec652fb18 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:32.632401 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-926dd1d3-2494-4fed-990c-b5f466e3b22e req-d9096250-12ab-4957-a3c5-e5e4fed746f0 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Neutron deleted interface f0706fd7-168f-43db-bc84-aadec652fb18; detaching it from the instance and deleting it from the info cache
May 28 14:12:32.636836 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-926dd1d3-2494-4fed-990c-b5f466e3b22e req-d9096250-12ab-4957-a3c5-e5e4fed746f0 service nova] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Detach interface failed, port_id=f0706fd7-168f-43db-bc84-aadec652fb18, reason: Instance d1db720f-ec51-4cb4-9ca9-60844350d239 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:12:32.679662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:32.680316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:32.779278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:32.783742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:12:32.784555 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Error from libvirt while getting description of instance-00000028: [Error Code 42] Domain not found: no domain with matching uuid 'd1db720f-ec51-4cb4-9ca9-60844350d239' (instance-00000028): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd1db720f-ec51-4cb4-9ca9-60844350d239' (instance-00000028)
May 28 14:12:32.785815 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:32.876984 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:32.877793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:32.970952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:32.975027 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:12:32.976512 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:33.032902 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:33.033364 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12295MB free_disk=73.07965087890625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:12:33.033617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:33.033968 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:33.075659 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:33.578809 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Took 1.59 seconds to deallocate network for instance.
May 28 14:12:34.114055 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d1db720f-ec51-4cb4-9ca9-60844350d239 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:12:34.114265 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 811bba84-3c9c-4ff7-b115-919041083aa2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:12:34.114431 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:12:34.114565 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:12:34.114631 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:12:34.114860 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:12:34.114988 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:12:33 up 39 min,  2 users,  load average: 4.47, 5.83, 4.31\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_1bd0a26536e743c9a9eaeb956fc55b79': '2', 'io_workload': '0', 'num_proj_db1dc6979a244982823fef41c57d1c75': '1', 'num_proj_52a6b1dd5a2f47bdbea499915e31b2f3': '1', 'num_task_deleting': '1', 'num_proj_061e1b7a86244ea1b9be96940816b397': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:12:34.132409 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:12:34.138316 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Deleting volume: 4977f462-5866-4abc-9b09-8f7ea2ac690f {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:12:34.466768 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:34.467080 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:34.661211 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:34.709697 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:34.970184 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:35.476665 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:12:35.476866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.443s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:35.477129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.767s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:35.477383 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:12:35.481972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:35.482160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:35.482375 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Shelving
May 28 14:12:35.770691 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:35.771136 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:36.117950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:36.273967 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:36.509458 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:36.516221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:36.534020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:36.565351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:36.698478 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65da16d7-b199-4994-b6c1-7dedaa98e2a9 req-e53d2764-b33b-4302-ba95-53525775dee9 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:36.699052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65da16d7-b199-4994-b6c1-7dedaa98e2a9 req-e53d2764-b33b-4302-ba95-53525775dee9 service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:36.699052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65da16d7-b199-4994-b6c1-7dedaa98e2a9 req-e53d2764-b33b-4302-ba95-53525775dee9 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:36.699052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65da16d7-b199-4994-b6c1-7dedaa98e2a9 req-e53d2764-b33b-4302-ba95-53525775dee9 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:36.699194 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65da16d7-b199-4994-b6c1-7dedaa98e2a9 req-e53d2764-b33b-4302-ba95-53525775dee9 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] No waiting events found dispatching network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:36.699367 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-65da16d7-b199-4994-b6c1-7dedaa98e2a9 req-e53d2764-b33b-4302-ba95-53525775dee9 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received unexpected event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 for instance with vm_state active and task_state shelving.
May 28 14:12:36.781907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.305s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:36.832957 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999566695999874 future=<Future at 0x71a75c3cdca0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:36.835411 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance destroyed successfully.
May 28 14:12:36.835989 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:36.859548 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Deleted allocations for instance d1db720f-ec51-4cb4-9ca9-60844350d239
May 28 14:12:37.432840 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Beginning cold snapshot process
May 28 14:12:37.473313 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:37.473579 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:37.473842 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:12:37.474119 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.35 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:12:37.870969 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f8143025-7083-4d1c-84f9-5169715ed4a1 tempest-ServerActionsV293TestJSON-537604347 tempest-ServerActionsV293TestJSON-537604347-project-member] Lock "d1db720f-ec51-4cb4-9ca9-60844350d239" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.105s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:38.807001 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-62e25f4c-6db8-4234-b80c-cca91a1d357b req-1fa3f1d2-fd22-4068-a5fb-8ef0de342404 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:38.808922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-62e25f4c-6db8-4234-b80c-cca91a1d357b req-1fa3f1d2-fd22-4068-a5fb-8ef0de342404 service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:38.808922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-62e25f4c-6db8-4234-b80c-cca91a1d357b req-1fa3f1d2-fd22-4068-a5fb-8ef0de342404 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:38.808922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-62e25f4c-6db8-4234-b80c-cca91a1d357b req-1fa3f1d2-fd22-4068-a5fb-8ef0de342404 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:38.808922 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-62e25f4c-6db8-4234-b80c-cca91a1d357b req-1fa3f1d2-fd22-4068-a5fb-8ef0de342404 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] No waiting events found dispatching network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:12:38.808922 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-62e25f4c-6db8-4234-b80c-cca91a1d357b req-1fa3f1d2-fd22-4068-a5fb-8ef0de342404 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received unexpected event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 14:12:38.947573 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:12:38.948106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk /opt/stack/data/nova/instances/snapshots/tmpqvvoceov/e039ca740ef84f72a4a6ea6d72680073 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:39.349621 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk /opt/stack/data/nova/instances/snapshots/tmpqvvoceov/e039ca740ef84f72a4a6ea6d72680073" returned: 0 in 0.401s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:39.350053 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Snapshot extracted, beginning image upload
May 28 14:12:39.663872 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:40.349172 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:41.119748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:42.044837 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:12:42.577756 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Snapshot image upload complete
May 28 14:12:42.578082 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:43.087771 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Shelve offloading
May 28 14:12:43.597880 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance destroyed successfully.
May 28 14:12:43.598634 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:43.600623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:43.601193 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquired lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:43.601386 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:12:44.105918 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:44.444625 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:44.627215 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:44.670146 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:44.912547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:45.130329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Releasing lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:45.131129 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:45.131517 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:45.601178 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005095019996588235 future=<Future at 0x71a75c23de50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:45.601321 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:45.601467 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.231060478000018 future=<Future at 0x71a75c3cdca0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:45.601535 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.230929995999759 future=<Future at 0x71a75c3cdca0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:45.602478 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] Emitting event <LifecycleEvent: 1779977550.600526, d1db720f-ec51-4cb4-9ca9-60844350d239 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:45.602670 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] VM Stopped (Lifecycle Event)
May 28 14:12:45.680653 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance destroyed successfully.
May 28 14:12:45.680653 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'resources' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:45.731157 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:45.732012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing instance network info cache due to event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:45.732511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] Acquiring lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:45.732998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] Acquired lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:45.734796 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing network info cache for port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:46.108737 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9dd8cafb-7a6f-4c55-9da8-8bf3bc5d4881 tempest-AttachVolumeMultiAttachTest-1067442384 tempest-AttachVolumeMultiAttachTest-1067442384-project-member] [instance: d1db720f-ec51-4cb4-9ca9-60844350d239] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:46.121980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:46.182771 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<3a1fb5dd-4075-4ede-aa93-8ceee595990a> lazy-loaded attributes: numa_topology,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:12:46.183532 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497369381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-497369381',id=43,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvW3mf2gcKHoDlonmj6X0h+rTiXWtySrcvIHOKBUyKPa21J2I+lToKgGAdfK0jVBMVoRFz8vmYwGZ4KVhrbr4QS7uPhQFIO9eMGkG2wFoouXKA59loNSF45jqwIl2GYcg==',key_name='tempest-keypair-1677477403',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:11:54Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-28q854w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member',shelved_at='2026-05-28T14:12:42.577832',shelved_host='np0000001643',shelved_image_id='c8c72f80-a136-4585-a918-18a47d255411'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=3a1fb5dd-4075-4ede-aa93-8ceee595990a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:12:46.183794 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:46.184566 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:46.184840 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:12:46.186155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:46.186381 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e74ab1b-23, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:46.187853 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:46.188935 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:46.191567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:46.192436 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:46.192613 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cec1c144-1df2-4f03-afc5-0ebe7822cbc3) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:46.193077 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:46.193806 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:46.194027 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:46.196092 np0000001643 nova-compute[98269]: INFO os_vif [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23')
May 28 14:12:46.196370 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Deleting instance files /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a_del
May 28 14:12:46.201063 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Deletion of /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a_del complete
May 28 14:12:46.242942 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:46.774002 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:46.782053 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Deleted allocations for instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a
May 28 14:12:46.969053 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updated VIF entry in instance network info cache for port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:12:46.969053 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:47.287342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:47.287342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:47.447001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:47.474391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-aff9dd2b-dd9a-4386-87fd-65cee113f98a req-d48ab425-9103-404b-987f-edca5f86f482 service nova] Releasing lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:47.520511 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:47.520511 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:48.025162 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:48.536294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.249s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:49.043359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-daefd6a8-be4a-4ca0-9143-f3210c6411bc tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.561s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:49.391570 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:49.391864 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:49.672300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:49.807167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:49.807371 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:49.807554 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Unshelving
May 28 14:12:49.896222 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:12:50.458429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:50.458652 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:50.461467 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:12:50.461605 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Claim successful on node np0000001643
May 28 14:12:50.940513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:50.940982 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:51.193957 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:51.319574 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Booting with volume 97b876e0-f937-46cc-ade6-ae66c75e7f2a at /dev/vdc
May 28 14:12:51.370798 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:51.381571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:12:51.409300 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:51.449965 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:51.463235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:12:51.463834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:12:51.474326 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:12:51.477027 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe7c:348', 'fe80::fc16:3eff:fecc:b48d', 'fe80::c0ca:ecff:fed2:b6fb'] 
May 28 14:12:51.478578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:12:51.481101 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:12:51.481101 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:51.481101 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating existing volume attachment record: f353be4a-294a-4b33-8ca8-714b44245422 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:12:51.761598 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:51.761872 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:51.832983 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003786920001402905 future=<Future at 0x71a75c3cdca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:51.833100 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:12:51.834467 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Emitting event <LifecycleEvent: 1779977556.8323853, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:12:51.834467 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Stopped (Lifecycle Event)
May 28 14:12:52.264799 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:52.336567 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-077c7e3d-4a88-447f-b2ff-3c611ce1310d tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:12:52.463109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:52.771224 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.312s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:52.771590 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:12:53.141367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:53.141641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:53.143089 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'pci_requests' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:53.279730 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:12:53.279730 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:12:53.279730 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:53.279730 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:53.357179 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e546f84a1ffb4deebf8addf08ad348e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c03afb9244e8bb825b9faf46b3f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:12:53.614023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:53.614248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:53.614459 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Attaching volume 6bf236ce-2481-4271-bdde-7dd231fd31c0 to /dev/vdb
May 28 14:12:53.647008 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:53.656996 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:53.669907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:12:53.695645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:53.741983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:12:53.742325 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:12:53.754104 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:12:53.756996 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe7c:348', 'fe80::fc16:3eff:fecc:b48d', 'fe80::c0ca:ecff:fed2:b6fb'] 
May 28 14:12:53.757190 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:12:53.757566 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:12:53.757850 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:53.758124 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Updating existing volume attachment record: 910793fe-fdc4-4711-9b32-bc98e0125d66 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:12:53.786753 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:12:53.835382 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Successfully created port: 6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:12:54.150718 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:12:54.150921 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Claim successful on node np0000001643
May 28 14:12:54.294308 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:12:54.328604 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:12:54.329073 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:12:54.329291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:54.329911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:54.330165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:12:54.346580 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:54.347171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:12:54.348969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:54.348969 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:12:54.350490 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:12:54.350752 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:12:54.365055 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:12:54.365055 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.startup = automatic
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.scan = manual
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:12:54.373760 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:12:54.373760 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:54.380058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:54.387925 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.402439 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.405053 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('20', '0', '0', 0) found on session 104 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:12:54.405053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:12:54.416403 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:12:54.417210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:54.417210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:12:54.418285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 104 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:12:54.418568 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:12:54.421662 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Successfully updated port: 6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:12:54.424000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('19', '0', '0', 0) found on session 103 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:12:54.424173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:12:54.437794 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 103 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:12:54.438054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:12:54.483302 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-changed-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:54.484866 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Refreshing instance network info cache due to event network-changed-6df2c9a1-7f50-4db2-952e-189c1a3d16f9. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:54.484866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] Acquiring lock "refresh_cache-fa8cce02-430b-44b3-a415-e4c38250e4ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:54.484866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] Acquired lock "refresh_cache-fa8cce02-430b-44b3-a415-e4c38250e4ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:54.484866 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Refreshing network info cache for port 6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:54.673100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:54.925282 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "refresh_cache-fa8cce02-430b-44b3-a415-e4c38250e4ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:54.987212 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:55.056600 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:12:55.211243 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:55.301799 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:12:55.304205 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:12:55.304539 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Creating image(s)
May 28 14:12:55.305241 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:55.305599 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "/opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:55.306337 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "/opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:55.307193 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:55.311736 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:55.315753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:55.350715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:12:55.419877 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:55.420317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:55.420957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:55.421517 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:55.425526 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:55.425956 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:55.491872 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:12:55.492248 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:12:55.518234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:55.518618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:55.579703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk 1073741824" returned: 0 in 0.061s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:55.580228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:55.580635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:55.677257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:55.677834 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:12:55.678164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:55.714933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e5fc9bc8-46bc-460b-b005-78044198736e req-999fdc6e-1e6c-4335-8bfb-42b9b00d8f74 service nova] Releasing lock "refresh_cache-fa8cce02-430b-44b3-a415-e4c38250e4ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:55.716881 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquired lock "refresh_cache-fa8cce02-430b-44b3-a415-e4c38250e4ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:55.716881 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:12:55.777633 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:12:55.778689 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Cannot resize image /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:12:55.778689 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:12:55.778689 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Ensure instance console log exists: /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:12:55.778689 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:55.778896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:55.778896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:55.996763 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:12:56.195303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:56.291460 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:12:56.369638 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found WWN 3300000009bea10b7 for multipath device dm-10 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:12:56.370231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:12:56.370441 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== connect_volume: return (2040ms) {'type': 'block', 'scsi_wwn': '3300000009bea10b7', 'path': '/dev/dm-10', 'multipath_id': '3300000009bea10b7'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:12:56.370626 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009bea10b7', 'path': '/dev/dm-10', 'multipath_id': '3300000009bea10b7'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:12:56.377060 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:56.446676 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:56.506538 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.365s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:56.506828 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:56.601324 np0000001643 nova-compute[98269]: INFO nova.network.neutron [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7 with attributes {'binding:host_id': 'np0000001643', 'device_owner': 'compute:nova'}
May 28 14:12:56.619510 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Updating instance_info_cache with network_info: [{"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:56.880528 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Attempting to attach volume 6bf236ce-2481-4271-bdde-7dd231fd31c0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:12:56.882124 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:12:56.882124 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:12:56.882124 np0000001643 nova-compute[98269]:   <alias name="ua-6bf236ce-2481-4271-bdde-7dd231fd31c0"/>
May 28 14:12:56.882124 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:12:56.882124 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:12:56.882124 np0000001643 nova-compute[98269]:   <serial>6bf236ce-2481-4271-bdde-7dd231fd31c0</serial>
May 28 14:12:56.882124 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:12:56.882124 np0000001643 nova-compute[98269]: </disk>
May 28 14:12:56.882124 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:12:57.122361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Releasing lock "refresh_cache-fa8cce02-430b-44b3-a415-e4c38250e4ba" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:57.122361 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Instance network_info: |[{"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:12:57.124428 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Start _get_guest_xml network_info=[{"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:12:57.127823 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:12:57.130036 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1298844520', uuid='fa8cce02-430b-44b3-a415-e4c38250e4ba'), owner=OwnerMeta(userid='e546f84a1ffb4deebf8addf08ad348e5', username='tempest-ServersNegativeTestJSON-1291103668-project-member', projectid='df8c03afb9244e8bb825b9faf46b3f7d', projectname='tempest-ServersNegativeTestJSON-1291103668'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977577.129487) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:12:57.132135 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:12:57.132968 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:12:57.133722 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:12:57.133964 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:12:57.135464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:12:57.135774 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:12:57.135989 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:12:57.137871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:12:57.156942 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1298844520',display_name='tempest-ServersNegativeTestJSON-server-1298844520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serversnegativetestjson-server-1298844520',id=46,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8c03afb9244e8bb825b9faf46b3f7d',ramdisk_id='',reservation_id='r-3w41oo5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1291103668',owner_user_name='tempest-ServersNegativeTestJSON-1291103668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:54Z,user_data=None,user_id='e546f84a1ffb4deebf8addf08ad348e5',uuid=fa8cce02-430b-44b3-a415-e4c38250e4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:12:57.158155 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converting VIF {"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:57.158155 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:4d:3a,bridge_name='br-int',has_traffic_filtering=True,id=6df2c9a1-7f50-4db2-952e-189c1a3d16f9,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df2c9a1-7f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:57.158838 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lazy-loading 'pci_devices' on Instance uuid fa8cce02-430b-44b3-a415-e4c38250e4ba {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:57.176600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:57.176814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquired lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:57.177070 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:12:57.241942 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:12:57.242465 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing instance network info cache due to event network-changed-4e74ab1b-2352-4cb6-bb11-265aad5c70e7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:12:57.242465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] Acquiring lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:12:57.662023 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] End _get_guest_xml xml=<domain type="qemu">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <uuid>fa8cce02-430b-44b3-a415-e4c38250e4ba</uuid>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <name>instance-0000002e</name>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServersNegativeTestJSON-server-1298844520</nova:name>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:12:57</nova:creationTime>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:user uuid="e546f84a1ffb4deebf8addf08ad348e5">tempest-ServersNegativeTestJSON-1291103668-project-member</nova:user>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:project uuid="df8c03afb9244e8bb825b9faf46b3f7d">tempest-ServersNegativeTestJSON-1291103668</nova:project>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         <nova:port uuid="6df2c9a1-7f50-4db2-952e-189c1a3d16f9">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <system>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <entry name="serial">fa8cce02-430b-44b3-a415-e4c38250e4ba</entry>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <entry name="uuid">fa8cce02-430b-44b3-a415-e4c38250e4ba</entry>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </system>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <os>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   </os>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <features>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   </features>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   <devices>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </disk>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk.config"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </disk>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:26:4d:3a"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <target dev="tap6df2c9a1-7f"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </interface>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/console.log" append="off"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </serial>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <video>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </video>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </rng>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:   </devices>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]: </domain>
May 28 14:12:57.662023 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:12:57.662023 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Preparing to wait for external event network-vif-plugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1298844520',display_name='tempest-ServersNegativeTestJSON-server-1298844520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serversnegativetestjson-server-1298844520',id=46,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8c03afb9244e8bb825b9faf46b3f7d',ramdisk_id='',reservation_id='r-3w41oo5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1291103668',owner_user_name='tempest-ServersNegativeTestJSON-1291103668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:54Z,user_data=None,user_id='e546f84a1ffb4deebf8addf08ad348e5',uuid=fa8cce02-430b-44b3-a415-e4c38250e4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converting VIF {"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:4d:3a,bridge_name='br-int',has_traffic_filtering=True,id=6df2c9a1-7f50-4db2-952e-189c1a3d16f9,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df2c9a1-7f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4d:3a,bridge_name='br-int',has_traffic_filtering=True,id=6df2c9a1-7f50-4db2-952e-189c1a3d16f9,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df2c9a1-7f') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:57.665402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:12:57.666031 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:57.666031 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '294fcf88-9253-55c9-b8c0-c89be8e2c96f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:57.666508 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:57.667303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:57.667757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:57.669894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:57.670022 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6df2c9a1-7f, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:57.670303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6df2c9a1-7f, col_values=(('qos', UUID('3f55a6f0-1086-4c60-a39a-90228695b6e4')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:57.670460 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6df2c9a1-7f, col_values=(('external_ids', {'iface-id': '6df2c9a1-7f50-4db2-952e-189c1a3d16f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:4d:3a', 'vm-uuid': 'fa8cce02-430b-44b3-a415-e4c38250e4ba'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:12:57.671167 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:57.672585 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:12:57.677238 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:57.678290 np0000001643 nova-compute[98269]: INFO os_vif [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4d:3a,bridge_name='br-int',has_traffic_filtering=True,id=6df2c9a1-7f50-4db2-952e-189c1a3d16f9,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df2c9a1-7f')
May 28 14:12:57.680154 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:57.979058 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:58.106998 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:58.546962 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:58.546962 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:58.547141 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:58.547141 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:7c:03:48, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:12:58.608900 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Releasing lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:12:58.610056 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:12:58.610367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] Acquired lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:12:58.610796 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Creating image(s)
May 28 14:12:58.611297 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Refreshing network info cache for port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:12:58.612438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:58.612588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:58.613144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:12:58.613318 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:12:59.115169 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:59.117563 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<3a1fb5dd-4075-4ede-aa93-8ceee595990a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:12:59.118118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "f3e8d5529b8ef199150a9ca2d08046dab51afae0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:12:59.118603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "f3e8d5529b8ef199150a9ca2d08046dab51afae0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:12:59.193012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:59.193137 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:12:59.193196 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] No VIF found with MAC fa:16:3e:26:4d:3a, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:12:59.193615 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Using config drive
May 28 14:12:59.476215 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:59.664988 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updated VIF entry in instance network info cache for port 4e74ab1b-2352-4cb6-bb11-265aad5c70e7. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:12:59.664988 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:12:59.678562 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:12:59.704229 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:12:59.887327 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Creating config drive at /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk.config
May 28 14:12:59.891424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3mmbf1yl {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:59.931178 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:59.935299 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:12:59.935584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:12:59.956374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3mmbf1yl" returned: 0 in 0.064s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.029334 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.part --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.029768 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] c8c72f80-a136-4585-a918-18a47d255411 was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:13:00.030511 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:13:00.030921 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.part /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:00.141388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a73ab436-c2fb-4e2c-b54a-0d37ab9e363f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.527s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:00.168102 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c681cb5d-68ca-46ba-8041-b5e491c1715d req-59324ee2-055b-4e70-a237-9c36a4da770f service nova] Releasing lock "refresh_cache-3a1fb5dd-4075-4ede-aa93-8ceee595990a" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:00.208231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.part /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.converted" returned: 0 in 0.177s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.220536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:00.312352 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0.converted --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.313079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "f3e8d5529b8ef199150a9ca2d08046dab51afae0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.194s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:00.313659 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:00.316856 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:00.318216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:00.408991 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.418158 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.422032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0 --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.422032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "f3e8d5529b8ef199150a9ca2d08046dab51afae0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:00.422400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "f3e8d5529b8ef199150a9ca2d08046dab51afae0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:00.422934 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:00.430435 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:00.430893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:00.450630 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.523124 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.541764 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0 --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.542811 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0,backing_fmt=raw /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:00.599109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0,backing_fmt=raw /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk 1073741824" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.599804 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "f3e8d5529b8ef199150a9ca2d08046dab51afae0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:00.600282 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:00.652181 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-70849677-61c4-4c06-aaea-95d98b765faf req-1949424e-51d4-4251-883b-f96d049ab127 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-vif-plugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:00.652282 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70849677-61c4-4c06-aaea-95d98b765faf req-1949424e-51d4-4251-883b-f96d049ab127 service nova] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:00.652721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70849677-61c4-4c06-aaea-95d98b765faf req-1949424e-51d4-4251-883b-f96d049ab127 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:00.653139 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70849677-61c4-4c06-aaea-95d98b765faf req-1949424e-51d4-4251-883b-f96d049ab127 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:00.653139 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-70849677-61c4-4c06-aaea-95d98b765faf req-1949424e-51d4-4251-883b-f96d049ab127 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Processing event network-vif-plugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:13:00.722441 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0 --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:00.722945 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'migration_context' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:00.815131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.817572 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.822222 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.824806 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:00.845987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:01.225264 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<3a1fb5dd-4075-4ede-aa93-8ceee595990a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:01.225794 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Rebasing disk image.
May 28 14:13:01.226390 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:01.321198 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:01.321808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 -F raw /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:01.339800 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:13:01.340957 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977581.3403387, fa8cce02-430b-44b3-a415-e4c38250e4ba => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:01.341621 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] VM Started (Lifecycle Event)
May 28 14:13:01.347836 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:13:01.356999 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Instance spawned successfully.
May 28 14:13:01.356999 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:13:01.673729 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:01.673989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:01.674122 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Shelve offloading
May 28 14:13:01.852143 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:01.856920 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:01.864378 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:01.864608 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:01.864775 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:01.864999 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:01.865287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:01.867538 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:01.989773 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:01.990023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:02.289683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 -F raw /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk" returned: 0 in 0.968s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:02.290220 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:13:02.290220 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Ensure instance console log exists: /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:13:02.290520 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:02.290720 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:02.290882 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:02.293730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Start _get_guest_xml network_info=[{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='f3ce3f0347dcc7d4b8ec0251e73c466b',container_format='bare',created_at=2026-05-28T14:12:35Z,direct_url=<?>,disk_format='qcow2',id=c8c72f80-a136-4585-a918-18a47d255411,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-497369381-shelved',owner='db1dc6979a244982823fef41c57d1c75',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T14:12:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': 'f353be4a-294a-4b33-8ca8-714b44245422', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '3a1fb5dd-4075-4ede-aa93-8ceee595990a', 'attached_at': '', 'detached_at': '', 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'serial': '97b876e0-f937-46cc-ade6-ae66c75e7f2a'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:13:02.296217 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:13:02.298132 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-497369381', uuid='3a1fb5dd-4075-4ede-aa93-8ceee595990a'), owner=OwnerMeta(userid='b666f3c9eb914e2dba854ed4e0d8fb20', username='tempest-AttachVolumeShelveTestJSON-1300734613-project-member', projectid='db1dc6979a244982823fef41c57d1c75', projectname='tempest-AttachVolumeShelveTestJSON-1300734613'), image=ImageMeta(id='c8c72f80-a136-4585-a918-18a47d255411', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977582.297754) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:13:02.299109 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:13:02.299519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:13:02.300384 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:13:02.300647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:13:02.301766 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:13:02.302134 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f3ce3f0347dcc7d4b8ec0251e73c466b',container_format='bare',created_at=2026-05-28T14:12:35Z,direct_url=<?>,disk_format='qcow2',id=c8c72f80-a136-4585-a918-18a47d255411,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-497369381-shelved',owner='db1dc6979a244982823fef41c57d1c75',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T14:12:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:13:02.302300 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:13:02.302413 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:13:02.302588 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:13:02.302699 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:13:02.302813 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:13:02.302984 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:13:02.303104 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:13:02.303234 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:13:02.303360 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:13:02.303536 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:13:02.303708 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:02.362474 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:13:02.362474 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977582.3601096, fa8cce02-430b-44b3-a415-e4c38250e4ba => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:02.362474 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] VM Paused (Lifecycle Event)
May 28 14:13:02.370542 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Took 7.07 seconds to spawn the instance on the hypervisor.
May 28 14:13:02.370736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:02.492567 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Detaching volume 6bf236ce-2481-4271-bdde-7dd231fd31c0
May 28 14:13:02.542037 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Attempting to driver detach volume 6bf236ce-2481-4271-bdde-7dd231fd31c0 from mountpoint /dev/vdb
May 28 14:13:02.548755 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdb by alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:02.552477 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdb by alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:02.552477 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Attempting to detach device vdb from instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:13:02.552477 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:   <alias name="ua-6bf236ce-2481-4271-bdde-7dd231fd31c0"/>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:   <serial>6bf236ce-2481-4271-bdde-7dd231fd31c0</serial>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:02.552477 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:02.560955 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdb from instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 from the persistent domain config.
May 28 14:13:02.561113 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] (1/8): Attempting to detach device vdb with device alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 from instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:13:02.561403 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:   <alias name="ua-6bf236ce-2481-4271-bdde-7dd231fd31c0"/>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:   <serial>6bf236ce-2481-4271-bdde-7dd231fd31c0</serial>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:02.561403 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:02.680312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:02.710687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:02.718120 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:02.730904 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9862475c-facd-4b08-b63a-5c1442b282e4 req-733a05e6-fda9-4344-8902-4c306c7c0fd3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-vif-plugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:02.731188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9862475c-facd-4b08-b63a-5c1442b282e4 req-733a05e6-fda9-4344-8902-4c306c7c0fd3 service nova] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:02.731308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9862475c-facd-4b08-b63a-5c1442b282e4 req-733a05e6-fda9-4344-8902-4c306c7c0fd3 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:02.731480 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9862475c-facd-4b08-b63a-5c1442b282e4 req-733a05e6-fda9-4344-8902-4c306c7c0fd3 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:02.731607 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9862475c-facd-4b08-b63a-5c1442b282e4 req-733a05e6-fda9-4344-8902-4c306c7c0fd3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] No waiting events found dispatching network-vif-plugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:02.731747 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9862475c-facd-4b08-b63a-5c1442b282e4 req-733a05e6-fda9-4344-8902-4c306c7c0fd3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received unexpected event network-vif-plugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 for instance with vm_state active and task_state None.
May 28 14:13:02.736589 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:02.740021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:02.760410 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:02.767298 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:02.807242 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<3a1fb5dd-4075-4ede-aa93-8ceee595990a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:02.827976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:13:02.828320 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:02.828492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:02.828914 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:02.829115 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:13:02.842770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:02.843374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:02.843791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:02.844027 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:13:02.844359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:02.844585 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:13:02.859330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:13:02.859330 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:02.866195 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:02.866381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:13:02.866381 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:02.871469 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977582.8710935, fa8cce02-430b-44b3-a415-e4c38250e4ba => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:02.871779 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] VM Resumed (Lifecycle Event)
May 28 14:13:02.875208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a] added
May 28 14:13:02.875208 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:13:02.875208 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:02.875208 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:02.875208 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:02.875208 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:02.875208 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:02.875558 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:13:02.875600 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:13:02.875736 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a] added
May 28 14:13:02.883572 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:02.883572 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:13:02.883572 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:13:02.886739 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Took 12.48 seconds to build instance.
May 28 14:13:02.923297 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1eecfe5c-7ea3-411e-ad6e-77daf0d25a04 req-c33320c1-728a-4837-8b18-e4b6cc687145 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:02.923519 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1eecfe5c-7ea3-411e-ad6e-77daf0d25a04 req-c33320c1-728a-4837-8b18-e4b6cc687145 service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:02.924349 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1eecfe5c-7ea3-411e-ad6e-77daf0d25a04 req-c33320c1-728a-4837-8b18-e4b6cc687145 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:02.924349 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1eecfe5c-7ea3-411e-ad6e-77daf0d25a04 req-c33320c1-728a-4837-8b18-e4b6cc687145 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:02.924349 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1eecfe5c-7ea3-411e-ad6e-77daf0d25a04 req-c33320c1-728a-4837-8b18-e4b6cc687145 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] No waiting events found dispatching network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:02.924349 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1eecfe5c-7ea3-411e-ad6e-77daf0d25a04 req-c33320c1-728a-4837-8b18-e4b6cc687145 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received unexpected event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca for instance with vm_state active and task_state shelving.
May 28 14:13:03.010119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:03.015690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:03.127019 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 for instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:13:03.128380 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance destroyed successfully.
May 28 14:13:03.128680 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:03.375156 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:03.376964 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:03.389513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.997s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:03.631106 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:03.633621 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:03.633745 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:03.633924 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:13:03.877070 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:13:03.879292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977583.8788953, 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 => ua-6bf236ce-2481-4271-bdde-7dd231fd31c0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:13:03.882430 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999673835000067 future=<Future at 0x71a75c2f2210 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:03.882430 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdb from instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 from the live domain config.
May 28 14:13:03.882864 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.996673641000143 future=<Future at 0x71a75c2f2210 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:03.882964 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.996517911999945 future=<Future at 0x71a75c2f2210 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:03.884735 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:13:03.892152 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:13:03.892152 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:13:03.903195 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:13:03.903195 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:03.911366 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:03.920044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.932614 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.946348 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:03.946704 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:03.993612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.50.100,3260]
May 28 14:13:03.993612 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.50.100,3260] successful.
May 28 14:13:03.993612 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:03.998632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.40.100,3260]
May 28 14:13:03.998632 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.40.100,3260] successful.
May 28 14:13:03.998632 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:04.006045 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:04.012573 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.026241 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.026742 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:04.026972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:04.026972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:13:04.028896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] HCTL ('14', '-', '-', 0) found on session 117 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:13:04.029039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.038216 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7dd7c81-d823-4925-82b0-ee569e0f96a8 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:04.038635 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:04.038881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:04.038935 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:13:04.040319 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] HCTL ('15', '-', '-', 0) found on session 118 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:13:04.040461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:13:04.055089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching for a device in session 117 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:13:04.055089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:13:04.079719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching for a device in session 118 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:13:04.079719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:13:04.137857 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:04.433415 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Detected multiple connections on this host for volume: 6bf236ce-2481-4271-bdde-7dd231fd31c0, skipping target disconnect.
May 28 14:13:04.549991 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:04.679968 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:04.716094 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:04.844721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:13:04.885075 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:04.885301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:04.999488 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c448f6f6-af24-4ba7-820e-f2f8446f9481 req-bd94be4e-10c5-4f25-9ef6-482b0d858dab service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:04.999770 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c448f6f6-af24-4ba7-820e-f2f8446f9481 req-bd94be4e-10c5-4f25-9ef6-482b0d858dab service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:05.002339 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:05.003931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c448f6f6-af24-4ba7-820e-f2f8446f9481 req-bd94be4e-10c5-4f25-9ef6-482b0d858dab service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:05.003931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c448f6f6-af24-4ba7-820e-f2f8446f9481 req-bd94be4e-10c5-4f25-9ef6-482b0d858dab service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:05.003931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c448f6f6-af24-4ba7-820e-f2f8446f9481 req-bd94be4e-10c5-4f25-9ef6-482b0d858dab service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] No waiting events found dispatching network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:05.003931 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-c448f6f6-af24-4ba7-820e-f2f8446f9481 req-bd94be4e-10c5-4f25-9ef6-482b0d858dab service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received unexpected event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca for instance with vm_state active and task_state shelving.
May 28 14:13:05.218094 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:05.218409 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:05.218718 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:05.387752 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:13:05.774055 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance destroyed successfully.
May 28 14:13:05.776074 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'resources' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:05.863415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Found WWN 3300000000cc0b4b4 for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:13:05.863807 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:05.864054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000000cc0b4b4', 'path': '/dev/dm-3', 'multipath_id': '3300000000cc0b4b4'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:05.864179 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000cc0b4b4', 'path': '/dev/dm-3', 'multipath_id': '3300000000cc0b4b4'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:13:05.970342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:05.970431 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:05.977237 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:13:05.977544 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Claim successful on node np0000001643
May 28 14:13:06.012992 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d5f40e0c-962e-4db1-bd3e-d5385505737f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.023s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:06.277029 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Object Instance<9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d> lazy-loaded attributes: numa_topology,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:06.280418 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1246116858',display_name='tempest-TestShelveInstance-server-1246116858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testshelveinstance-server-1246116858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/vQiaxyXS8LEGTF8uoCSUGZqkfvB9GkU+ffz3e+h07cS1mFxJ4cYTb5c2JNnEqAwvcU+QKwKkWk0ibNRSKDeH0r43SQ2edTw2WLX4etfwJJ8B9KEKLabOcoF075PLjtQ==',key_name='tempest-TestShelveInstance-1312651833',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:12:21Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52a6b1dd5a2f47bdbea499915e31b2f3',ramdisk_id='',reservation_id='r-nq05f8am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-596826550',owner_user_name='tempest-TestShelveInstance-596826550-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:12:22Z,user_data=None,user_id='62dd681b2bbe4147af5e6cd596c6d668',uuid=9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:13:06.280418 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converting VIF {"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:06.280418 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:06.280418 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:13:06.280790 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.281155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab278e65-37, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:06.283535 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:06.285272 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.286420 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.286718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cc6589b-e835-453a-ad89-eafe12f39a15) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:06.291055 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:06.293670 np0000001643 nova-compute[98269]: INFO os_vif [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37')
May 28 14:13:06.294473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:13:06.295826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:06.295826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:06.295826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:06.295826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:13:06.295826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:06.334321 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:06.334939 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d4463483-5ba0-442a-bb8a-5cfc35a47edf', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:13:06.334939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '106')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:06.335904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '107')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:06.336805 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780187920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'): ({'sdg'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:13:06.336985 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:13:06.337192 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Flush multipath device 330000000e6a27b75 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:13:06.360867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:06.360867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:06.360867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:06.360867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:06.360867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:06.362307 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Terminating instance
May 28 14:13:06.377365 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497369381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-497369381',id=43,image_ref='c8c72f80-a136-4585-a918-18a47d255411',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1677477403',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:11:54Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-28q854w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member',shelved_at='2026-05-28T14:12:42.577832',shelved_host='np0000001643',shelved_image_id='c8c72f80-a136-4585-a918-18a47d255411'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=3a1fb5dd-4075-4ede-aa93-8ceee595990a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:13:06.377859 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:06.378577 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:06.379126 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:06.388233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:06.426187 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:06.466996 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:13:06.467160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:13:06.468312 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:13:06.482123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:13:06.484426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:13:06.498406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:06.534015 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260]
May 28 14:13:06.534015 np0000001643 nova-compute[98269]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260] successful.
May 28 14:13:06.534015 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:06.562702 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:06.577179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:06.614577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260]
May 28 14:13:06.614577 np0000001643 nova-compute[98269]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260] successful.
May 28 14:13:06.614577 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:06.633923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:06.634140 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:06.634261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] <== disconnect_volume: return (339ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:06.634401 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:13:06.634708 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Deleting instance files /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d_del
May 28 14:13:06.635277 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Deletion of /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d_del complete
May 28 14:13:06.869289 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:13:06.882427 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<3a1fb5dd-4075-4ede-aa93-8ceee595990a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:06.883786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] End _get_guest_xml xml=<domain type="qemu">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <uuid>3a1fb5dd-4075-4ede-aa93-8ceee595990a</uuid>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <name>instance-0000002b</name>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-497369381</nova:name>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:13:02</nova:creationTime>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:user uuid="b666f3c9eb914e2dba854ed4e0d8fb20">tempest-AttachVolumeShelveTestJSON-1300734613-project-member</nova:user>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:project uuid="db1dc6979a244982823fef41c57d1c75">tempest-AttachVolumeShelveTestJSON-1300734613</nova:project>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         <nova:port uuid="4e74ab1b-2352-4cb6-bb11-265aad5c70e7">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <system>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <entry name="serial">3a1fb5dd-4075-4ede-aa93-8ceee595990a</entry>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <entry name="uuid">3a1fb5dd-4075-4ede-aa93-8ceee595990a</entry>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </system>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <os>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   </os>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <features>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   </features>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   <devices>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <alias name="ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-3"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <target dev="vdc" bus="virtio"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <serial>97b876e0-f937-46cc-ade6-ae66c75e7f2a</serial>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:05:43:7f"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <target dev="tap4e74ab1b-23"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </interface>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/console.log" append="off"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </serial>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <video>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </video>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </rng>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:   </devices>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]: </domain>
May 28 14:13:06.883786 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:13:06.886856 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Preparing to wait for external event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:13:06.886856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:06.886856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:06.886856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:06.888062 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497369381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-497369381',id=43,image_ref='c8c72f80-a136-4585-a918-18a47d255411',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1677477403',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:11:54Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-28q854w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member',shelved_at='2026-05-28T14:12:42.577832',shelved_host='np0000001643',shelved_image_id='c8c72f80-a136-4585-a918-18a47d255411'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:12:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=3a1fb5dd-4075-4ede-aa93-8ceee595990a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:13:06.888244 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:06.888881 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:06.889141 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:13:06.889368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.889617 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:06.889834 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:13:06.890535 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.890698 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dafbd62-9cc1-5bdd-8885-d84e653cf70f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:06.904314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.906479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:06.906479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.936268 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.939547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.942352 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.942511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e74ab1b-23, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:06.942978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e74ab1b-23, col_values=(('qos', UUID('7d053e0b-4844-4253-bcdc-21e86f656f7f')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:06.943217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e74ab1b-23, col_values=(('external_ids', {'iface-id': '4e74ab1b-2352-4cb6-bb11-265aad5c70e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:43:7f', 'vm-uuid': '3a1fb5dd-4075-4ede-aa93-8ceee595990a'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:06.946897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:06.958097 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:06.959742 np0000001643 nova-compute[98269]: INFO os_vif [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23')
May 28 14:13:07.084484 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-changed-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:07.084704 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing instance network info cache due to event network-changed-ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:07.086639 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:07.087061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:07.087310 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing network info cache for port ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:07.092319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-deea8f6e-57ad-45c4-a496-3cbfdfca90ba req-fecae2b0-eed8-47bb-b6e8-c279ccb3e02d service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:07.092699 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-deea8f6e-57ad-45c4-a496-3cbfdfca90ba req-fecae2b0-eed8-47bb-b6e8-c279ccb3e02d service nova] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:07.092756 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-deea8f6e-57ad-45c4-a496-3cbfdfca90ba req-fecae2b0-eed8-47bb-b6e8-c279ccb3e02d service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:07.093911 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-deea8f6e-57ad-45c4-a496-3cbfdfca90ba req-fecae2b0-eed8-47bb-b6e8-c279ccb3e02d service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:07.094181 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-deea8f6e-57ad-45c4-a496-3cbfdfca90ba req-fecae2b0-eed8-47bb-b6e8-c279ccb3e02d service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] No waiting events found dispatching network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:07.094308 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-deea8f6e-57ad-45c4-a496-3cbfdfca90ba req-fecae2b0-eed8-47bb-b6e8-c279ccb3e02d service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:07.103911 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.113958 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.208625 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999619434000124 future=<Future at 0x71a75c1cce30 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:07.211147 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Instance destroyed successfully.
May 28 14:13:07.211526 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'resources' on Instance uuid 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:07.383216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:07.383400 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:07.595784 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:07.713910 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-44610843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-44610843',id=44,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV38pm1HbkUROW/tCJmf52xS6BdlTXdGhB7E70gTHtjkTPX7hag/5B9RTUqMwmX3Cqz3dEUOdWuIg74tj0p2z6baF7RtvsMHaZe0ZRHkLWYt3ZzcEeJB0m/zxo2iAwBQQ==',key_name='tempest-keypair-1772616094',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:12:12Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-10qvtph5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=8ad77d56-99f2-4c46-b41e-ff9b85a23e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:13:07.714098 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "fb468400-028e-4a16-89be-0bd979271e03", "address": "fa:16:3e:7c:03:48", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb468400-02", "ovs_interfaceid": "fb468400-028e-4a16-89be-0bd979271e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:07.714737 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:03:48,bridge_name='br-int',has_traffic_filtering=True,id=fb468400-028e-4a16-89be-0bd979271e03,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb468400-02') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:07.714927 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:03:48,bridge_name='br-int',has_traffic_filtering=True,id=fb468400-028e-4a16-89be-0bd979271e03,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb468400-02') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:13:07.717269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.717554 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb468400-02, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:07.720230 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:07.727618 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.729835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.729975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a790adc7-8aa7-480e-b557-99e1e3c950e0) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:07.730607 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.731764 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.732049 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:07.738789 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:07.741142 np0000001643 nova-compute[98269]: INFO os_vif [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:03:48,bridge_name='br-int',has_traffic_filtering=True,id=fb468400-028e-4a16-89be-0bd979271e03,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb468400-02')
May 28 14:13:07.741517 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Deleting instance files /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58_del
May 28 14:13:07.742357 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Deletion of /opt/stack/data/nova/instances/8ad77d56-99f2-4c46-b41e-ff9b85a23e58_del complete
May 28 14:13:07.887833 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:07.970656 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:08.097739 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updated VIF entry in instance network info cache for port ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:13:08.097999 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": null, "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapab278e65-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:08.248089 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 14:13:08.248849 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:13:08.249254 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:13:08.249543 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:13:08.249799 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:08.330549 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:08.367577 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Deleted allocations for instance 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d
May 28 14:13:08.396478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.425s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:08.396478 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:13:08.479119 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:08.479355 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:08.479355 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:08.479514 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No VIF found with MAC fa:16:3e:05:43:7f, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:13:08.479960 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Using config drive
May 28 14:13:08.599646 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bcb1af99-e19c-4686-9340-75c8a9e52d37 req-975709ad-2a02-42f7-82a4-a844bf31831b service nova] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:08.872429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:08.872859 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:08.902194 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:13:08.902637 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:13:08.902637 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:08.902842 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:08.981154 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e546f84a1ffb4deebf8addf08ad348e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8c03afb9244e8bb825b9faf46b3f7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:13:08.983596 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'ec2_ids' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:09.151151 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3b3ac98c-f28e-4b94-a476-6d63c517840a req-3120d6ff-72d5-4b76-91fd-74c9eaf44997 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:09.151151 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3b3ac98c-f28e-4b94-a476-6d63c517840a req-3120d6ff-72d5-4b76-91fd-74c9eaf44997 service nova] Acquiring lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:09.151151 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3b3ac98c-f28e-4b94-a476-6d63c517840a req-3120d6ff-72d5-4b76-91fd-74c9eaf44997 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:09.151151 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3b3ac98c-f28e-4b94-a476-6d63c517840a req-3120d6ff-72d5-4b76-91fd-74c9eaf44997 service nova] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:09.151151 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3b3ac98c-f28e-4b94-a476-6d63c517840a req-3120d6ff-72d5-4b76-91fd-74c9eaf44997 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] No waiting events found dispatching network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:09.151151 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3b3ac98c-f28e-4b94-a476-6d63c517840a req-3120d6ff-72d5-4b76-91fd-74c9eaf44997 service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-unplugged-fb468400-028e-4a16-89be-0bd979271e03 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:09.164321 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:09.164897 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:09.407041 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:13:09.411537 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6b4708df-7c22-499c-a378-1b4797b0cd01 req-47d52b32-695f-43ec-ae27-934ea47032cf service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Received event network-vif-deleted-fb468400-028e-4a16-89be-0bd979271e03 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:09.411710 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-6b4708df-7c22-499c-a378-1b4797b0cd01 req-47d52b32-695f-43ec-ae27-934ea47032cf service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Neutron deleted interface fb468400-028e-4a16-89be-0bd979271e03; detaching it from the instance and deleting it from the info cache
May 28 14:13:09.415843 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6b4708df-7c22-499c-a378-1b4797b0cd01 req-47d52b32-695f-43ec-ae27-934ea47032cf service nova] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Detach interface failed, port_id=fb468400-028e-4a16-89be-0bd979271e03, reason: Instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:13:09.486766 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<3a1fb5dd-4075-4ede-aa93-8ceee595990a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:09.486929 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'keypairs' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:09.512391 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Successfully created port: ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:13:09.667383 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:09.842584 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:09.914962 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:13:09.989256 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<3a1fb5dd-4075-4ede-aa93-8ceee595990a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:09.992818 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:10.141075 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Creating config drive at /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config
May 28 14:13:10.145664 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Successfully updated port: ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:13:10.149659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsfponxze {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:10.180036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.306s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:10.201307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsfponxze" returned: 0 in 0.052s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:10.272183 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:10.344825 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Took 2.10 seconds to deallocate network for instance.
May 28 14:13:10.648147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "refresh_cache-04c99001-1372-4b2d-bdc6-0500dfc7d283" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:10.648365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquired lock "refresh_cache-04c99001-1372-4b2d-bdc6-0500dfc7d283" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:10.648627 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:13:10.688298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7246c1c6-8800-46f8-87a8-a4726559765a tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.014s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:10.688667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.416s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:10.688738 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Unshelving
May 28 14:13:10.701544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:10.703789 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:10.730879 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:10.835631 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:10.853850 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:10.854065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:10.925517 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:13:10.925517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:13:10.925517 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Creating image(s)
May 28 14:13:10.929994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "/opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:10.929994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "/opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:10.929994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "/opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:10.929994 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:10.934281 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:10.943650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:11.080381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.137s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:11.082540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:11.082540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:11.083809 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:11.089542 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:11.089882 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:11.143710 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:11.172270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:11.221151 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-changed-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:11.221430 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Refreshing instance network info cache due to event network-changed-ca79dcde-3ca6-46f1-8393-daf7090d83da. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:11.221734 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Acquiring lock "refresh_cache-04c99001-1372-4b2d-bdc6-0500dfc7d283" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:11.227704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.138s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:11.228205 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:11.262867 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:13:11.290820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk 1073741824" returned: 0 in 0.062s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:11.291824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:11.292211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:11.396047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:11.396366 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:13:11.396848 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:11.446481 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:11.446481 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:11.510492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:11.511161 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Cannot resize image /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:13:11.511988 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:13:11.511988 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Ensure instance console log exists: /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:13:11.512761 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:11.512988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:11.513162 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:11.529886 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:11.668822 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Updating instance_info_cache with network_info: [{"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:11.699165 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977591.698791, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:11.699502 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Started (Lifecycle Event)
May 28 14:13:11.708738 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Booting with volume 92f77984-c5a1-486b-ac27-897f5399e7ce at /dev/vda
May 28 14:13:11.775670 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:11.786676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:13:11.808055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:11.864133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:13:11.865076 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:13:11.874909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:13:11.879688 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe29:775f', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe26:4d3a', 'fe80::8bc:45ff:fed4:41c0', 'fe80::fc16:3eff:fe05:437f', 'fe80::64c0:f7ff:fe14:ca9b'] 
May 28 14:13:11.879688 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:13:11.879688 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:13:11.879688 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:11.879688 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating existing volume attachment record: b6f4876b-0e98-4f2b-9ece-b04cc6f61616 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:13:11.951279 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:12.171905 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Releasing lock "refresh_cache-04c99001-1372-4b2d-bdc6-0500dfc7d283" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:12.172272 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Instance network_info: |[{"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:13:12.172644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Acquired lock "refresh_cache-04c99001-1372-4b2d-bdc6-0500dfc7d283" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:12.172863 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Refreshing network info cache for port ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:12.174867 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Start _get_guest_xml network_info=[{"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:13:12.179135 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:13:12.180375 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1079765193', uuid='04c99001-1372-4b2d-bdc6-0500dfc7d283'), owner=OwnerMeta(userid='e546f84a1ffb4deebf8addf08ad348e5', username='tempest-ServersNegativeTestJSON-1291103668-project-member', projectid='df8c03afb9244e8bb825b9faf46b3f7d', projectname='tempest-ServersNegativeTestJSON-1291103668'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977592.1800237) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:13:12.182059 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:13:12.182389 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:13:12.183155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:13:12.183311 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:13:12.184212 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:13:12.184551 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:13:12.184694 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:13:12.184815 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:13:12.184932 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:13:12.185012 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:13:12.185101 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:13:12.185265 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:13:12.185360 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:13:12.185481 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:13:12.185581 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:13:12.185689 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:13:12.198503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1079765193',display_name='tempest-ServersNegativeTestJSON-server-1079765193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serversnegativetestjson-server-1079765193',id=47,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8c03afb9244e8bb825b9faf46b3f7d',ramdisk_id='',reservation_id='r-j951rp8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1291103668',owner_user_name='tempest-ServersNegativeTestJSON-1291103668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:10Z,user_data=None,user_id='e546f84a1ffb4deebf8addf08ad348e5',uuid=04c99001-1372-4b2d-bdc6-0500dfc7d283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:13:12.198664 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converting VIF {"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:12.199192 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=ca79dcde-3ca6-46f1-8393-daf7090d83da,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca79dcde-3c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:12.200575 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lazy-loading 'pci_devices' on Instance uuid 04c99001-1372-4b2d-bdc6-0500dfc7d283 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:12.202023 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:12.203917 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977592.2037182, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:12.204048 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Paused (Lifecycle Event)
May 28 14:13:12.459976 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.606s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:12.520430 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Deleted allocations for instance 8ad77d56-99f2-4c46-b41e-ff9b85a23e58
May 28 14:13:12.676981 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:12.703609 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] End _get_guest_xml xml=<domain type="qemu">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <uuid>04c99001-1372-4b2d-bdc6-0500dfc7d283</uuid>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <name>instance-0000002f</name>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:name>tempest-ServersNegativeTestJSON-server-1079765193</nova:name>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:13:12</nova:creationTime>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:user uuid="e546f84a1ffb4deebf8addf08ad348e5">tempest-ServersNegativeTestJSON-1291103668-project-member</nova:user>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:project uuid="df8c03afb9244e8bb825b9faf46b3f7d">tempest-ServersNegativeTestJSON-1291103668</nova:project>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         <nova:port uuid="ca79dcde-3ca6-46f1-8393-daf7090d83da">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <system>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <entry name="serial">04c99001-1372-4b2d-bdc6-0500dfc7d283</entry>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <entry name="uuid">04c99001-1372-4b2d-bdc6-0500dfc7d283</entry>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </system>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <os>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   </os>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <features>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   </features>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   <devices>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk.config"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:d7:a6:36"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <target dev="tapca79dcde-3c"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </interface>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/console.log" append="off"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </serial>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <video>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </video>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </rng>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:   </devices>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]: </domain>
May 28 14:13:12.703609 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Preparing to wait for external event network-vif-plugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1079765193',display_name='tempest-ServersNegativeTestJSON-server-1079765193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serversnegativetestjson-server-1079765193',id=47,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8c03afb9244e8bb825b9faf46b3f7d',ramdisk_id='',reservation_id='r-j951rp8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1291103668',owner_user_name='tempest-ServersNegativeTestJSON-1291103668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:10Z,user_data=None,user_id='e546f84a1ffb4deebf8addf08ad348e5',uuid=04c99001-1372-4b2d-bdc6-0500dfc7d283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converting VIF {"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=ca79dcde-3ca6-46f1-8393-daf7090d83da,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca79dcde-3c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:12.705873 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=ca79dcde-3ca6-46f1-8393-daf7090d83da,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca79dcde-3c') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:13:12.706287 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:12.706562 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:12.706827 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:13:12.707899 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:12.708984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:12.709581 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c27fbd9-3e65-5987-8952-b5326b90d2e1', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:12.710645 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:12.711605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:12.711955 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:12.716806 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:12.717031 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca79dcde-3c, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:12.717548 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca79dcde-3c, col_values=(('qos', UUID('48ae2b9c-49e4-4f88-b972-0da620062ce3')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:12.717742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca79dcde-3c, col_values=(('external_ids', {'iface-id': 'ca79dcde-3ca6-46f1-8393-daf7090d83da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:a6:36', 'vm-uuid': '04c99001-1372-4b2d-bdc6-0500dfc7d283'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:12.718714 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:12.720341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:12.725997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:12.727402 np0000001643 nova-compute[98269]: INFO os_vif [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=ca79dcde-3ca6-46f1-8393-daf7090d83da,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca79dcde-3c')
May 28 14:13:12.981393 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:13.136696 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Updated VIF entry in instance network info cache for port ca79dcde-3ca6-46f1-8393-daf7090d83da. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:13:13.137203 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Updating instance_info_cache with network_info: [{"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:13.218426 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:13:13.529687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-04878cc1-a09e-43ba-8dd3-09d9e43a7bf9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "8ad77d56-99f2-4c46-b41e-ff9b85a23e58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.171s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:13.534550 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:13.534835 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:13.536336 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:13.639716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Releasing lock "refresh_cache-04c99001-1372-4b2d-bdc6-0500dfc7d283" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:13.639716 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:13.639873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:13.640002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:13.640327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:13.640327 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Processing event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:13:13.640327 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:13.641032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:13.641032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:13.641032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:13.641032 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] No waiting events found dispatching network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:13.641032 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-319794f3-c204-4e7b-aab7-1fa0cb326395 req-1f3d4cce-2a3f-46f5-b381-5064a337593c service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received unexpected event network-vif-plugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 for instance with vm_state shelved_offloaded and task_state spawning.
May 28 14:13:13.641534 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:13:13.647875 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977593.6475475, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:13.647988 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Resumed (Lifecycle Event)
May 28 14:13:13.650578 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:13:13.658501 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance spawned successfully.
May 28 14:13:13.848657 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:13.848883 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:13.980237 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:14.039717 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:14.151304 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:14.152570 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:14.250167 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:14.250167 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:14.250167 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] No VIF found with MAC fa:16:3e:d7:a6:36, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:13:14.250167 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Using config drive
May 28 14:13:14.353246 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Detaching volume 6bf236ce-2481-4271-bdde-7dd231fd31c0
May 28 14:13:14.399846 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attempting to driver detach volume 6bf236ce-2481-4271-bdde-7dd231fd31c0 from mountpoint /dev/vdd
May 28 14:13:14.407027 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdd by alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:14.409730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdd by alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:14.412818 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Attempting to detach device vdd from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:13:14.413154 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:   <alias name="ua-6bf236ce-2481-4271-bdde-7dd231fd31c0"/>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:   <target dev="vdd" bus="virtio"/>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:   <serial>6bf236ce-2481-4271-bdde-7dd231fd31c0</serial>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:14.413154 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:14.423895 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdd from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the persistent domain config.
May 28 14:13:14.424127 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] (1/8): Attempting to detach device vdd with device alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:13:14.424464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:   <alias name="ua-6bf236ce-2481-4271-bdde-7dd231fd31c0"/>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-10"/>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:   <target dev="vdd" bus="virtio"/>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:   <serial>6bf236ce-2481-4271-bdde-7dd231fd31c0</serial>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:14.424464 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:14.488010 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2b73157d-0eed-465e-bff1-fc4da889f55e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.681s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:14.542260 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:13:14.542609 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Claim successful on node np0000001643
May 28 14:13:14.789004 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:14.811720 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:14.939234 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Creating config drive at /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk.config
May 28 14:13:14.942536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw2jb8mmf {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:14.969548 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977594.9678838, 811bba84-3c9c-4ff7-b115-919041083aa2 => ua-6bf236ce-2481-4271-bdde-7dd231fd31c0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:13:14.972996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-6bf236ce-2481-4271-bdde-7dd231fd31c0 for instance 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:13:14.979228 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdd from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the live domain config.
May 28 14:13:15.001660 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw2jb8mmf" returned: 0 in 0.059s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:15.023525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:13:15.024020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:15.024251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:15.442334 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:15.471552 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:15.478027 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:15.572767 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:15.663934 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-27c73151-792b-4b27-972c-f0f09976fcdb req-41909d11-53c8-4a53-b05f-6db0f722bcd1 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-vif-plugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:15.664371 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-27c73151-792b-4b27-972c-f0f09976fcdb req-41909d11-53c8-4a53-b05f-6db0f722bcd1 service nova] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:15.665100 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-27c73151-792b-4b27-972c-f0f09976fcdb req-41909d11-53c8-4a53-b05f-6db0f722bcd1 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:15.665100 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-27c73151-792b-4b27-972c-f0f09976fcdb req-41909d11-53c8-4a53-b05f-6db0f722bcd1 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:15.665100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-27c73151-792b-4b27-972c-f0f09976fcdb req-41909d11-53c8-4a53-b05f-6db0f722bcd1 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Processing event network-vif-plugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:13:15.665965 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:15.906001 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:15.906345 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:16.250222 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977596.249718, 04c99001-1372-4b2d-bdc6-0500dfc7d283 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:16.250734 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:13:16.250952 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] VM Started (Lifecycle Event)
May 28 14:13:16.253525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:13:16.256068 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Instance spawned successfully.
May 28 14:13:16.258572 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:13:16.409652 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:16.754941 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:16.756783 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:16.763532 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:16.763696 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:16.763896 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:16.764096 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:16.764324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:16.764577 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:16.889356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:16.889568 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:16.917821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.383s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:16.918209 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:17.001664 np0000001643 nova-compute[98269]: INFO nova.network.neutron [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating port ab278e65-373b-410c-a01b-71df629acfca with attributes {'binding:host_id': 'np0000001643', 'device_owner': 'compute:nova'}
May 28 14:13:17.260108 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:13:17.260108 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977597.2596843, 04c99001-1372-4b2d-bdc6-0500dfc7d283 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:17.260108 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] VM Paused (Lifecycle Event)
May 28 14:13:17.268701 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Took 6.34 seconds to spawn the instance on the hypervisor.
May 28 14:13:17.268954 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:17.381304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.357s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:17.381716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6bf236ce-2481-4271-bdde-7dd231fd31c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:13:17.381890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:13:17.392850 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:17.425298 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '104')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:17.425298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0', '103')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:17.426334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778150ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'): ({'sdn'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:13:17.426496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Removing multipathed devices sdn, sdo {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:13:17.427743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flush multipath device 3300000009bea10b7 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:13:17.471497 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:17.522394 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:17.575279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:13:17.575279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:13:17.575279 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:13:17.588330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:13:17.589092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:13:17.602607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:17.614365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:17.614510 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:17.614611 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:13:17.646079 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.40.100,3260]
May 28 14:13:17.646079 np0000001643 nova-compute[98269]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.40.100,3260] successful.
May 28 14:13:17.646079 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:17.658798 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-changed-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:17.658963 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing instance network info cache due to event network-changed-ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:17.659126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:17.668000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:17.680378 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:17.720039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:17.724476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.50.100,3260]
May 28 14:13:17.724476 np0000001643 nova-compute[98269]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-6bf236ce-2481-4271-bdde-7dd231fd31c0, portal: 192.168.50.100,3260] successful.
May 28 14:13:17.724476 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:17.748005 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e3d02c14-4c71-4dcf-9ae5-056ef00f0a7a req-f12a31d1-8b49-476a-967f-363d4000d709 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-vif-plugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:17.748457 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3d02c14-4c71-4dcf-9ae5-056ef00f0a7a req-f12a31d1-8b49-476a-967f-363d4000d709 service nova] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:17.748894 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3d02c14-4c71-4dcf-9ae5-056ef00f0a7a req-f12a31d1-8b49-476a-967f-363d4000d709 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:17.748958 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e3d02c14-4c71-4dcf-9ae5-056ef00f0a7a req-f12a31d1-8b49-476a-967f-363d4000d709 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:17.749166 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e3d02c14-4c71-4dcf-9ae5-056ef00f0a7a req-f12a31d1-8b49-476a-967f-363d4000d709 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] No waiting events found dispatching network-vif-plugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:17.749695 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e3d02c14-4c71-4dcf-9ae5-056ef00f0a7a req-f12a31d1-8b49-476a-967f-363d4000d709 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received unexpected event network-vif-plugged-ca79dcde-3ca6-46f1-8393-daf7090d83da for instance with vm_state active and task_state None.
May 28 14:13:17.750240 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:17.753907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:17.753907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== disconnect_volume: return (2726ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:17.753907 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:13:17.762924 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:17.766158 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977597.7658672, 04c99001-1372-4b2d-bdc6-0500dfc7d283 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:17.766289 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] VM Resumed (Lifecycle Event)
May 28 14:13:17.790056 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Took 11.90 seconds to build instance.
May 28 14:13:17.960026 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:17.960280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:17.963735 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:13:17.963899 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Claim successful on node np0000001643
May 28 14:13:18.116786 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:18.269306 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:18.271597 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:18.296080 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e1611a3e-f610-4f28-ba86-abd4be3ae5e0 tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.411s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:18.323071 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:18.432655 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:18.597854 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:18.880075 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005219559998295153 future=<Future at 0x71a75c2f2210 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:18.881084 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Emitting event <LifecycleEvent: 1779977583.879406, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:18.882125 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Stopped (Lifecycle Event)
May 28 14:13:18.883666 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:18.884234 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.3241025339998487 future=<Future at 0x71a75c1cce30 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:18.884234 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.3239779929999713 future=<Future at 0x71a75c1cce30 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:19.100140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:19.101223 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:13:19.101605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:19.101891 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Creating image(s)
May 28 14:13:19.102283 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing network info cache for port ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:19.102818 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:13:19.103592 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Ensure instance console log exists: /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:13:19.104030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:19.104187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:19.104311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:19.104807 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Start _get_guest_xml network_info=[{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'b6f4876b-0e98-4f2b-9ece-b04cc6f61616', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d', 'attached_at': '', 'detached_at': '', 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'serial': '92f77984-c5a1-486b-ac27-897f5399e7ce'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:13:19.107786 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:13:19.108882 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1246116858', uuid='9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d'), owner=OwnerMeta(userid='62dd681b2bbe4147af5e6cd596c6d668', username='tempest-TestShelveInstance-596826550-project-member', projectid='52a6b1dd5a2f47bdbea499915e31b2f3', projectname='tempest-TestShelveInstance-596826550'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977599.1085365) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:13:19.111671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:13:19.111671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:13:19.112281 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:13:19.112502 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:13:19.113371 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:13:19.113810 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:13:19.114087 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:13:19.114279 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:13:19.114474 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:13:19.114606 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:13:19.114731 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:13:19.114900 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:13:19.115047 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:13:19.115161 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:13:19.115604 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:13:19.115770 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:13:19.115947 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:19.293106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:19.293281 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:19.306876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:19.330154 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:19.330322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:19.330484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:19.330627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:19.330798 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:19.332084 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2f980e5f-9213-4893-8a56-a5a94fed9b5f tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.483s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:19.333484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.027s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:19.335379 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Terminating instance
May 28 14:13:19.386420 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:19.606007 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:19.618269 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Object Instance<9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:19.627753 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:13:19.628064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:19.628183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:19.628509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:19.628715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:13:19.643589 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:19.644463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:19.645172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:19.645610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:19.645926 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:13:19.646268 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:13:19.665930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:13:19.665930 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:19.671134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:13:19.671134 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:19.679956 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce] added
May 28 14:13:19.679956 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:13:19.679956 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:19.679956 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:19.679956 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:19.679956 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:19.679956 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:19.680254 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:13:19.681464 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:13:19.681464 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:13:19.685069 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:19.687589 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce] added
May 28 14:13:19.687589 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:13:19.687589 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:19.687589 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:19.687589 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:13:19.687589 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:13:19.687589 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:19.688575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:13:19.692937 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.047(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:13:19.693174 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:13:19.795675 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:19.843614 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:13:19.844390 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Detaching volume 1003165e-0fe9-43e7-9f4a-f15cf89c7b85
May 28 14:13:19.874524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:19.879428 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:19.903351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:19.917706 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attempting to driver detach volume 1003165e-0fe9-43e7-9f4a-f15cf89c7b85 from mountpoint /dev/vdc
May 28 14:13:19.962286 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': '811bba84-3c9c-4ff7-b115-919041083aa2', 'attached_at': '', 'detached_at': '', 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'serial': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:13:19.966125 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdc by alias ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:19.967351 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdc by alias ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:19.967525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Attempting to detach device vdc from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:13:19.967758 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   <alias name="ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85"/>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   <serial>1003165e-0fe9-43e7-9f4a-f15cf89c7b85</serial>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="67d472f8-ef8a-43f2-bed1-7b7b500ef403"/>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:19.967758 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:19.984194 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdc from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the persistent domain config.
May 28 14:13:19.984194 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] (1/8): Attempting to detach device vdc with device alias ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:13:19.984517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   <alias name="ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85"/>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   <serial>1003165e-0fe9-43e7-9f4a-f15cf89c7b85</serial>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="67d472f8-ef8a-43f2-bed1-7b7b500ef403"/>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:19.984517 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:20.059098 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:20.061605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.068140 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.085240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a042ad4b-0b99-4527-8d9c-a657c38bf45b req-a5403993-8d43-49ef-99ee-1deed2a97ce0 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-vif-unplugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:20.085240 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a042ad4b-0b99-4527-8d9c-a657c38bf45b req-a5403993-8d43-49ef-99ee-1deed2a97ce0 service nova] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:20.085609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a042ad4b-0b99-4527-8d9c-a657c38bf45b req-a5403993-8d43-49ef-99ee-1deed2a97ce0 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:20.085609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a042ad4b-0b99-4527-8d9c-a657c38bf45b req-a5403993-8d43-49ef-99ee-1deed2a97ce0 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:20.085782 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a042ad4b-0b99-4527-8d9c-a657c38bf45b req-a5403993-8d43-49ef-99ee-1deed2a97ce0 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] No waiting events found dispatching network-vif-unplugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:20.085856 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a042ad4b-0b99-4527-8d9c-a657c38bf45b req-a5403993-8d43-49ef-99ee-1deed2a97ce0 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-vif-unplugged-ca79dcde-3ca6-46f1-8393-daf7090d83da for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:20.169099 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.172845 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.201426 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999583999000151 future=<Future at 0x71a75c18e900 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:20.207120 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Instance destroyed successfully.
May 28 14:13:20.207699 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lazy-loading 'resources' on Instance uuid 04c99001-1372-4b2d-bdc6-0500dfc7d283 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:20.269236 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updated VIF entry in instance network info cache for port ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:13:20.269563 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:20.309108 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.349s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:20.309578 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:13:20.490926 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977600.4905803, 811bba84-3c9c-4ff7-b115-919041083aa2 => ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:13:20.492164 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 for instance 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:13:20.495075 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdc from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the live domain config.
May 28 14:13:20.497729 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:13:20.497998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:20.498113 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:20.680959 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:13:20.692622 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:13:20.692622 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.696010 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:13:20.706072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:13:20.710065 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:13:20.710065 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.713907 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1079765193',display_name='tempest-ServersNegativeTestJSON-server-1079765193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serversnegativetestjson-server-1079765193',id=47,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:13:17Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8c03afb9244e8bb825b9faf46b3f7d',ramdisk_id='',reservation_id='r-j951rp8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1291103668',owner_user_name='tempest-ServersNegativeTestJSON-1291103668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:17Z,user_data=None,user_id='e546f84a1ffb4deebf8addf08ad348e5',uuid=04c99001-1372-4b2d-bdc6-0500dfc7d283,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:13:20.713907 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converting VIF {"id": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "address": "fa:16:3e:d7:a6:36", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca79dcde-3c", "ovs_interfaceid": "ca79dcde-3ca6-46f1-8393-daf7090d83da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:20.714500 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=ca79dcde-3ca6-46f1-8393-daf7090d83da,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca79dcde-3c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:20.714771 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=ca79dcde-3ca6-46f1-8393-daf7090d83da,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca79dcde-3c') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:13:20.718782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.719013 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca79dcde-3c, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.737112 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:20.737112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.738315 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:20.738731 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.738731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.742671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.742787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48ae2b9c-49e4-4f88-b972-0da620062ce3) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:20.743360 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.743787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:20.744186 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:20.745760 np0000001643 nova-compute[98269]: INFO os_vif [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a6:36,bridge_name='br-int',has_traffic_filtering=True,id=ca79dcde-3ca6-46f1-8393-daf7090d83da,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca79dcde-3c')
May 28 14:13:20.746023 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Deleting instance files /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283_del
May 28 14:13:20.746657 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Deletion of /opt/stack/data/nova/instances/04c99001-1372-4b2d-bdc6-0500dfc7d283_del complete
May 28 14:13:20.771477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e91ea0d7-5d78-43de-ba42-c5a11e834c2a req-6d5e39de-7a01-4c73-b12b-0c717d43ae13 service nova] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:20.773129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260]
May 28 14:13:20.773129 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260] successful.
May 28 14:13:20.773129 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.778793 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:20.788035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.811470 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.812055 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:20.812250 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:20.812306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:13:20.817110 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:13:20.817316 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:13:20.817594 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:20.818033 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:20.821172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] HCTL ('11', '-', '-', 0) found on session 121 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:13:20.821372 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:13:20.828831 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260]
May 28 14:13:20.828831 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260] successful.
May 28 14:13:20.828831 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.841204 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching for a device in session 121 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:13:20.842724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:13:20.854182 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.879818 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:20.880520 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:20.881123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:20.883741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:13:20.885061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] HCTL ('12', '-', '-', 0) found on session 122 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:13:20.885229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:13:20.916505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Searching for a device in session 122 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:13:20.916857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:13:20.951721 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d64d4218444093a2b86cfdda17f742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161531d31b404ab1bc2c6c340124f03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:13:21.255813 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 14:13:21.257146 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:13:21.257488 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:13:21.257629 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:13:21.257893 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:21.320530 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:13:21.328034 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:21.552656 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Successfully created port: 80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:13:21.645963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:13:21.823669 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:13:21.827708 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:22.098054 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Successfully updated port: 80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:13:22.152670 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:22.161784 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-vif-unplugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:22.161968 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] Acquiring lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:22.162119 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:22.162229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:22.162343 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] No waiting events found dispatching network-vif-unplugged-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:22.162801 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-vif-unplugged-ca79dcde-3ca6-46f1-8393-daf7090d83da for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:22.162923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Received event network-vif-deleted-ca79dcde-3ca6-46f1-8393-daf7090d83da {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:22.163511 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Neutron deleted interface ca79dcde-3ca6-46f1-8393-daf7090d83da; detaching it from the instance and deleting it from the info cache
May 28 14:13:22.164746 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e1a826dd-635f-4a80-85b5-a7bd6acce805 req-aae84c0b-5cb4-45f3-94c8-6bc2bd7f4802 service nova] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Detach interface failed, port_id=ca79dcde-3ca6-46f1-8393-daf7090d83da, reason: Instance 04c99001-1372-4b2d-bdc6-0500dfc7d283 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:13:22.170304 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-changed-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:22.171280 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Refreshing instance network info cache due to event network-changed-80005835-4de3-4f71-b91a-589b63d1631c. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:22.171556 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] Acquiring lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:22.171737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] Acquired lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:22.174900 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Refreshing network info cache for port 80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:22.208611 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00034622500015757396 future=<Future at 0x71a75c1cce30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:22.208959 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Emitting event <LifecycleEvent: 1779977587.2081437, 8ad77d56-99f2-4c46-b41e-ff9b85a23e58 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:22.209075 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:22.209238 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] VM Stopped (Lifecycle Event)
May 28 14:13:22.210318 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=12.990669528000126 future=<Future at 0x71a75c18e900 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:22.210486 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=12.990485136000189 future=<Future at 0x71a75c18e900 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:22.332629 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:13:22.601681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:22.659983 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Took 1.40 seconds to deallocate network for instance.
May 28 14:13:22.662822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Found WWN 330000000e6a27b75 for multipath device dm-2 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:13:22.663114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:22.663365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000e6a27b75', 'path': '/dev/dm-2', 'multipath_id': '330000000e6a27b75'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:22.663601 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e6a27b75', 'path': '/dev/dm-2', 'multipath_id': '330000000e6a27b75'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:13:22.663998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.166s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:22.664400 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:13:22.666966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:13:22.675200 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:22.698068 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2 (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85 (non-flash)
May 28 14:13:22.698404 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:22.698404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61230c37-5bee-49e6-9b24-f38197ce42f2', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:13:22.698667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '97')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:22.699613 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85', '98')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:22.700578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801eade0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'): ({'sdm'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:13:22.700791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Removing multipathed devices sdl, sdm {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:13:22.701140 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flush multipath device 330000000543612c1 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:13:22.715330 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: 8ad77d56-99f2-4c46-b41e-ff9b85a23e58] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:22.731261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:22.745598 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:13:22.796576 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:22.831852 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:13:22.832910 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:13:22.833179 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Creating image(s)
May 28 14:13:22.833685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:22.833868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "/opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:22.834378 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "/opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:22.834962 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:22.838653 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:22.839662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:22.855405 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:13:22.855674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:13:22.863705 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:13:22.876214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:13:22.876560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:13:22.888703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:22.900056 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:22.934519 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.40.100,3260]
May 28 14:13:22.934519 np0000001643 nova-compute[98269]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.40.100,3260] successful.
May 28 14:13:22.934519 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:22.935020 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:22.938700 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:22.939167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:22.940678 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:22.943126 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:22.943658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:22.955331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:22.966790 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:23.006989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.50.100,3260]
May 28 14:13:23.006989 np0000001643 nova-compute[98269]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-1003165e-0fe9-43e7-9f4a-f15cf89c7b85, portal: 192.168.50.100,3260] successful.
May 28 14:13:23.006989 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:23.023986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:23.025418 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:23.025610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== disconnect_volume: return (2527ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:23.025824 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:13:23.036486 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:23.036990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:23.090591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk 1073741824" returned: 0 in 0.053s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:23.093459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:23.093459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:23.171191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:23.171676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:23.174313 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1246116858',display_name='tempest-TestShelveInstance-server-1246116858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testshelveinstance-server-1246116858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1312651833',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:12:21Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52a6b1dd5a2f47bdbea499915e31b2f3',ramdisk_id='',reservation_id='r-nq05f8am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-596826550',owner_user_name='tempest-TestShelveInstance-596826550-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:11Z,user_data=None,user_id='62dd681b2bbe4147af5e6cd596c6d668',uuid=9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:13:23.177192 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converting VIF {"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:23.178341 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:23.179408 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:23.185958 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:23.187284 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:13:23.187552 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:23.288401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:23.288745 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Cannot resize image /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:13:23.289064 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:13:23.289214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Ensure instance console log exists: /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:13:23.289498 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:23.289703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:23.289862 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:23.402919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9315fd2f-3eb6-4d26-9e1c-1925630864a4 req-cd6ff33a-dac0-40ad-8cda-4977c496e6f6 service nova] Releasing lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:23.404899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquired lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:23.405119 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:13:23.556505 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:23.556505 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:23.586113 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:23.682647 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Object Instance<9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:23.683934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] End _get_guest_xml xml=<domain type="qemu">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <uuid>9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d</uuid>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <name>instance-0000002d</name>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestShelveInstance-server-1246116858</nova:name>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:13:19</nova:creationTime>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:user uuid="62dd681b2bbe4147af5e6cd596c6d668">tempest-TestShelveInstance-596826550-project-member</nova:user>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:project uuid="52a6b1dd5a2f47bdbea499915e31b2f3">tempest-TestShelveInstance-596826550</nova:project>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         <nova:port uuid="ab278e65-373b-410c-a01b-71df629acfca">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <system>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <entry name="serial">9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d</entry>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <entry name="uuid">9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d</entry>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </system>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <os>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   </os>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <features>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   </features>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   <devices>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <alias name="ua-92f77984-c5a1-486b-ac27-897f5399e7ce"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-2"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <serial>92f77984-c5a1-486b-ac27-897f5399e7ce</serial>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:cc:b4:8d"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <target dev="tapab278e65-37"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </interface>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/console.log" append="off"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </serial>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <video>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </video>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </rng>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:   </devices>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]: </domain>
May 28 14:13:23.683934 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:13:23.686234 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Preparing to wait for external event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:13:23.686234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:23.686234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:23.686234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:23.686234 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1246116858',display_name='tempest-TestShelveInstance-server-1246116858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testshelveinstance-server-1246116858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1312651833',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:12:21Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52a6b1dd5a2f47bdbea499915e31b2f3',ramdisk_id='',reservation_id='r-nq05f8am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-596826550',owner_user_name='tempest-TestShelveInstance-596826550-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:11Z,user_data=None,user_id='62dd681b2bbe4147af5e6cd596c6d668',uuid=9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:13:23.686234 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converting VIF {"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:23.686234 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:23.686516 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:13:23.686981 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:23.687458 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:23.687881 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:13:23.688741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:23.688957 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd504811b-290f-5114-a6ff-9518bb532e66', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:23.689901 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:23.690785 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:23.692841 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:23.693023 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab278e65-37, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:23.693483 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab278e65-37, col_values=(('qos', UUID('9b73c12c-19e0-4486-b8a6-84a37db75395')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:23.693664 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab278e65-37, col_values=(('external_ids', {'iface-id': 'ab278e65-373b-410c-a01b-71df629acfca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:b4:8d', 'vm-uuid': '9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:23.694490 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:23.695945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:23.699980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:23.700884 np0000001643 nova-compute[98269]: INFO os_vif [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37')
May 28 14:13:23.976198 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:13:24.058827 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:24.138352 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:24.273009 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Updating instance_info_cache with network_info: [{"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:24.567765 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.396s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:24.595601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7a47ac37-e0b6-449f-9b1e-8f05e72950d6 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.262s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:24.621688 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Deleted allocations for instance 04c99001-1372-4b2d-bdc6-0500dfc7d283
May 28 14:13:24.685698 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:24.711868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:24.712026 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:24.775072 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Releasing lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:24.775391 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Instance network_info: |[{"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:13:24.776864 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Start _get_guest_xml network_info=[{"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:13:24.779034 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:13:24.780202 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-410171301', uuid='bfac770e-7430-4353-9f3c-ec438536a7c3'), owner=OwnerMeta(userid='53d64d4218444093a2b86cfdda17f742', username='tempest-VolumesBackupsTest-654288917-project-member', projectid='161531d31b404ab1bc2c6c340124f03d', projectname='tempest-VolumesBackupsTest-654288917'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977604.779887) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:13:24.781440 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:13:24.781807 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:13:24.782667 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:13:24.782866 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:13:24.783769 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:13:24.784082 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:13:24.784236 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:13:24.784329 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:13:24.784493 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:13:24.784609 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:13:24.784731 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:13:24.784918 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:13:24.785041 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:13:24.785181 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:13:24.785309 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:13:24.785548 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:13:24.795734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-410171301',display_name='tempest-VolumesBackupsTest-instance-410171301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesbackupstest-instance-410171301',id=48,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIkRZ9wEh/K7YInYJ6wY5fmRocdvxYBMVzxG+Tvns53o3WeqTn9Ai5CIi37NEf15FG201ctEogkJWgI5GvXlDEVjXKy3o5GmDze4zZfELXHtUxwpLd0Kdvs8c87SEx0Lg==',key_name='tempest-keypair-171131720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161531d31b404ab1bc2c6c340124f03d',ramdisk_id='',reservation_id='r-p5jd6kae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-654288917',owner_user_name='tempest-VolumesBackupsTest-654288917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d64d4218444093a2b86cfdda17f742',uuid=bfac770e-7430-4353-9f3c-ec438536a7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:13:24.795965 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converting VIF {"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:24.796478 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=80005835-4de3-4f71-b91a-589b63d1631c,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80005835-4d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:24.796975 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'pci_devices' on Instance uuid bfac770e-7430-4353-9f3c-ec438536a7c3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:25.215416 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Detaching volume a5ab1a7e-e37b-480f-9a6e-4b84dd713f34
May 28 14:13:25.220739 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:25.223780 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:25.223897 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] No VIF found with MAC fa:16:3e:cc:b4:8d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:13:25.224529 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Using config drive
May 28 14:13:25.265486 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Attempting to driver detach volume a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 from mountpoint /dev/vdb
May 28 14:13:25.270635 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdb by alias ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:25.272314 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdb by alias ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:25.272514 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Attempting to detach device vdb from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:13:25.272812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:25.272812 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:25.272812 np0000001643 nova-compute[98269]:   <alias name="ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34"/>
May 28 14:13:25.272812 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:13:25.272812 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:13:25.272812 np0000001643 nova-compute[98269]:   <serial>a5ab1a7e-e37b-480f-9a6e-4b84dd713f34</serial>
May 28 14:13:25.272812 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:13:25.272812 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:25.272812 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:25.278998 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdb from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the persistent domain config.
May 28 14:13:25.279561 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] (1/8): Attempting to detach device vdb with device alias ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:13:25.279561 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:25.279561 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:25.279561 np0000001643 nova-compute[98269]:   <alias name="ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34"/>
May 28 14:13:25.279561 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:13:25.279561 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:13:25.279561 np0000001643 nova-compute[98269]:   <serial>a5ab1a7e-e37b-480f-9a6e-4b84dd713f34</serial>
May 28 14:13:25.279561 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:13:25.279561 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:25.279561 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:25.299684 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] End _get_guest_xml xml=<domain type="qemu">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <uuid>bfac770e-7430-4353-9f3c-ec438536a7c3</uuid>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <name>instance-00000030</name>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesBackupsTest-instance-410171301</nova:name>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:13:24</nova:creationTime>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:user uuid="53d64d4218444093a2b86cfdda17f742">tempest-VolumesBackupsTest-654288917-project-member</nova:user>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:project uuid="161531d31b404ab1bc2c6c340124f03d">tempest-VolumesBackupsTest-654288917</nova:project>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         <nova:port uuid="80005835-4de3-4f71-b91a-589b63d1631c">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <system>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <entry name="serial">bfac770e-7430-4353-9f3c-ec438536a7c3</entry>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <entry name="uuid">bfac770e-7430-4353-9f3c-ec438536a7c3</entry>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </system>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <os>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   </os>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <features>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   </features>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   <devices>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk.config"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:f7:2f:79"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <target dev="tap80005835-4d"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </interface>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/console.log" append="off"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </serial>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <video>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </video>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </rng>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:   </devices>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]: </domain>
May 28 14:13:25.299684 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:13:25.301591 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Preparing to wait for external event network-vif-plugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:13:25.301591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:25.301591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:25.301591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:25.301591 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-410171301',display_name='tempest-VolumesBackupsTest-instance-410171301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesbackupstest-instance-410171301',id=48,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIkRZ9wEh/K7YInYJ6wY5fmRocdvxYBMVzxG+Tvns53o3WeqTn9Ai5CIi37NEf15FG201ctEogkJWgI5GvXlDEVjXKy3o5GmDze4zZfELXHtUxwpLd0Kdvs8c87SEx0Lg==',key_name='tempest-keypair-171131720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='161531d31b404ab1bc2c6c340124f03d',ramdisk_id='',reservation_id='r-p5jd6kae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-654288917',owner_user_name='tempest-VolumesBackupsTest-654288917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d64d4218444093a2b86cfdda17f742',uuid=bfac770e-7430-4353-9f3c-ec438536a7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:13:25.301591 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converting VIF {"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:25.302147 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=80005835-4de3-4f71-b91a-589b63d1631c,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80005835-4d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:25.302422 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=80005835-4de3-4f71-b91a-589b63d1631c,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80005835-4d') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:13:25.305741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:25.305994 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:25.306190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:13:25.306998 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:25.307139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5228d7c-cfce-578b-9015-a739ee68375b', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:25.307859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:25.308575 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:25.314254 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:25.320952 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:25.321168 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80005835-4d, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:25.321577 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80005835-4d, col_values=(('qos', UUID('a929106e-a5dd-43dd-afd1-06a6a24cd043')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:25.321828 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80005835-4d, col_values=(('external_ids', {'iface-id': '80005835-4de3-4f71-b91a-589b63d1631c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:2f:79', 'vm-uuid': 'bfac770e-7430-4353-9f3c-ec438536a7c3'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:25.322710 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:25.323919 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:25.333968 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:25.335012 np0000001643 nova-compute[98269]: INFO os_vif [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=80005835-4de3-4f71-b91a-589b63d1631c,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80005835-4d')
May 28 14:13:25.631261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba5c5d2a-d56c-4145-b5cc-94883f2d78ee tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "04c99001-1372-4b2d-bdc6-0500dfc7d283" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.301s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:25.726910 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'ec2_ids' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:25.742177 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977605.741839, 811bba84-3c9c-4ff7-b115-919041083aa2 => ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:13:25.744089 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 for instance 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:13:25.746366 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdb from instance 811bba84-3c9c-4ff7-b115-919041083aa2 from the live domain config.
May 28 14:13:25.747364 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:13:25.747706 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:25.747850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:25.748201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:25.748501 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:13:25.748637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:13:25.774013 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:25.774013 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:25.774013 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:25.774013 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:25.774013 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:25.774013 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:25.774013 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34 (non-flash)
May 28 14:13:25.774285 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:13:25.774285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '92')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:25.775216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34', '91')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:25.776024 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781bfba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34'): ({'sdd'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:13:25.776241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Removing multipathed devices sdd, sde {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:13:25.776653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flush multipath device 33000000070884b35 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:13:25.808036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:25.853380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:25.895581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:13:25.895720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:13:25.896672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:13:25.909006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:13:25.909257 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:13:25.924571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:25.962471 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.40.100,3260]
May 28 14:13:25.962471 np0000001643 nova-compute[98269]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.40.100,3260] successful.
May 28 14:13:25.962471 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:25.981239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:25.993535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:26.034188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.50.100,3260]
May 28 14:13:26.034188 np0000001643 nova-compute[98269]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-a5ab1a7e-e37b-480f-9a6e-4b84dd713f34, portal: 192.168.50.100,3260] successful.
May 28 14:13:26.034188 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:26.051627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:26.051824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:26.051938 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== disconnect_volume: return (304ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:26.052043 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:13:26.231818 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Object Instance<9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:26.231941 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'keypairs' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:26.332812 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:26.333364 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:13:26.617747 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:26.736250 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Object Instance<9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:13:26.739201 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:26.835946 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:13:26.836321 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:13:26.850785 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:26.850976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:26.851147 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No VIF found with MAC fa:16:3e:f7:2f:79, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:13:26.852180 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Using config drive
May 28 14:13:26.862596 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Creating config drive at /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config
May 28 14:13:26.867569 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3004ef3m {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:26.921872 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3004ef3m" returned: 0 in 0.054s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:27.339438 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:27.368994 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:27.389466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:27.477677 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:27.578528 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Creating config drive at /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk.config
May 28 14:13:27.587729 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqnujtgvb {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:27.623917 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a86a1270-baa4-49c4-9221-5ff72444d6e6 req-1a348f6b-7377-424c-a3d0-c388055b717b service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:27.624941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a86a1270-baa4-49c4-9221-5ff72444d6e6 req-1a348f6b-7377-424c-a3d0-c388055b717b service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:27.624941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a86a1270-baa4-49c4-9221-5ff72444d6e6 req-1a348f6b-7377-424c-a3d0-c388055b717b service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:27.624941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a86a1270-baa4-49c4-9221-5ff72444d6e6 req-1a348f6b-7377-424c-a3d0-c388055b717b service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:27.625140 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a86a1270-baa4-49c4-9221-5ff72444d6e6 req-1a348f6b-7377-424c-a3d0-c388055b717b service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Processing event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:13:27.628412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1b711cd3-817c-4934-9685-ee104579417c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.916s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:27.663933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqnujtgvb" returned: 0 in 0.076s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:27.712279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:27.718248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:27.746847 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:27.754640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:28.129928 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:28.161197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:28.269143 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:28.280815 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:13:28.282434 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977608.2820945, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:28.282608 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Started (Lifecycle Event)
May 28 14:13:28.290198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:13:28.304221 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance spawned successfully.
May 28 14:13:28.304751 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:28.590265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:28.619315 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:28.785464 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:28.787723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:28.820801 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-55afa137-4648-4d54-86e6-70eb81f17abd tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.132s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:29.290504 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977609.2901573, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:29.290634 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Paused (Lifecycle Event)
May 28 14:13:29.330651 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:29.330958 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:13:29.687410 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:29.691053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:29.691244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:29.691532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:29.691626 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:29.693955 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] No waiting events found dispatching network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:29.694358 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received unexpected event network-vif-plugged-ab278e65-373b-410c-a01b-71df629acfca for instance with vm_state active and task_state None.
May 28 14:13:29.694504 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-vif-plugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:29.694659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:29.694836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:29.694948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:29.695052 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Processing event network-vif-plugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:13:29.695199 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-vif-plugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:29.695349 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:29.696964 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:29.697141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:29.697293 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] No waiting events found dispatching network-vif-plugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:29.697518 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-64c39346-55f7-4e7b-b8ff-5aa7c8f378ed req-45f8abab-d71d-4182-8920-8645fcfa2c18 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received unexpected event network-vif-plugged-80005835-4de3-4f71-b91a-589b63d1631c for instance with vm_state building and task_state spawning.
May 28 14:13:29.697902 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:13:29.702731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:13:29.705726 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Instance spawned successfully.
May 28 14:13:29.705726 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:13:29.794193 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:29.795362 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977609.7948961, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:29.795362 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Resumed (Lifecycle Event)
May 28 14:13:29.828006 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:29.828423 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:29.828976 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:29.829132 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:13:30.211462 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:30.211619 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:30.211986 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:30.212266 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:30.212644 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:30.212932 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:30.297605 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:30.299737 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:30.323206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:30.331778 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:13:30.718141 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Took 7.89 seconds to spawn the instance on the hypervisor.
May 28 14:13:30.718625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:30.801959 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977610.8016357, bfac770e-7430-4353-9f3c-ec438536a7c3 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:30.802106 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] VM Started (Lifecycle Event)
May 28 14:13:31.231470 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Took 13.33 seconds to build instance.
May 28 14:13:31.304461 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:31.306057 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:31.329913 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:31.330441 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:31.330441 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:13:31.330781 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:13:31.546785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:31.546785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:31.546785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:31.546785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:31.546785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:31.547851 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Terminating instance
May 28 14:13:31.705229 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-changed-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:31.705989 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Refreshing instance network info cache due to event network-changed-80005835-4de3-4f71-b91a-589b63d1631c. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:31.706422 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] Acquiring lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:31.708184 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] Acquired lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:31.708184 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Refreshing network info cache for port 80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:31.731346 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7391440c-78b3-4665-8e44-5b1e73ed1a86 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.842s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:31.809276 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977611.8087757, bfac770e-7430-4353-9f3c-ec438536a7c3 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:31.809276 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] VM Paused (Lifecycle Event)
May 28 14:13:31.826877 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:32.051026 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:13:32.073623 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.077735 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.098059 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.100951 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.124116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.130561 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.212495 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:32.303319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79d669b4-30df-4dc0-813c-c7a0f94381f7 req-712990a3-8d0d-4662-8de8-a04106c836b5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-vif-unplugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:32.303600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79d669b4-30df-4dc0-813c-c7a0f94381f7 req-712990a3-8d0d-4662-8de8-a04106c836b5 service nova] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:32.303846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79d669b4-30df-4dc0-813c-c7a0f94381f7 req-712990a3-8d0d-4662-8de8-a04106c836b5 service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:32.304645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79d669b4-30df-4dc0-813c-c7a0f94381f7 req-712990a3-8d0d-4662-8de8-a04106c836b5 service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:32.304775 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79d669b4-30df-4dc0-813c-c7a0f94381f7 req-712990a3-8d0d-4662-8de8-a04106c836b5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] No waiting events found dispatching network-vif-unplugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:32.304909 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79d669b4-30df-4dc0-813c-c7a0f94381f7 req-712990a3-8d0d-4662-8de8-a04106c836b5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-vif-unplugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:32.314131 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:32.317020 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977612.3166802, bfac770e-7430-4353-9f3c-ec438536a7c3 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:32.317228 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] VM Resumed (Lifecycle Event)
May 28 14:13:32.332157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:32.332157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:32.332491 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:32.335991 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:13:32.409965 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Instance destroyed successfully.
May 28 14:13:32.411364 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'resources' on Instance uuid 811bba84-3c9c-4ff7-b115-919041083aa2 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:32.609230 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:32.646620 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:32.646866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:32.647128 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:32.647351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:32.647563 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:32.649840 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Terminating instance
May 28 14:13:32.742628 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Updated VIF entry in instance network info cache for port 80005835-4de3-4f71-b91a-589b63d1631c. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:13:32.742980 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Updating instance_info_cache with network_info: [{"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:32.823445 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:32.825278 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:32.914908 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1030993449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-1030993449',id=42,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV38pm1HbkUROW/tCJmf52xS6BdlTXdGhB7E70gTHtjkTPX7hag/5B9RTUqMwmX3Cqz3dEUOdWuIg74tj0p2z6baF7RtvsMHaZe0ZRHkLWYt3ZzcEeJB0m/zxo2iAwBQQ==',key_name='tempest-keypair-1772616094',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:10:10Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-iq09fsc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=811bba84-3c9c-4ff7-b115-919041083aa2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:13:32.915105 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "address": "fa:16:3e:29:77:5f", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d30b655-1e", "ovs_interfaceid": "2d30b655-1e54-4e0b-aa01-e53b665fa3b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:32.915697 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:77:5f,bridge_name='br-int',has_traffic_filtering=True,id=2d30b655-1e54-4e0b-aa01-e53b665fa3b7,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d30b655-1e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:32.915916 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:77:5f,bridge_name='br-int',has_traffic_filtering=True,id=2d30b655-1e54-4e0b-aa01-e53b665fa3b7,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d30b655-1e') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:13:32.917133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.917374 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d30b655-1e, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:32.924809 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.925519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:32.926035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.926843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.927021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b70fa13e-9677-4eb5-b116-b5fa8fe39945) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:32.927503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.928026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:32.928260 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:32.930019 np0000001643 nova-compute[98269]: INFO os_vif [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:77:5f,bridge_name='br-int',has_traffic_filtering=True,id=2d30b655-1e54-4e0b-aa01-e53b665fa3b7,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d30b655-1e')
May 28 14:13:32.930279 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Deleting instance files /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2_del
May 28 14:13:32.930924 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Deletion of /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2_del complete
May 28 14:13:33.041925 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.045602 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.153147 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:13:33.169910 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.172145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.189167 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.194140 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.213636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.218967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.244845 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-be01d224-bdb3-450c-a416-d792d6efb464 req-b1c133df-84eb-4a05-b382-20380464e15d service nova] Releasing lock "refresh_cache-bfac770e-7430-4353-9f3c-ec438536a7c3" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:33.327469 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999733325999841 future=<Future at 0x71a7801a8da0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:33.440481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.441900 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002a, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/811bba84-3c9c-4ff7-b115-919041083aa2/disk
May 28 14:13:33.443553 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 14:13:33.445572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:33.446024 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:13:33.446202 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:13:33.446306 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:13:33.446503 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:33.461673 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:33.478411 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999071577999985 future=<Future at 0x71a77810a1b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:33.485589 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Instance destroyed successfully.
May 28 14:13:33.486673 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lazy-loading 'resources' on Instance uuid fa8cce02-430b-44b3-a415-e4c38250e4ba {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:33.550739 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:33.560811 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:33.561317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:33.662787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:33.668539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:33.772584 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-vif-unplugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:33.773239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:33.773460 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:33.773600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:33.773788 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] No waiting events found dispatching network-vif-unplugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:33.773943 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-vif-unplugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:33.774057 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-vif-unplugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:33.774152 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] Acquiring lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:33.774281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:33.774401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:33.774523 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] No waiting events found dispatching network-vif-unplugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:33.774631 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-904276dd-0cd7-4ae8-8871-94393b9aee4a req-e0d054b8-97e1-4f12-b510-52eb21c8aef3 service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-vif-unplugged-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:33.776333 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:33.779517 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:33.868740 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:33.874485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:33.962824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:33.967492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:33.993786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1298844520',display_name='tempest-ServersNegativeTestJSON-server-1298844520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-serversnegativetestjson-server-1298844520',id=46,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:13:02Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8c03afb9244e8bb825b9faf46b3f7d',ramdisk_id='',reservation_id='r-3w41oo5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1291103668',owner_user_name='tempest-ServersNegativeTestJSON-1291103668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:02Z,user_data=None,user_id='e546f84a1ffb4deebf8addf08ad348e5',uuid=fa8cce02-430b-44b3-a415-e4c38250e4ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:13:33.994063 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converting VIF {"id": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "address": "fa:16:3e:26:4d:3a", "network": {"id": "44d32df1-e63f-4cf7-8ace-336d582799ff", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1757965702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df8c03afb9244e8bb825b9faf46b3f7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df2c9a1-7f", "ovs_interfaceid": "6df2c9a1-7f50-4db2-952e-189c1a3d16f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:33.995400 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:4d:3a,bridge_name='br-int',has_traffic_filtering=True,id=6df2c9a1-7f50-4db2-952e-189c1a3d16f9,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df2c9a1-7f') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:33.995860 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4d:3a,bridge_name='br-int',has_traffic_filtering=True,id=6df2c9a1-7f50-4db2-952e-189c1a3d16f9,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df2c9a1-7f') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:13:34.000560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:34.001042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6df2c9a1-7f, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:34.015694 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:34.015694 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:34.016247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:34.016478 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f55a6f0-1086-4c60-a39a-90228695b6e4) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:34.018572 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:34.018572 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:34.019276 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:34.023051 np0000001643 nova-compute[98269]: INFO os_vif [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4d:3a,bridge_name='br-int',has_traffic_filtering=True,id=6df2c9a1-7f50-4db2-952e-189c1a3d16f9,network=Network(44d32df1-e63f-4cf7-8ace-336d582799ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df2c9a1-7f')
May 28 14:13:34.023368 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Deleting instance files /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba_del
May 28 14:13:34.024243 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Deletion of /opt/stack/data/nova/instances/fa8cce02-430b-44b3-a415-e4c38250e4ba_del complete
May 28 14:13:34.049956 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:34.055689 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-3 (vdc) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:13:34.061342 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:13:34.064868 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:13:34.065802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:34.120790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:34.121330 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12868MB free_disk=72.9980239868164GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:13:34.121588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:34.121881 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:34.357939 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:34.403210 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b9fe021-0ca9-42ed-905f-5617dd5d48eb req-f35771c7-37c9-4e7e-bb0a-daee079850b5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-vif-unplugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:34.403487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b9fe021-0ca9-42ed-905f-5617dd5d48eb req-f35771c7-37c9-4e7e-bb0a-daee079850b5 service nova] Acquiring lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:34.403695 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b9fe021-0ca9-42ed-905f-5617dd5d48eb req-f35771c7-37c9-4e7e-bb0a-daee079850b5 service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:34.403834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b9fe021-0ca9-42ed-905f-5617dd5d48eb req-f35771c7-37c9-4e7e-bb0a-daee079850b5 service nova] Lock "811bba84-3c9c-4ff7-b115-919041083aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:34.403972 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b9fe021-0ca9-42ed-905f-5617dd5d48eb req-f35771c7-37c9-4e7e-bb0a-daee079850b5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] No waiting events found dispatching network-vif-unplugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:34.404089 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b9fe021-0ca9-42ed-905f-5617dd5d48eb req-f35771c7-37c9-4e7e-bb0a-daee079850b5 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-vif-unplugged-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:34.533914 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 14:13:34.534762 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:13:34.535089 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:13:34.535232 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:13:34.535694 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:34.639426 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:34.689108 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:34.861529 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Took 1.41 seconds to deallocate network for instance.
May 28 14:13:35.182046 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 811bba84-3c9c-4ff7-b115-919041083aa2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:13:35.182130 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance fa8cce02-430b-44b3-a415-e4c38250e4ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:13:35.182229 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:13:35.182326 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:13:35.182403 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance bfac770e-7430-4353-9f3c-ec438536a7c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:13:35.182582 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:13:35.182701 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:13:34 up 40 min,  2 users,  load average: 5.83, 5.95, 4.45\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_161531d31b404ab1bc2c6c340124f03d': '1', 'io_workload': '0', 'num_task_deleting': '2', 'num_proj_1bd0a26536e743c9a9eaeb956fc55b79': '1', 'num_proj_db1dc6979a244982823fef41c57d1c75': '1', 'num_proj_52a6b1dd5a2f47bdbea499915e31b2f3': '1', 'num_proj_df8c03afb9244e8bb825b9faf46b3f7d': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:13:35.201549 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004935679999107379 future=<Future at 0x71a75c18e900 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:35.202116 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Emitting event <LifecycleEvent: 1779977600.2008975, 04c99001-1372-4b2d-bdc6-0500dfc7d283 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:35.202305 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:35.202535 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] VM Stopped (Lifecycle Event)
May 28 14:13:35.203627 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=13.123515424999823 future=<Future at 0x71a7801a8da0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:35.203756 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=13.123365146999731 future=<Future at 0x71a7801a8da0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:35.366867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:35.369401 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:35.468050 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:35.468390 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:35.705329 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9636641e-e819-4603-8459-d0cc10fbf61f tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] [instance: 04c99001-1372-4b2d-bdc6-0500dfc7d283] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:35.834433 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ce3cd28e-9cfc-4570-93de-a02ea6fb7dba req-599605e0-120e-434f-b428-8e87598e34b6 service nova] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Received event network-vif-deleted-2d30b655-1e54-4e0b-aa01-e53b665fa3b7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:35.871591 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Took 1.34 seconds to deallocate network for instance.
May 28 14:13:35.971129 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:36.149622 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:36.379168 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:36.477952 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:13:36.478983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.356s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:36.479714 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.112s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:36.480556 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:13:36.482416 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c0867579-44be-4437-bae2-8abb9cfa12a3 req-c8187eec-c5c4-47f4-8856-1fa7c9133dab service nova] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Received event network-vif-deleted-6df2c9a1-7f50-4db2-952e-189c1a3d16f9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:36.754934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:36.755169 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:37.258196 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:37.765625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.285s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:37.766821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.386s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:37.851459 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Deleted allocations for instance 811bba84-3c9c-4ff7-b115-919041083aa2
May 28 14:13:38.040327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:38.057493 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:38.057727 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:38.563219 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:38.858916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-30866dde-702e-452c-8ce6-1d6f282f1379 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "811bba84-3c9c-4ff7-b115-919041083aa2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.314s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:39.017379 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:39.072172 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.307s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:39.126360 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Deleted allocations for instance fa8cce02-430b-44b3-a415-e4c38250e4ba
May 28 14:13:39.690838 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:40.135075 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f2a644c4-ad54-4534-af94-b91863d99aac tempest-ServersNegativeTestJSON-1291103668 tempest-ServersNegativeTestJSON-1291103668-project-member] Lock "fa8cce02-430b-44b3-a415-e4c38250e4ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.488s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:40.476605 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:40.477124 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:13:40.477124 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.35 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:13:40.845708 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:42.450536 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:43.051727 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:43.930804 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:43.931199 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:44.024848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:44.437781 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:13:44.692217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:45.143901 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:45.144280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:45.148168 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:13:45.148344 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Claim successful on node np0000001643
May 28 14:13:46.196934 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:13:46.251785 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:13:46.251935 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:13:46.294379 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:13:46.347042 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:13:46.579612 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:46.579895 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:46.823094 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:46.823319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:47.082734 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:47.325096 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:13:47.588106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.444s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:47.588492 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:13:47.871191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:47.871338 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:47.873868 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:13:47.873988 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Claim successful on node np0000001643
May 28 14:13:48.093649 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:13:48.093879 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:13:48.094155 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:48.094405 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:48.159752 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '443210af2282478b862d252bfa3bb611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd0a26536e743c9a9eaeb956fc55b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:13:48.327651 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004754540000249108 future=<Future at 0x71a7801a8da0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:48.329064 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Emitting event <LifecycleEvent: 1779977613.3270526, 811bba84-3c9c-4ff7-b115-919041083aa2 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:48.329064 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:48.329064 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] VM Stopped (Lifecycle Event)
May 28 14:13:48.331087 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.14766557899974941 future=<Future at 0x71a77810a1b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:48.331087 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.1475436829996397 future=<Future at 0x71a77810a1b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:48.477768 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00036438300003283075 future=<Future at 0x71a77810a1b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:48.477868 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:48.478485 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] Emitting event <LifecycleEvent: 1779977613.4771857, fa8cce02-430b-44b3-a415-e4c38250e4ba => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:48.478687 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] VM Stopped (Lifecycle Event)
May 28 14:13:48.595563 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Successfully created port: 87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:13:48.597186 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:13:48.831004 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 811bba84-3c9c-4ff7-b115-919041083aa2] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:48.982986 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7065d7b5-f05b-4aa4-8527-8e8b1e0dd188 tempest-TestServerVolumeAttachmentScenario-1229630570 tempest-TestServerVolumeAttachmentScenario-1229630570-project-member] [instance: fa8cce02-430b-44b3-a415-e4c38250e4ba] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:49.041971 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Successfully updated port: 87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:13:49.042195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:49.071173 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-changed-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:49.071326 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Refreshing instance network info cache due to event network-changed-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:49.071502 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] Acquiring lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:49.071633 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] Acquired lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:49.071740 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Refreshing network info cache for port 87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:49.100344 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:13:49.124991 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:49.125167 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:49.531366 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:49.573650 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:49.627483 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:49.638303 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:13:49.693963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:49.782967 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:50.107406 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:13:50.108285 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:13:50.108531 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Creating image(s)
May 28 14:13:50.108937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "/opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:50.109085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "/opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:50.109545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "/opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:50.109973 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:50.112397 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:50.113430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:50.135062 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.263s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:50.135875 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:13:50.198458 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:50.198809 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:50.199197 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:50.199596 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:50.202250 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:50.202553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:50.282207 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.079s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:50.282944 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:50.295000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2b54029b-991c-419d-b969-cd7d4c7bf137 req-7ddcea08-60ad-42f3-b7bc-9be1944bdf67 service nova] Releasing lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:50.296386 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquired lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:50.296757 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:13:50.335180 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk 1073741824" returned: 0 in 0.052s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:50.336175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.136s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:50.336175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:50.418579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.082s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:50.419010 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:13:50.419359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:50.502429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:50.502809 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Cannot resize image /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:13:50.503242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:13:50.503410 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Ensure instance console log exists: /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:13:50.503738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:50.503946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:50.504080 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:50.643873 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:13:50.644314 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:13:50.644510 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:50.644671 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:50.712628 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c111ae1684f4ed3be8ba247f5f49709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816dec0e07ba4bd596fac38e7df5e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:13:50.855766 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:13:51.003830 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:51.149951 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:13:51.169869 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Updating instance_info_cache with network_info: [{"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:51.176216 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Successfully created port: d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:13:51.634670 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Successfully updated port: d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:13:51.656973 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:13:51.672663 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Releasing lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:51.672861 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Instance network_info: |[{"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:13:51.677269 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Start _get_guest_xml network_info=[{"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:13:51.685759 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:13:51.686987 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1773821913', uuid='eee1e472-9a54-4213-a0ca-aba7284297c5'), owner=OwnerMeta(userid='443210af2282478b862d252bfa3bb611', username='tempest-VolumeMultiattachTests-761556748-project-member', projectid='1bd0a26536e743c9a9eaeb956fc55b79', projectname='tempest-VolumeMultiattachTests-761556748'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977631.6866143) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:13:51.691250 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-changed-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:51.691698 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Refreshing instance network info cache due to event network-changed-d448dee9-cd94-4537-b2b1-43d834fc96b8. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:51.691997 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:13:51.692268 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] Acquiring lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:51.692532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] Acquired lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:51.692721 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Refreshing network info cache for port d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:51.693913 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:13:51.695581 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:13:51.695743 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:13:51.697200 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:13:51.697512 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:13:51.697652 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:13:51.697746 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:13:51.697847 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:13:51.697938 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:13:51.698028 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:13:51.698187 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:13:51.698283 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:13:51.698386 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:13:51.699624 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:13:51.700153 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:13:51.711424 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1773821913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-1773821913',id=49,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0RVMtZNhpjNinm8LT6S/lQmXRaqEACYUmnYO+GCnv4tWH2kgY4R1WoypSEuAr+Xg+GvA6F+rqwQrFaHL8IbEQPIRnR9FvYDna/7R6AO97r7GBKKEEDeEISLwkiAhrq4w==',key_name='tempest-keypair-256979471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-8g4mdbtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=eee1e472-9a54-4213-a0ca-aba7284297c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:13:51.711876 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:51.712572 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcb95-0e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:51.713118 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'pci_devices' on Instance uuid eee1e472-9a54-4213-a0ca-aba7284297c5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:51.738892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:51.739044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:52.137735 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:52.195572 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:52.215763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] End _get_guest_xml xml=<domain type="qemu">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <uuid>eee1e472-9a54-4213-a0ca-aba7284297c5</uuid>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <name>instance-00000031</name>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumeMultiattachTests-server-1773821913</nova:name>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:13:51</nova:creationTime>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:user uuid="443210af2282478b862d252bfa3bb611">tempest-VolumeMultiattachTests-761556748-project-member</nova:user>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:project uuid="1bd0a26536e743c9a9eaeb956fc55b79">tempest-VolumeMultiattachTests-761556748</nova:project>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         <nova:port uuid="87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <system>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <entry name="serial">eee1e472-9a54-4213-a0ca-aba7284297c5</entry>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <entry name="uuid">eee1e472-9a54-4213-a0ca-aba7284297c5</entry>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </system>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <os>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   </os>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <features>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   </features>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   <devices>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk.config"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:74:4b:01"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <target dev="tap87fdcb95-0e"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </interface>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/console.log" append="off"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </serial>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <video>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </video>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </rng>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:   </devices>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]: </domain>
May 28 14:13:52.215763 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Preparing to wait for external event network-vif-plugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1773821913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-1773821913',id=49,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0RVMtZNhpjNinm8LT6S/lQmXRaqEACYUmnYO+GCnv4tWH2kgY4R1WoypSEuAr+Xg+GvA6F+rqwQrFaHL8IbEQPIRnR9FvYDna/7R6AO97r7GBKKEEDeEISLwkiAhrq4w==',key_name='tempest-keypair-256979471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-8g4mdbtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=eee1e472-9a54-4213-a0ca-aba7284297c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcb95-0e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcb95-0e') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:52.218658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:52.219201 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:13:52.219595 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:52.219679 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce6991ec-069e-59a3-b189-7d75b2f110a9', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:52.220631 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:52.221032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:52.222900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:52.225474 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:52.225474 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87fdcb95-0e, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:52.225474 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87fdcb95-0e, col_values=(('qos', UUID('6ffc1171-a00d-40a7-868c-655a92947b71')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:52.225642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87fdcb95-0e, col_values=(('external_ids', {'iface-id': '87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:4b:01', 'vm-uuid': 'eee1e472-9a54-4213-a0ca-aba7284297c5'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:52.227268 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:52.227618 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:52.235244 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:52.236292 np0000001643 nova-compute[98269]: INFO os_vif [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcb95-0e')
May 28 14:13:52.241499 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Detaching volume 97b876e0-f937-46cc-ade6-ae66c75e7f2a
May 28 14:13:52.267957 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:13:52.290943 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Attempting to driver detach volume 97b876e0-f937-46cc-ade6-ae66c75e7f2a from mountpoint /dev/vdc
May 28 14:13:52.300698 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Found disk vdc by alias ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:52.301716 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Found disk vdc by alias ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:13:52.302044 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Attempting to detach device vdc from instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:13:52.302340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:52.302340 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:52.302340 np0000001643 nova-compute[98269]:   <alias name="ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a"/>
May 28 14:13:52.302340 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:13:52.302340 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:13:52.302340 np0000001643 nova-compute[98269]:   <serial>97b876e0-f937-46cc-ade6-ae66c75e7f2a</serial>
May 28 14:13:52.302340 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:13:52.302340 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:52.302340 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:52.307201 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully detached device vdc from instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a from the persistent domain config.
May 28 14:13:52.307381 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] (1/8): Attempting to detach device vdc with device alias ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a from instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:13:52.307681 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:13:52.307681 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:13:52.307681 np0000001643 nova-compute[98269]:   <alias name="ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a"/>
May 28 14:13:52.307681 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:13:52.307681 np0000001643 nova-compute[98269]:   <target dev="vdc" bus="virtio"/>
May 28 14:13:52.307681 np0000001643 nova-compute[98269]:   <serial>97b876e0-f937-46cc-ade6-ae66c75e7f2a</serial>
May 28 14:13:52.307681 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:13:52.307681 np0000001643 nova-compute[98269]: </disk>
May 28 14:13:52.307681 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:13:52.411885 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:52.666535 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:13:52.667303 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:13:52.667532 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Creating image(s)
May 28 14:13:52.667886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "/opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:52.668028 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "/opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:52.668459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "/opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:52.668921 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:52.671265 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:52.672110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:52.767510 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:52.767948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:52.768742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:52.769261 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:52.773169 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:13:52.773602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:52.835811 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977632.8350043, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:13:52.840118 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-97b876e0-f937-46cc-ade6-ae66c75e7f2a for instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:13:52.843409 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully detached device vdc from instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a from the live domain config.
May 28 14:13:52.845570 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:13:52.846110 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:13:52.846285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:13:52.846829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:13:52.847225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97b876e0-f937-46cc-ade6-ae66c75e7f2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:13:52.847429 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:13:52.864171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:52.864601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:52.879123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:52.879123 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:52.879123 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:52.879123 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:52.879123 np0000001643 nova-compute[98269]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:13:52.879123 np0000001643 nova-compute[98269]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:13:52.879123 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:13:52.879387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsi session list stdout=tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:52.879387 np0000001643 nova-compute[98269]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a (non-flash)
May 28 14:13:52.879387 np0000001643 nova-compute[98269]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:52.879387 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:13:52.879387 np0000001643 nova-compute[98269]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:13:52.879387 np0000001643 nova-compute[98269]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:13:52.879387 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:13:52.879731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '124')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:13:52.879899 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '118')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:52.881027 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a', '117')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:13:52.881893 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c15a480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:13:52.882216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Removing multipathed devices sdj, sdi {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:13:52.882651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flush multipath device 3300000000cc0b4b4 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:13:52.914304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e048c226-ee03-4f28-a522-755b6ccd3278 req-bf97afc7-ea3d-46f9-91de-d711f8146026 service nova] Releasing lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:52.914846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquired lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:52.915043 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:13:52.917550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:52.926656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk 1073741824" returned: 0 in 0.061s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:52.927469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:52.927808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:52.975718 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:13:53.020743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:13:53.020917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:13:53.022047 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:13:53.038099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:13:53.038342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:13:53.040607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:53.041043 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:13:53.041341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:53.057826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:53.097105 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.40.100,3260]
May 28 14:13:53.097105 np0000001643 nova-compute[98269]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.40.100,3260] successful.
May 28 14:13:53.097105 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:53.112350 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:53.123681 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:53.134742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:53.134742 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Cannot resize image /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:13:53.134742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:13:53.134742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Ensure instance console log exists: /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:13:53.134742 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:53.134939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:53.135077 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:53.155537 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.50.100,3260]
May 28 14:13:53.155537 np0000001643 nova-compute[98269]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-97b876e0-f937-46cc-ade6-ae66c75e7f2a, portal: 192.168.50.100,3260] successful.
May 28 14:13:53.155537 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:53.171929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:13:53.171929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:13:53.171929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] <== disconnect_volume: return (323ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:13:53.171929 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:13:53.483641 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:13:53.643371 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:53.731973 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'flavor' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:53.763484 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:53.763484 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:53.763484 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:74:4b:01, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:13:53.763484 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Using config drive
May 28 14:13:53.794344 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating instance_info_cache with network_info: [{"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:54.269484 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:54.298156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Releasing lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:13:54.298438 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Instance network_info: |[{"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:13:54.301172 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Start _get_guest_xml network_info=[{"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:13:54.304740 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:13:54.305961 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-546163848', uuid='a95922fd-8d79-43bc-9052-e05f100abb79'), owner=OwnerMeta(userid='0c111ae1684f4ed3be8ba247f5f49709', username='tempest-SnapshotDataIntegrityTests-859017370-project-member', projectid='816dec0e07ba4bd596fac38e7df5e9db', projectname='tempest-SnapshotDataIntegrityTests-859017370'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977634.305589) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:13:54.309242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:13:54.309622 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:13:54.313462 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:13:54.314021 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:13:54.315146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:13:54.315561 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:13:54.315703 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:13:54.315808 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:13:54.315988 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:13:54.316101 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:13:54.316217 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:13:54.316347 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:13:54.320106 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:13:54.320429 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:13:54.320733 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:13:54.322521 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:13:54.347188 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-546163848',display_name='tempest-SnapshotDataIntegrityTests-server-546163848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-snapshotdataintegritytests-server-546163848',id=50,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlp5DEO60MqI+PZ0bgx/1bXcTuGdizucYeHB0il15ubrDHVZ1QACJT+JvV9e2fRInRzn8Tcr6EIbB3IY7LlHbo0KpTK+Qhz9BQ8mDs44gQU1Bav9TIya0CIoDBZtg+VdA==',key_name='tempest-keypair-1540680371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='816dec0e07ba4bd596fac38e7df5e9db',ramdisk_id='',reservation_id='r-had04d1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-859017370',owner_user_name='tempest-SnapshotDataIntegrityTests-859017370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c111ae1684f4ed3be8ba247f5f49709',uuid=a95922fd-8d79-43bc-9052-e05f100abb79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:13:54.347348 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Converting VIF {"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:54.349133 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:ea:68,bridge_name='br-int',has_traffic_filtering=True,id=d448dee9-cd94-4537-b2b1-43d834fc96b8,network=Network(abb6b297-c8c2-45d2-b3b9-215cc6239d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd448dee9-cd') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:54.350462 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'pci_devices' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:54.426349 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Creating config drive at /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk.config
May 28 14:13:54.429232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_5swvazi {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:54.503124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_5swvazi" returned: 0 in 0.074s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:54.695953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.739365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-df52ee89-c987-45eb-98e3-46e5248e7da9 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:54.861071 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] End _get_guest_xml xml=<domain type="qemu">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <uuid>a95922fd-8d79-43bc-9052-e05f100abb79</uuid>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <name>instance-00000032</name>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-546163848</nova:name>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:13:54</nova:creationTime>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:user uuid="0c111ae1684f4ed3be8ba247f5f49709">tempest-SnapshotDataIntegrityTests-859017370-project-member</nova:user>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:project uuid="816dec0e07ba4bd596fac38e7df5e9db">tempest-SnapshotDataIntegrityTests-859017370</nova:project>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         <nova:port uuid="d448dee9-cd94-4537-b2b1-43d834fc96b8">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <system>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <entry name="serial">a95922fd-8d79-43bc-9052-e05f100abb79</entry>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <entry name="uuid">a95922fd-8d79-43bc-9052-e05f100abb79</entry>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </system>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <os>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   </os>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <features>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   </features>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   <devices>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk.config"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </disk>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:12:ea:68"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <target dev="tapd448dee9-cd"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </interface>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/console.log" append="off"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </serial>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <video>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </video>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </rng>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:   </devices>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]: </domain>
May 28 14:13:54.861071 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Preparing to wait for external event network-vif-plugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-546163848',display_name='tempest-SnapshotDataIntegrityTests-server-546163848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-snapshotdataintegritytests-server-546163848',id=50,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlp5DEO60MqI+PZ0bgx/1bXcTuGdizucYeHB0il15ubrDHVZ1QACJT+JvV9e2fRInRzn8Tcr6EIbB3IY7LlHbo0KpTK+Qhz9BQ8mDs44gQU1Bav9TIya0CIoDBZtg+VdA==',key_name='tempest-keypair-1540680371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='816dec0e07ba4bd596fac38e7df5e9db',ramdisk_id='',reservation_id='r-had04d1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-859017370',owner_user_name='tempest-SnapshotDataIntegrityTests-859017370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c111ae1684f4ed3be8ba247f5f49709',uuid=a95922fd-8d79-43bc-9052-e05f100abb79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Converting VIF {"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:ea:68,bridge_name='br-int',has_traffic_filtering=True,id=d448dee9-cd94-4537-b2b1-43d834fc96b8,network=Network(abb6b297-c8c2-45d2-b3b9-215cc6239d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd448dee9-cd') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ea:68,bridge_name='br-int',has_traffic_filtering=True,id=d448dee9-cd94-4537-b2b1-43d834fc96b8,network=Network(abb6b297-c8c2-45d2-b3b9-215cc6239d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd448dee9-cd') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.864298 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:54.864884 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:13:54.869248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.869707 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0d68a26-de93-5e9a-9f0c-dccfc1478860', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:54.870398 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.871873 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:54.878030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.880170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.880312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd448dee9-cd, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:54.880731 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd448dee9-cd, col_values=(('qos', UUID('75b8dc43-476e-4221-9e1e-471d36d526c4')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:54.881208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd448dee9-cd, col_values=(('external_ids', {'iface-id': 'd448dee9-cd94-4537-b2b1-43d834fc96b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:ea:68', 'vm-uuid': 'a95922fd-8d79-43bc-9052-e05f100abb79'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:54.882151 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.884504 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:54.895616 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.896786 np0000001643 nova-compute[98269]: INFO os_vif [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ea:68,bridge_name='br-int',has_traffic_filtering=True,id=d448dee9-cd94-4537-b2b1-43d834fc96b8,network=Network(abb6b297-c8c2-45d2-b3b9-215cc6239d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd448dee9-cd')
May 28 14:13:54.945388 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.974344 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:54.976715 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.003955 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:55.004195 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:55.004425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:55.004628 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:55.004781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:55.007796 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Terminating instance
May 28 14:13:55.053030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.138665 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0eb36122-0fca-44fc-9896-c4c4da4bb11f req-caf06dde-a7f6-4292-9328-644c88a9cf3b service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-vif-plugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:55.139051 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0eb36122-0fca-44fc-9896-c4c4da4bb11f req-caf06dde-a7f6-4292-9328-644c88a9cf3b service nova] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:55.139195 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0eb36122-0fca-44fc-9896-c4c4da4bb11f req-caf06dde-a7f6-4292-9328-644c88a9cf3b service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:55.140235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0eb36122-0fca-44fc-9896-c4c4da4bb11f req-caf06dde-a7f6-4292-9328-644c88a9cf3b service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:55.140235 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0eb36122-0fca-44fc-9896-c4c4da4bb11f req-caf06dde-a7f6-4292-9328-644c88a9cf3b service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Processing event network-vif-plugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:13:55.290840 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.298042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.302898 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.324985 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.332052 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.512421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:13:55.539773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.565725 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.568808 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.601196 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:55.695002 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977635.6946614, eee1e472-9a54-4213-a0ca-aba7284297c5 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:55.695402 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:13:55.695541 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] VM Started (Lifecycle Event)
May 28 14:13:55.699771 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:13:55.700335 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Instance spawned successfully.
May 28 14:13:55.700698 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:13:55.847782 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Instance destroyed successfully.
May 28 14:13:55.849231 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'resources' on Instance uuid 3a1fb5dd-4075-4ede-aa93-8ceee595990a {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:13:56.043972 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:56.044118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:56.197434 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:56.199381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:56.209903 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:56.210234 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:56.210397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:56.210622 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:56.210883 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:56.211118 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:56.353466 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-497369381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-497369381',id=43,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvW3mf2gcKHoDlonmj6X0h+rTiXWtySrcvIHOKBUyKPa21J2I+lToKgGAdfK0jVBMVoRFz8vmYwGZ4KVhrbr4QS7uPhQFIO9eMGkG2wFoouXKA59loNSF45jqwIl2GYcg==',key_name='tempest-keypair-1677477403',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:13:13Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-28q854w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=3a1fb5dd-4075-4ede-aa93-8ceee595990a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:13:56.353466 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "address": "fa:16:3e:05:43:7f", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e74ab1b-23", "ovs_interfaceid": "4e74ab1b-2352-4cb6-bb11-265aad5c70e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:13:56.353466 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:13:56.353466 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:13:56.354136 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:56.354332 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e74ab1b-23, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:56.355291 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:56.356841 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:56.360984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:56.361690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:56.361821 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d053e0b-4844-4253-bcdc-21e86f656f7f) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:13:56.362283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:56.362716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:13:56.367654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:56.372248 np0000001643 nova-compute[98269]: INFO os_vif [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:43:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e74ab1b-23')
May 28 14:13:56.372248 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Deleting instance files /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a_del
May 28 14:13:56.377141 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Deletion of /opt/stack/data/nova/instances/3a1fb5dd-4075-4ede-aa93-8ceee595990a_del complete
May 28 14:13:56.416040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:56.416216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:13:56.416366 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No VIF found with MAC fa:16:3e:12:ea:68, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:13:56.416875 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Using config drive
May 28 14:13:56.547513 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:13:56.701249 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:13:56.701553 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977636.7013333, eee1e472-9a54-4213-a0ca-aba7284297c5 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:56.701689 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] VM Paused (Lifecycle Event)
May 28 14:13:56.716896 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Took 6.61 seconds to spawn the instance on the hypervisor.
May 28 14:13:56.717046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:56.882988 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 14:13:56.883699 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:13:56.883846 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:13:56.883958 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:13:56.884225 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:56.922086 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:56.943495 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:57.053001 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Creating config drive at /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk.config
May 28 14:13:57.062304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeq62vjnc {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:13:57.128141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:57.128375 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:57.134858 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:13:57.134993 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Claim successful on node np0000001643
May 28 14:13:57.139568 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeq62vjnc" returned: 0 in 0.077s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:13:57.204422 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:57.208493 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977637.2081635, eee1e472-9a54-4213-a0ca-aba7284297c5 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:57.208701 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] VM Resumed (Lifecycle Event)
May 28 14:13:57.226294 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Took 12.28 seconds to build instance.
May 28 14:13:57.232982 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-vif-plugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:57.234846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:57.235082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:57.235326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:57.235432 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] No waiting events found dispatching network-vif-plugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:57.235858 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received unexpected event network-vif-plugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 for instance with vm_state active and task_state None.
May 28 14:13:57.237724 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:57.238171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:57.238430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:57.238629 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:57.238810 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] No waiting events found dispatching network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:57.238982 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:57.239159 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:57.239364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Acquiring lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:57.239574 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:57.239741 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:57.239900 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] No waiting events found dispatching network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:57.240041 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-427b0bfe-ebd9-41db-bbf0-135fc8ea4192 req-aee2bf87-3eeb-4e91-93fd-057aa9417296 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-unplugged-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:13:57.386715 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-88f898d8-5dcf-4e0d-be89-88583d5ef42e req-651e12bf-d13e-4ce5-bf18-0e74969b8818 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Received event network-vif-deleted-4e74ab1b-2352-4cb6-bb11-265aad5c70e7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:57.386715 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-88f898d8-5dcf-4e0d-be89-88583d5ef42e req-651e12bf-d13e-4ce5-bf18-0e74969b8818 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Neutron deleted interface 4e74ab1b-2352-4cb6-bb11-265aad5c70e7; detaching it from the instance and deleting it from the info cache
May 28 14:13:57.388849 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-88f898d8-5dcf-4e0d-be89-88583d5ef42e req-651e12bf-d13e-4ce5-bf18-0e74969b8818 service nova] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Detach interface failed, port_id=4e74ab1b-2352-4cb6-bb11-265aad5c70e7, reason: Instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:13:57.580100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:57.616628 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:57.708285 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:57.711227 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:57.722182 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:57.729185 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-89e6fc12-75ad-4b9d-9e21-0fe5974a642c tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.797s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:57.831852 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:13:57.968369 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:57.970168 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:57.972258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:57.974584 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:57.994471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:58.226400 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999706566999976 future=<Future at 0x71a7801abda0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:58.228797 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.996857726000144 future=<Future at 0x71a7801abda0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:58.228918 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.996711405000042 future=<Future at 0x71a7801abda0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:13:58.334729 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Took 1.45 seconds to deallocate network for instance.
May 28 14:13:58.376323 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977638.3760028, a95922fd-8d79-43bc-9052-e05f100abb79 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:58.376750 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] VM Started (Lifecycle Event)
May 28 14:13:58.449527 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:58.449752 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:58.840595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:58.879046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:58.882022 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977638.8808444, a95922fd-8d79-43bc-9052-e05f100abb79 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:58.882022 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] VM Paused (Lifecycle Event)
May 28 14:13:58.952470 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:13:59.290529 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-changed-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:59.290981 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Refreshing instance network info cache due to event network-changed-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:13:59.291185 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] Acquiring lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:13:59.291297 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] Acquired lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:13:59.291476 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Refreshing network info cache for port 87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:13:59.383867 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:13:59.385351 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:13:59.453046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-vif-plugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:59.453387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:59.453526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:59.453663 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:59.453789 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Processing event network-vif-plugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:13:59.453913 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-vif-plugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:13:59.454040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:13:59.454209 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:59.454330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:59.454456 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] No waiting events found dispatching network-vif-plugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:13:59.454611 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a30e6eb8-ba67-44ce-b892-c4efaa1550d9 req-ffb30028-d205-49a8-9aef-428ef25d2bcd service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received unexpected event network-vif-plugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 for instance with vm_state building and task_state spawning.
May 28 14:13:59.455169 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:13:59.459141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.331s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:13:59.459671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.619s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:13:59.459830 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:13:59.461886 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:13:59.468911 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Instance spawned successfully.
May 28 14:13:59.469014 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:13:59.702540 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:13:59.775308 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:13:59.775308 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:13:59.793477 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:59.889594 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:13:59.890931 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977639.8899548, a95922fd-8d79-43bc-9052-e05f100abb79 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:13:59.890931 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] VM Resumed (Lifecycle Event)
May 28 14:13:59.977152 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:13:59.979734 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:13:59.979734 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:59.979734 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:13:59.980568 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:59.980568 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:59.980786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:59.981021 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:59.981280 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:13:59.981575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:00.113110 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:00.152935 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af9256b87bff41169f687e525ed03b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb1797521824e3eb334e57554516577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:14:00.251886 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Updated VIF entry in instance network info cache for port 87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:14:00.252269 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Updating instance_info_cache with network_info: [{"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:00.277487 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:00.396262 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:00.398980 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:00.477292 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:14:00.493979 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Took 7.83 seconds to spawn the instance on the hypervisor.
May 28 14:14:00.494222 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:00.754587 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-92285c4c-9be8-4553-a740-f243adeb17ac req-20ba59ef-eeae-4cd4-8230-0f360398ede4 service nova] Releasing lock "refresh_cache-eee1e472-9a54-4213-a0ca-aba7284297c5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:00.769894 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Successfully created port: 12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:14:00.784820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.325s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:00.835870 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Deleted allocations for instance 3a1fb5dd-4075-4ede-aa93-8ceee595990a
May 28 14:14:00.902283 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:14:00.981770 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:14:01.005578 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Took 13.17 seconds to build instance.
May 28 14:14:01.261426 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Successfully updated port: 12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:14:01.306318 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-changed-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:01.306318 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Refreshing instance network info cache due to event network-changed-12c3b222-1d81-49f3-97f5-60154de00ec2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:01.306318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] Acquiring lock "refresh_cache-ed584e13-6fd9-4879-af22-995a2d47ceb6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:01.306318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] Acquired lock "refresh_cache-ed584e13-6fd9-4879-af22-995a2d47ceb6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:01.306318 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Refreshing network info cache for port 12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:01.378746 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:01.486510 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Booting with volume 79d29a5a-4281-46fd-b495-132885b4cb21 at /dev/vda
May 28 14:14:01.506425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1a31b8c6-2b7e-4390-a2c0-fa8af8636db3 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.683s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:01.528654 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:01.538963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:14:01.560442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:01.601238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:14:01.601569 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:14:01.610836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:14:01.612092 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fecc:b48d', 'fe80::c0ca:ecff:fed2:b6fb', 'fe80::fc16:3eff:fef7:2f79', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe74:4b01', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707'] 
May 28 14:14:01.612272 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:14:01.612381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:14:01.612652 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:01.612853 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Updating existing volume attachment record: 854fed16-3a60-42db-b2e8-30f3ad1a3e53 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:14:01.766557 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "refresh_cache-ed584e13-6fd9-4879-af22-995a2d47ceb6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:01.808397 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:01.845214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7cd43f95-0d54-4a3c-b350-48949953dc87 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "3a1fb5dd-4075-4ede-aa93-8ceee595990a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.841s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:01.900840 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:02.041423 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:02.337717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-changed-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:02.337717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Refreshing instance network info cache due to event network-changed-d448dee9-cd94-4537-b2b1-43d834fc96b8. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:02.337965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] Acquiring lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:02.338183 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] Acquired lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:02.338299 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Refreshing network info cache for port d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:02.542567 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-11f10e0a-0dbd-4714-8df6-1095e2e5583f req-d78e6f05-2169-4a15-9e75-a1137c32019e service nova] Releasing lock "refresh_cache-ed584e13-6fd9-4879-af22-995a2d47ceb6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:02.543037 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquired lock "refresh_cache-ed584e13-6fd9-4879-af22-995a2d47ceb6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:02.543285 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:14:02.840618 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:03.107843 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:03.184591 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:03.315485 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:03.325031 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updated VIF entry in instance network info cache for port d448dee9-cd94-4537-b2b1-43d834fc96b8. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:14:03.325031 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating instance_info_cache with network_info: [{"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:03.440643 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Updating instance_info_cache with network_info: [{"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:03.716643 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:14:03.717651 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:14:03.717853 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Creating image(s)
May 28 14:14:03.718155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:14:03.718268 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Ensure instance console log exists: /opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:14:03.718485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:03.718642 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:03.718749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:03.826332 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d5e7451d-cbec-40de-a36c-00f578bdff66 req-b4e490d6-129c-49f5-a3fe-01227afb2824 service nova] Releasing lock "refresh_cache-a95922fd-8d79-43bc-9052-e05f100abb79" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:03.942551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Releasing lock "refresh_cache-ed584e13-6fd9-4879-af22-995a2d47ceb6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:03.942823 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Instance network_info: |[{"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:14:03.943403 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Start _get_guest_xml network_info=[{"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '854fed16-3a60-42db-b2e8-30f3ad1a3e53', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ed584e13-6fd9-4879-af22-995a2d47ceb6', 'attached_at': '', 'detached_at': '', 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'serial': '79d29a5a-4281-46fd-b495-132885b4cb21'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:14:03.946598 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:14:03.947611 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='ed584e13-6fd9-4879-af22-995a2d47ceb6'), owner=OwnerMeta(userid='af9256b87bff41169f687e525ed03b2c', username='tempest-ImageDependencyTests-1134113524-project-member', projectid='bbb1797521824e3eb334e57554516577', projectname='tempest-ImageDependencyTests-1134113524'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977643.9472976) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:14:03.948608 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:14:03.948958 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:14:03.950983 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:14:03.951179 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:14:03.952027 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:14:03.952310 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:14:03.952485 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:14:03.952605 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:14:03.952755 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:14:03.952871 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:14:03.953046 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:14:03.953228 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:14:03.953363 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:14:03.953520 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:14:03.953659 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:14:03.953811 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:14:03.964096 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:14:03.964429 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:03.964617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:03.964953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:03.965174 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:14:03.978064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:03.978607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:03.978949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:03.979153 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:03.979440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:03.979704 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:03.989283 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:03.989283 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:03.994136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:03.994136 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:04.005904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21] added
May 28 14:14:04.005904 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:04.005904 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:04.005904 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:04.005904 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:04.005904 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:04.005904 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:04.006893 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21] added
May 28 14:14:04.006893 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:04.006893 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:04.006893 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:04.006893 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:04.006893 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:04.006893 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:04.007156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:04.007437 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:04.007744 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:04.007973 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:04.008225 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:04.008412 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:04.426671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:04.426827 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:04.712141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:04.928485 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:14:05.008641 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:05.008997 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:05.024373 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:05.024373 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:05.026738 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:05.026738 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.041763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.046545 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.053734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.053734 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.053734 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:05.053897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsi session list stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.053897 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.053897 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:05.059560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.059560 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.059560 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:05.059753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsi session list stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.059753 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.059753 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:05.085071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.40.100,3260]
May 28 14:14:05.085071 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.40.100,3260] successful.
May 28 14:14:05.085071 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.097000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.102076 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.50.100,3260]
May 28 14:14:05.102076 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.50.100,3260] successful.
May 28 14:14:05.102076 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.111067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.111067 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.111067 np0000001643 nova-compute[98269]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.111067 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.111067 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:05.111392 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsi session list stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.111392 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.111392 np0000001643 nova-compute[98269]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.111392 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.111392 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:05.111625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:05.112465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:05.112574 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] HCTL ('7', '-', '-', 0) found on session 125 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:05.112717 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:05.118168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:05.127803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Searching for a device in session 125 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:05.127948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:05.135286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.135286 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.135286 np0000001643 nova-compute[98269]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.135286 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.135286 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:05.135425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsi session list stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.135425 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:05.135425 np0000001643 nova-compute[98269]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.135425 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:05.135425 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:05.135706 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:05.135815 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:05.136550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] HCTL ('8', '-', '-', 0) found on session 126 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:05.136653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:05.158387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Searching for a device in session 126 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:05.158605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:05.482827 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:05.482998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:05.486004 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:14:05.486151 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Claim successful on node np0000001643
May 28 14:14:05.980516 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:14:06.115115 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-changed-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:06.115267 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing instance network info cache due to event network-changed-ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:06.115419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] Acquiring lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:06.115545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] Acquired lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:06.116419 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Refreshing network info cache for port ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:06.379322 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:06.625018 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:06.627006 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:06.627274 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:06.627516 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:06.627713 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:06.627864 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:06.632906 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Terminating instance
May 28 14:14:06.850935 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:14:06.851306 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:14:06.964586 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:07.000581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Found WWN 330000000d69788fd for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:14:07.000990 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:07.000990 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000d69788fd', 'path': '/dev/dm-0', 'multipath_id': '330000000d69788fd'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:07.001069 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d69788fd', 'path': '/dev/dm-0', 'multipath_id': '330000000d69788fd'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:14:07.111674 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updated VIF entry in instance network info cache for port ab278e65-373b-410c-a01b-71df629acfca. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:14:07.111998 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [{"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:07.139712 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:14:07.165734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:07.184886 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:07.189622 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:07.218671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:07.356060 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:07.399602 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79e7f59f-6f8e-4aac-9ec6-d07053c920f9 req-e97f4950-8608-4e67-90c5-b2fb5114646c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:07.400937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79e7f59f-6f8e-4aac-9ec6-d07053c920f9 req-e97f4950-8608-4e67-90c5-b2fb5114646c service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:07.400937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79e7f59f-6f8e-4aac-9ec6-d07053c920f9 req-e97f4950-8608-4e67-90c5-b2fb5114646c service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:07.400937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-79e7f59f-6f8e-4aac-9ec6-d07053c920f9 req-e97f4950-8608-4e67-90c5-b2fb5114646c service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:07.400937 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79e7f59f-6f8e-4aac-9ec6-d07053c920f9 req-e97f4950-8608-4e67-90c5-b2fb5114646c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] No waiting events found dispatching network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:07.401254 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-79e7f59f-6f8e-4aac-9ec6-d07053c920f9 req-e97f4950-8608-4e67-90c5-b2fb5114646c service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:14:07.484618 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999567338999896 future=<Future at 0x71a75c2819d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:07.486573 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Instance destroyed successfully.
May 28 14:14:07.488561 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lazy-loading 'resources' on Instance uuid 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:07.505798 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='instance-depend-image',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb1797521824e3eb334e57554516577',ramdisk_id='',reservation_id='r-q8300dmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1134113524',owner_user_name='tempest-ImageDependencyTests-1134113524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:01Z,user_data=None,user_id='af9256b87bff41169f687e525ed03b2c',uuid=ed584e13-6fd9-4879-af22-995a2d47ceb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:14:07.506078 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Converting VIF {"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:07.506764 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:13,bridge_name='br-int',has_traffic_filtering=True,id=12c3b222-1d81-49f3-97f5-60154de00ec2,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12c3b222-1d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:07.507486 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lazy-loading 'pci_devices' on Instance uuid ed584e13-6fd9-4879-af22-995a2d47ceb6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:07.613933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a9e1acf1-25b8-48f7-b2e4-9fdb44b9cf88 req-046bcee1-3579-4e3c-8bc1-8501081fceb2 service nova] Releasing lock "refresh_cache-9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:07.861126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.378s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:07.861603 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:14:07.981253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:07.981425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:07.992630 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1246116858',display_name='tempest-TestShelveInstance-server-1246116858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testshelveinstance-server-1246116858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/vQiaxyXS8LEGTF8uoCSUGZqkfvB9GkU+ffz3e+h07cS1mFxJ4cYTb5c2JNnEqAwvcU+QKwKkWk0ibNRSKDeH0r43SQ2edTw2WLX4etfwJJ8B9KEKLabOcoF075PLjtQ==',key_name='tempest-TestShelveInstance-1312651833',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:13:28Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52a6b1dd5a2f47bdbea499915e31b2f3',ramdisk_id='',reservation_id='r-nq05f8am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-596826550',owner_user_name='tempest-TestShelveInstance-596826550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:28Z,user_data=None,user_id='62dd681b2bbe4147af5e6cd596c6d668',uuid=9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:14:07.992872 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converting VIF {"id": "ab278e65-373b-410c-a01b-71df629acfca", "address": "fa:16:3e:cc:b4:8d", "network": {"id": "c2e23014-ab24-4766-b9ab-d0df33bec922", "bridge": "br-int", "label": "tempest-TestShelveInstance-2113739253-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52a6b1dd5a2f47bdbea499915e31b2f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab278e65-37", "ovs_interfaceid": "ab278e65-373b-410c-a01b-71df629acfca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:07.993593 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:07.993911 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:14:07.998187 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:07.998992 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab278e65-37, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:08.000134 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.001151 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:08.002596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.003545 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.003711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b73c12c-19e0-4486-b8a6-84a37db75395) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:08.004239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.004866 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:08.005272 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.007103 np0000001643 nova-compute[98269]: INFO os_vif [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b4:8d,bridge_name='br-int',has_traffic_filtering=True,id=ab278e65-373b-410c-a01b-71df629acfca,network=Network(c2e23014-ab24-4766-b9ab-d0df33bec922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab278e65-37')
May 28 14:14:08.008476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:14:08.008747 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:08.008882 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:08.009316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:08.009628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92f77984-c5a1-486b-ac27-897f5399e7ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:14:08.009799 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:14:08.012251 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] End _get_guest_xml xml=<domain type="qemu">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <uuid>ed584e13-6fd9-4879-af22-995a2d47ceb6</uuid>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <name>instance-00000033</name>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:name>instance-depend-image</nova:name>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:14:03</nova:creationTime>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:properties/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:user uuid="af9256b87bff41169f687e525ed03b2c">tempest-ImageDependencyTests-1134113524-project-member</nova:user>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:project uuid="bbb1797521824e3eb334e57554516577">tempest-ImageDependencyTests-1134113524</nova:project>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         <nova:port uuid="12c3b222-1d81-49f3-97f5-60154de00ec2">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="192.168.233.172" ipVersion="4"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <system>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <entry name="serial">ed584e13-6fd9-4879-af22-995a2d47ceb6</entry>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <entry name="uuid">ed584e13-6fd9-4879-af22-995a2d47ceb6</entry>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </system>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <os>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   </os>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <features>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   </features>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   <devices>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6/disk.config"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <alias name="ua-79d29a5a-4281-46fd-b495-132885b4cb21"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <serial>79d29a5a-4281-46fd-b495-132885b4cb21</serial>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:84:20:13"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <target dev="tap12c3b222-1d"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </interface>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6/console.log" append="off"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </serial>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <video>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </video>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </rng>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:   </devices>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]: </domain>
May 28 14:14:08.012251 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:14:08.015254 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Preparing to wait for external event network-vif-plugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:14:08.015254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:08.015254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:08.015254 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:08.015254 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='instance-depend-image',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb1797521824e3eb334e57554516577',ramdisk_id='',reservation_id='r-q8300dmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1134113524',owner_user_name='tempest-ImageDependencyTests-1134113524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:01Z,user_data=None,user_id='af9256b87bff41169f687e525ed03b2c',uuid=ed584e13-6fd9-4879-af22-995a2d47ceb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:14:08.015254 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Converting VIF {"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:08.015254 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:13,bridge_name='br-int',has_traffic_filtering=True,id=12c3b222-1d81-49f3-97f5-60154de00ec2,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12c3b222-1d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:08.015876 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:13,bridge_name='br-int',has_traffic_filtering=True,id=12c3b222-1d81-49f3-97f5-60154de00ec2,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12c3b222-1d') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:14:08.016103 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.016357 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:08.016610 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:14:08.017212 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.017378 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a9a1943-889a-59c0-a225-769c69fd37c5', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:08.018159 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.018764 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:08.019543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.021720 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.021868 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12c3b222-1d, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:08.022207 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12c3b222-1d, col_values=(('qos', UUID('77c8516d-ecc8-41df-ad0f-b106852feb15')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:08.022372 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12c3b222-1d, col_values=(('external_ids', {'iface-id': '12c3b222-1d81-49f3-97f5-60154de00ec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:20:13', 'vm-uuid': 'ed584e13-6fd9-4879-af22-995a2d47ceb6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:08.023177 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.024435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:08.030639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:08.031673 np0000001643 nova-compute[98269]: INFO os_vif [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:13,bridge_name='br-int',has_traffic_filtering=True,id=12c3b222-1d81-49f3-97f5-60154de00ec2,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12c3b222-1d')
May 28 14:14:08.037294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:08.037294 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:08.037294 np0000001643 nova-compute[98269]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:08.037294 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:08.037294 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:08.037573 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsi session list stdout=tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:08.037573 np0000001643 nova-compute[98269]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce (non-flash)
May 28 14:14:08.037573 np0000001643 nova-compute[98269]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:08.037573 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:08.037573 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:08.037733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '126')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:14:08.037822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '122')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:14:08.038666 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce', '121')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:14:08.039363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801eb100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:14:08.039614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:14:08.039982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Flush multipath device 330000000e6a27b75 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:14:08.097868 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:14:08.138883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:14:08.197849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:14:08.198038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:14:08.198762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:14:08.213568 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:14:08.213915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:14:08.226798 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:08.266121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260]
May 28 14:14:08.266121 np0000001643 nova-compute[98269]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.40.100,3260] successful.
May 28 14:14:08.266121 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:08.284572 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:08.298976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:08.333117 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260]
May 28 14:14:08.333117 np0000001643 nova-compute[98269]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-92f77984-c5a1-486b-ac27-897f5399e7ce, portal: 192.168.50.100,3260] successful.
May 28 14:14:08.333117 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:08.351203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:08.351339 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:08.351402 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] <== disconnect_volume: return (342ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:08.351530 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:14:08.351767 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Deleting instance files /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d_del
May 28 14:14:08.352267 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Deletion of /opt/stack/data/nova/instances/9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d_del complete
May 28 14:14:08.368731 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:14:08.368957 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:14:08.369277 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:08.369583 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:08.444933 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b666f3c9eb914e2dba854ed4e0d8fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1dc6979a244982823fef41c57d1c75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:14:08.484949 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'flavor' on Instance uuid bfac770e-7430-4353-9f3c-ec438536a7c3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:08.858159 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Took 1.72 seconds to destroy the instance on the hypervisor.
May 28 14:14:08.858658 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:14:08.859012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:14:08.859134 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:14:08.859349 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:08.873226 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:14:08.933939 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:08.983719 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Successfully created port: 9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:14:08.987760 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Ignoring supplied device name: /dev/vdb
May 28 14:14:09.175680 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:09.176071 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:09.378829 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:14:09.486522 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:09.486702 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] Acquiring lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:09.486868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:09.487028 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:09.487143 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] No waiting events found dispatching network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:09.487286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-unplugged-ab278e65-373b-410c-a01b-71df629acfca for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:14:09.487410 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Received event network-vif-deleted-ab278e65-373b-410c-a01b-71df629acfca {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:09.493123 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Successfully updated port: 9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:14:09.493891 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:09.494293 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Neutron deleted interface ab278e65-373b-410c-a01b-71df629acfca; detaching it from the instance and deleting it from the info cache
May 28 14:14:09.496900 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-eb4989bb-355c-44c1-be58-5393c0c61a21 req-c71b3d9f-64ce-4a78-bd41-b92e57a9a4fb service nova] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Detach interface failed, port_id=ab278e65-373b-410c-a01b-71df629acfca, reason: Instance 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:14:09.552819 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:09.552976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:09.555468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] No VIF found with MAC fa:16:3e:84:20:13, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:14:09.555468 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Using config drive
May 28 14:14:09.557524 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-changed-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:09.557674 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing instance network info cache due to event network-changed-9b754c38-a97e-4220-96e5-625800c5d818. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:09.557852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] Acquiring lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:09.557948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] Acquired lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:09.558062 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing network info cache for port 9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:09.654600 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:09.677381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:14:09.715565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:09.995846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:10.062873 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:10.065300 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:10.127465 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:10.157039 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Took 1.30 seconds to deallocate network for instance.
May 28 14:14:10.212650 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Creating config drive at /opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6/disk.config
May 28 14:14:10.215611 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpomcyvii_ {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:10.273122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:10.273686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:10.274232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpomcyvii_" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:10.279005 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:14:10.279305 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Claim successful on node np0000001643
May 28 14:14:10.302170 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:10.390774 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:14:10.392213 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:14:10.392612 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Creating image(s)
May 28 14:14:10.393429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:10.393661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:10.394257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:10.395024 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:10.398974 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:10.400036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:10.493150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:10.493759 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:10.494720 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:10.495349 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:10.500266 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:10.502003 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:10.560837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:10.561179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:10.561555 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Attaching volume 67d20bd7-a81b-4e18-be80-56ccf2995bbc to /dev/vdb
May 28 14:14:10.600423 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:10.600799 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:10.616693 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:10.636407 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:14:10.663281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk 1073741824" returned: 0 in 0.062s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:10.663705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:10.663997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:10.677378 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:10.726417 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:10.735952 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Took 0.57 seconds to detach 1 volumes for instance.
May 28 14:14:10.735952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:14:10.735952 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:10.735952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:14:10.736931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Deleting volume: 92f77984-c5a1-486b-ac27-897f5399e7ce {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:14:10.746711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:14:10.747761 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef7:2f79', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe74:4b01', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe84:2013'] 
May 28 14:14:10.747875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:14:10.747972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:14:10.748231 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:10.748421 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Updating existing volume attachment record: 3c637c85-54db-4860-930c-9311c89b9914 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:14:10.773464 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:10.773963 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:14:10.774205 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:10.817558 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:10.828541 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4631b97b-1982-4c0e-b65e-a0989a8e2871 req-8832352b-be3e-4fdb-aed1-e69f7df62a6a service nova] Releasing lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:10.845136 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquired lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:10.845823 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:14:10.871199 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:10.925331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:10.926503 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Cannot resize image /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:14:10.926503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:14:10.926503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Ensure instance console log exists: /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:14:10.930440 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:10.930440 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:10.930440 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:11.143578 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:11.148362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:11.153477 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:11.177944 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:11.309604 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:14:11.310172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:11.310365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:11.310736 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:11.310911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:14:11.324139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:11.324771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:11.325203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:11.325421 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:11.325771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:11.326041 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:11.336394 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:11.336394 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:11.343697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:11.343697 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:11.347474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:11.350099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc] added
May 28 14:14:11.350099 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:11.350099 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:11.350099 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:11.350099 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:11.350099 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:11.350099 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:11.350480 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:11.350570 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:11.350914 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:11.359327 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc] added
May 28 14:14:11.359327 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:11.359327 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:11.359327 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:11.359327 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:11.359327 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:11.359327 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:11.359550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:11.359672 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:11.359821 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:11.422309 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-vif-plugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Processing event network-vif-plugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-vif-plugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:11.566572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:11.568207 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] No waiting events found dispatching network-vif-plugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:11.568207 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9e043b59-f044-481c-b4d3-66d6588c1874 req-ab57cb4a-c871-4927-9e63-cd04f89d3281 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received unexpected event network-vif-plugged-12c3b222-1d81-49f3-97f5-60154de00ec2 for instance with vm_state building and task_state spawning.
May 28 14:14:11.630028 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:11.635598 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977651.6351445, ed584e13-6fd9-4879-af22-995a2d47ceb6 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:11.636289 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:14:11.637850 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] VM Started (Lifecycle Event)
May 28 14:14:11.639389 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:14:11.644377 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Instance spawned successfully.
May 28 14:14:11.644797 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:14:11.755119 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:14:11.755312 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:14:11.786334 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:12.139633 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:12.140915 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:12.151789 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:12.151996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:12.152226 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:12.152464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:12.152781 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:12.153040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:12.258082 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:12.288105 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Releasing lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:12.288326 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance network_info: |[{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:14:12.289809 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Start _get_guest_xml network_info=[{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:14:12.291744 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:14:12.292753 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-253298750', uuid='5b580f8d-61fa-4994-822f-0500e14eeced'), owner=OwnerMeta(userid='b666f3c9eb914e2dba854ed4e0d8fb20', username='tempest-AttachVolumeShelveTestJSON-1300734613-project-member', projectid='db1dc6979a244982823fef41c57d1c75', projectname='tempest-AttachVolumeShelveTestJSON-1300734613'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977652.2924716) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:14:12.293705 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:14:12.294130 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:14:12.294831 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:14:12.295038 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:14:12.295848 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:14:12.296180 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:14:12.296377 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:14:12.296535 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:14:12.296719 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:14:12.296851 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:14:12.297012 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:14:12.297211 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:14:12.297365 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:14:12.297543 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:14:12.297705 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:14:12.297867 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:14:12.311736 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-253298750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-253298750',id=52,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLBXqXRdQpsXsHQ6iLHpJqYQH+dvCxX6Exr6ArQUPgrr1nTlfq7cX3PQX7Td86IS/vefw/pPw9OQpYY7X2+qWdMKXosb7HRzQbCntkeyWx+D0/69JoffQsFfeK2LjGeuw==',key_name='tempest-keypair-1418715405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-lw0yqruz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=5b580f8d-61fa-4994-822f-0500e14eeced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:14:12.312343 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:12.312430 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:12.313162 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:12.351355 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:12.360634 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:12.363099 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:12.363099 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:12.373656 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:12.373656 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.379359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.388752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.396187 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.396187 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.396187 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:12.396370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.396370 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.396370 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:12.402970 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.402970 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.402970 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:12.403136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.403136 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.403136 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:12.429636 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.40.100,3260]
May 28 14:14:12.429636 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.40.100,3260] successful.
May 28 14:14:12.429636 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.441031 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.448057 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.50.100,3260]
May 28 14:14:12.448057 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.50.100,3260] successful.
May 28 14:14:12.448057 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.454945 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:12.455525 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:12.455525 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:12.456055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] HCTL ('9', '-', '-', 0) found on session 127 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:12.456156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:12.460774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:12.471297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching for a device in session 127 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:12.471758 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:12.478135 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.478135 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.478135 np0000001643 nova-compute[98269]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.478135 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.478135 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:12.478294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.478294 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:12.478294 np0000001643 nova-compute[98269]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.478294 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:12.478294 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:12.478565 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:12.478691 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:12.479367 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] HCTL ('10', '-', '-', 0) found on session 128 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:12.479522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:12.494626 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching for a device in session 128 and hctl ['10', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:12.643183 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:14:12.643708 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977652.6435175, ed584e13-6fd9-4879-af22-995a2d47ceb6 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:12.643991 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] VM Paused (Lifecycle Event)
May 28 14:14:12.659154 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Took 8.94 seconds to spawn the instance on the hypervisor.
May 28 14:14:12.659342 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:12.763982 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.490s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:12.764831 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.417s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:12.765154 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:14:12.818718 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] End _get_guest_xml xml=<domain type="qemu">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <uuid>5b580f8d-61fa-4994-822f-0500e14eeced</uuid>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <name>instance-00000034</name>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-253298750</nova:name>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:14:12</nova:creationTime>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:user uuid="b666f3c9eb914e2dba854ed4e0d8fb20">tempest-AttachVolumeShelveTestJSON-1300734613-project-member</nova:user>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:project uuid="db1dc6979a244982823fef41c57d1c75">tempest-AttachVolumeShelveTestJSON-1300734613</nova:project>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         <nova:port uuid="9b754c38-a97e-4220-96e5-625800c5d818">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <system>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <entry name="serial">5b580f8d-61fa-4994-822f-0500e14eeced</entry>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <entry name="uuid">5b580f8d-61fa-4994-822f-0500e14eeced</entry>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </system>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <os>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   </os>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <features>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   </features>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   <devices>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:05:3b:49"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <target dev="tap9b754c38-a9"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </interface>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/console.log" append="off"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </serial>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <video>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </video>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </rng>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:   </devices>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]: </domain>
May 28 14:14:12.818718 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:14:12.824461 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Preparing to wait for external event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:14:12.824461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:12.824461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:12.824461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:12.824461 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-253298750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-253298750',id=52,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLBXqXRdQpsXsHQ6iLHpJqYQH+dvCxX6Exr6ArQUPgrr1nTlfq7cX3PQX7Td86IS/vefw/pPw9OQpYY7X2+qWdMKXosb7HRzQbCntkeyWx+D0/69JoffQsFfeK2LjGeuw==',key_name='tempest-keypair-1418715405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-lw0yqruz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=5b580f8d-61fa-4994-822f-0500e14eeced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:14:12.826395 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:12.826395 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:12.826395 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:14:12.827340 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:12.827340 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:12.827340 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:14:12.828229 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:12.828496 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab813fb1-b30e-52cf-bc02-c295725871d1', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:12.829299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:12.830221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:12.831055 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:12.833253 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:12.833554 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b754c38-a9, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:12.834028 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b754c38-a9, col_values=(('qos', UUID('df73ceab-bd15-4780-a916-cf7924d1fdd7')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:12.834820 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b754c38-a9, col_values=(('external_ids', {'iface-id': '9b754c38-a97e-4220-96e5-625800c5d818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:3b:49', 'vm-uuid': '5b580f8d-61fa-4994-822f-0500e14eeced'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:12.836850 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:12.836850 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:12.843557 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:12.843557 np0000001643 nova-compute[98269]: INFO os_vif [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9')
May 28 14:14:13.099380 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:14:13.099700 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:14:13.146294 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:13.147794 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977653.1476169, ed584e13-6fd9-4879-af22-995a2d47ceb6 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:13.147981 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] VM Resumed (Lifecycle Event)
May 28 14:14:13.166944 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Took 16.11 seconds to build instance.
May 28 14:14:13.226166 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004098869999324961 future=<Future at 0x71a7801abda0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:13.226315 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:13.226387 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.25776291000011 future=<Future at 0x71a75c2819d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:13.227620 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.257641414999853 future=<Future at 0x71a75c2819d0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:13.227620 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Emitting event <LifecycleEvent: 1779977638.225552, 3a1fb5dd-4075-4ede-aa93-8ceee595990a => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:13.227620 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] VM Stopped (Lifecycle Event)
May 28 14:14:13.273853 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:14:13.273853 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:14:13.273853 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:13.273853 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:13.343050 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4fa943716494225849fb8aac46fb662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503ff5746ac94b068fca926067617b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:14:13.494998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Searching for a device in session 128 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:13.495196 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:13.602405 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:13.650269 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:13.659012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:13.669519 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e62d49a0-a5cf-4c9e-97aa-eda45aa0a38b tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.625s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:13.729332 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 3a1fb5dd-4075-4ede-aa93-8ceee595990a] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:13.775944 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:14:13.845683 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Successfully created port: 06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:14:14.109489 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.345s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:14.156461 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Deleted allocations for instance 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d
May 28 14:14:14.268058 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Successfully updated port: 06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:14:14.280514 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:14:14.346582 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Found WWN 3300000001f804708 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:14:14.348103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:14.348103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000001f804708', 'path': '/dev/dm-1', 'multipath_id': '3300000001f804708'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:14.348103 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001f804708', 'path': '/dev/dm-1', 'multipath_id': '3300000001f804708'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:14:14.353254 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'flavor' on Instance uuid bfac770e-7430-4353-9f3c-ec438536a7c3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:14.359663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:14.359663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:14.359663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No VIF found with MAC fa:16:3e:05:3b:49, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:14:14.359663 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Using config drive
May 28 14:14:14.434708 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-changed-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:14.434708 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Refreshing instance network info cache due to event network-changed-06677b0d-9214-446b-8dfe-871a0743bb62. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:14.434708 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] Acquiring lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:14.434708 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] Acquired lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:14.434891 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Refreshing network info cache for port 06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:14.715966 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:14.770009 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:14.857539 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Attempting to attach volume 67d20bd7-a81b-4e18-be80-56ccf2995bbc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:14:14.859293 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:14:14.859293 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:14:14.859293 np0000001643 nova-compute[98269]:   <alias name="ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc"/>
May 28 14:14:14.859293 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:14:14.859293 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:14:14.859293 np0000001643 nova-compute[98269]:   <serial>67d20bd7-a81b-4e18-be80-56ccf2995bbc</serial>
May 28 14:14:14.859293 np0000001643 nova-compute[98269]: </disk>
May 28 14:14:14.859293 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:14:14.863368 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:14.936631 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:15.003516 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Creating config drive at /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config
May 28 14:14:15.007419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptavb3m50 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:15.029598 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:15.066407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptavb3m50" returned: 0 in 0.059s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:15.165531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-066be689-eeba-477d-a6dd-d8ad48108892 tempest-TestShelveInstance-596826550 tempest-TestShelveInstance-596826550-project-member] Lock "9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.538s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:15.204815 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:15.292294 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:14:15.293715 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:14:15.294008 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Creating image(s)
May 28 14:14:15.294584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "/opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:15.294802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "/opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:15.295375 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "/opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:15.295983 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:15.299926 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:15.301234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:15.395120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:15.395570 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:15.396120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:15.396680 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:15.399230 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:14:15.399547 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:15.488502 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:15.488917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:15.507963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:15.537133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:15.542038 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:15.562970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk 1073741824" returned: 0 in 0.074s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:15.563990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:15.563990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:15.664547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:15.669536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.106s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:15.669888 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:14:15.670118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:15.708866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34687654-28a7-45f1-a00f-49165fcfbd76 req-66076469-6cf5-4e74-ab5f-13a39594f408 service nova] Releasing lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:15.712660 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquired lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:15.712660 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:14:15.774503 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:15.774862 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Cannot resize image /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:14:15.775286 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:14:15.775516 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Ensure instance console log exists: /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:14:15.775894 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:15.776189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:15.776372 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:15.906714 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:15.910461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:15.915816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:15.934351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:16.294499 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:16.358031 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977656.3575, 5b580f8d-61fa-4994-822f-0500e14eeced => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:16.358276 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Started (Lifecycle Event)
May 28 14:14:16.445683 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:16.519687 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:16.519903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:16.520064 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:16.520513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:16.520513 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Processing event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:14:16.520979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:16.521547 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:14:16.521752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:16.521896 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:16.522021 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:16.522135 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] No waiting events found dispatching network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:16.522243 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-4c7713a5-8cc2-497d-a18b-4afbebb9b66a req-f862a16c-b345-484d-b738-7b699801ae82 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received unexpected event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 for instance with vm_state building and task_state spawning.
May 28 14:14:16.527758 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:14:16.530879 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance spawned successfully.
May 28 14:14:16.531306 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:14:16.568779 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:16.568918 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:16.569049 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:16.569145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No VIF found with MAC fa:16:3e:f7:2f:79, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:14:16.627129 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Updating instance_info_cache with network_info: [{"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:16.862080 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:16.863879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:17.038231 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:17.039231 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:17.039231 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:17.039231 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:17.039774 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:17.040281 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:17.129433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Releasing lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:17.129678 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Instance network_info: |[{"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:14:17.132061 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Start _get_guest_xml network_info=[{"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:14:17.133879 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:14:17.135301 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-105321707', uuid='eadb7b17-f3e3-46c7-9149-04c4b94fc699'), owner=OwnerMeta(userid='d4fa943716494225849fb8aac46fb662', username='tempest-VolumesSnapshotTestJSON-33088366-project-member', projectid='503ff5746ac94b068fca926067617b52', projectname='tempest-VolumesSnapshotTestJSON-33088366'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977657.13491) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:14:17.136604 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:14:17.137061 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:14:17.138165 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:14:17.140486 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:14:17.141038 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:14:17.141267 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:14:17.152700 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-105321707',display_name='tempest-VolumesSnapshotTestJSON-instance-105321707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumessnapshottestjson-instance-105321707',id=53,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOVGuDuDz6Z1IfK2G72oFANrLzwi/+vFsMlhJvOqbJEB5qG2PgtUdlWU5qTUOQBjEMJkwyzTzq/729ZrjA7GjiHoLy9tO1z62N3rNz5BrIZcZh3e/SwDDWT0n39ZG/g/Q==',key_name='tempest-keypair-522639749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='503ff5746ac94b068fca926067617b52',ramdisk_id='',reservation_id='r-9jtxchqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-33088366',owner_user_name='tempest-VolumesSnapshotTestJSON-33088366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4fa943716494225849fb8aac46fb662',uuid=eadb7b17-f3e3-46c7-9149-04c4b94fc699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:14:17.154717 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converting VIF {"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:17.154717 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=06677b0d-9214-446b-8dfe-871a0743bb62,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06677b0d-92') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:17.154717 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'pci_devices' on Instance uuid eadb7b17-f3e3-46c7-9149-04c4b94fc699 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:17.365931 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:14:17.366217 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977657.3660526, 5b580f8d-61fa-4994-822f-0500e14eeced => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:17.366335 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Paused (Lifecycle Event)
May 28 14:14:17.462247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.547628 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Took 7.16 seconds to spawn the instance on the hypervisor.
May 28 14:14:17.547628 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:17.656935 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] End _get_guest_xml xml=<domain type="qemu">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <uuid>eadb7b17-f3e3-46c7-9149-04c4b94fc699</uuid>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <name>instance-00000035</name>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-105321707</nova:name>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:14:17</nova:creationTime>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:user uuid="d4fa943716494225849fb8aac46fb662">tempest-VolumesSnapshotTestJSON-33088366-project-member</nova:user>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:project uuid="503ff5746ac94b068fca926067617b52">tempest-VolumesSnapshotTestJSON-33088366</nova:project>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         <nova:port uuid="06677b0d-9214-446b-8dfe-871a0743bb62">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <system>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <entry name="serial">eadb7b17-f3e3-46c7-9149-04c4b94fc699</entry>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <entry name="uuid">eadb7b17-f3e3-46c7-9149-04c4b94fc699</entry>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </system>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <os>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   </os>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <features>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   </features>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   <devices>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk.config"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:6b:b3:c8"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <target dev="tap06677b0d-92"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </interface>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/console.log" append="off"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </serial>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <video>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </video>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </rng>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:   </devices>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]: </domain>
May 28 14:14:17.656935 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Preparing to wait for external event network-vif-plugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-105321707',display_name='tempest-VolumesSnapshotTestJSON-instance-105321707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumessnapshottestjson-instance-105321707',id=53,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOVGuDuDz6Z1IfK2G72oFANrLzwi/+vFsMlhJvOqbJEB5qG2PgtUdlWU5qTUOQBjEMJkwyzTzq/729ZrjA7GjiHoLy9tO1z62N3rNz5BrIZcZh3e/SwDDWT0n39ZG/g/Q==',key_name='tempest-keypair-522639749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='503ff5746ac94b068fca926067617b52',ramdisk_id='',reservation_id='r-9jtxchqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-33088366',owner_user_name='tempest-VolumesSnapshotTestJSON-33088366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4fa943716494225849fb8aac46fb662',uuid=eadb7b17-f3e3-46c7-9149-04c4b94fc699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converting VIF {"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=06677b0d-9214-446b-8dfe-871a0743bb62,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06677b0d-92') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:17.662485 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=06677b0d-9214-446b-8dfe-871a0743bb62,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06677b0d-92') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:14:17.663208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.663208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:17.663375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:14:17.664067 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.664209 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3681d489-22d4-5c31-aa84-5842c60f1a2f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:17.665078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.665690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:17.666693 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.668341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.668491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06677b0d-92, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:17.668759 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06677b0d-92, col_values=(('qos', UUID('6fb0fc4a-d4aa-4537-ac66-e75c2d8372e4')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:17.668910 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06677b0d-92, col_values=(('external_ids', {'iface-id': '06677b0d-9214-446b-8dfe-871a0743bb62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:b3:c8', 'vm-uuid': 'eadb7b17-f3e3-46c7-9149-04c4b94fc699'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:17.669559 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.670640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:17.675950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:17.677583 np0000001643 nova-compute[98269]: INFO os_vif [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=06677b0d-9214-446b-8dfe-871a0743bb62,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06677b0d-92')
May 28 14:14:17.868585 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:17.871715 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977657.8712785, 5b580f8d-61fa-4994-822f-0500e14eeced => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:17.871824 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Resumed (Lifecycle Event)
May 28 14:14:18.055519 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Took 12.62 seconds to build instance.
May 28 14:14:18.120934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-192e008d-bfb0-4cb0-84f6-a1e5707a656a tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.560s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:18.374110 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:18.375707 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:18.541800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:18.542282 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:18.542366 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:18.542529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:18.542660 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:18.544793 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Terminating instance
May 28 14:14:18.557755 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.131s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:19.047864 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:14:19.075969 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.077891 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.095087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.102477 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.122106 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.133029 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.159029 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-changed-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:19.159093 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing instance network info cache due to event network-changed-9b754c38-a97e-4220-96e5-625800c5d818. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:19.159230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] Acquiring lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:19.159327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] Acquired lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:19.159429 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing network info cache for port 9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:19.194571 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:19.194698 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:19.194797 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No VIF found with MAC fa:16:3e:6b:b3:c8, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:14:19.195243 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Using config drive
May 28 14:14:19.387463 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999654780000128 future=<Future at 0x71a7781577a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:19.389922 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Instance destroyed successfully.
May 28 14:14:19.391241 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lazy-loading 'resources' on Instance uuid ed584e13-6fd9-4879-af22-995a2d47ceb6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:19.400533 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-68f74c4d-5cc9-47ae-aa40-91bd7a53fa70 req-d5b688fa-7896-42e1-907d-78ae69910347 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-vif-unplugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:19.400533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68f74c4d-5cc9-47ae-aa40-91bd7a53fa70 req-d5b688fa-7896-42e1-907d-78ae69910347 service nova] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:19.400533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68f74c4d-5cc9-47ae-aa40-91bd7a53fa70 req-d5b688fa-7896-42e1-907d-78ae69910347 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:19.400533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68f74c4d-5cc9-47ae-aa40-91bd7a53fa70 req-d5b688fa-7896-42e1-907d-78ae69910347 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:19.400533 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-68f74c4d-5cc9-47ae-aa40-91bd7a53fa70 req-d5b688fa-7896-42e1-907d-78ae69910347 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] No waiting events found dispatching network-vif-unplugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:19.400533 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-68f74c4d-5cc9-47ae-aa40-91bd7a53fa70 req-d5b688fa-7896-42e1-907d-78ae69910347 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-vif-unplugged-12c3b222-1d81-49f3-97f5-60154de00ec2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:14:19.463050 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.665476 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:19.703821 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:19.717715 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.882794 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Creating config drive at /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk.config
May 28 14:14:19.886377 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr3lf845p {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:19.905593 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='instance-depend-image',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:14:12Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb1797521824e3eb334e57554516577',ramdisk_id='',reservation_id='r-q8300dmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1134113524',owner_user_name='tempest-ImageDependencyTests-1134113524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:14:13Z,user_data=None,user_id='af9256b87bff41169f687e525ed03b2c',uuid=ed584e13-6fd9-4879-af22-995a2d47ceb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:14:19.913926 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Converting VIF {"id": "12c3b222-1d81-49f3-97f5-60154de00ec2", "address": "fa:16:3e:84:20:13", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12c3b222-1d", "ovs_interfaceid": "12c3b222-1d81-49f3-97f5-60154de00ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:19.917839 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:13,bridge_name='br-int',has_traffic_filtering=True,id=12c3b222-1d81-49f3-97f5-60154de00ec2,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12c3b222-1d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:19.921465 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:13,bridge_name='br-int',has_traffic_filtering=True,id=12c3b222-1d81-49f3-97f5-60154de00ec2,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12c3b222-1d') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:14:19.926956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.927967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12c3b222-1d, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:19.933877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.935145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:19.939750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.941489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.941677 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77c8516d-ecc8-41df-ad0f-b106852feb15) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:19.942282 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.943141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:19.948777 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:19.955634 np0000001643 nova-compute[98269]: INFO os_vif [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:20:13,bridge_name='br-int',has_traffic_filtering=True,id=12c3b222-1d81-49f3-97f5-60154de00ec2,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12c3b222-1d')
May 28 14:14:19.956494 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr3lf845p" returned: 0 in 0.070s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:19.958730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:14:19.959185 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:19.959355 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:20.043948 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:20.171918 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updated VIF entry in instance network info cache for port 9b754c38-a97e-4220-96e5-625800c5d818. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:14:20.172406 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:20.451865 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.485660 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.490823 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.600127 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.675165 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-099a2ecf-9e44-4542-b734-fe1231c34f5a req-99c8ba4c-5d75-4dc3-803f-6805a0586123 service nova] Releasing lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:20.819590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.857s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:20.819590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '79d29a5a-4281-46fd-b495-132885b4cb21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:14:20.819590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:14:20.848201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:20.848201 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:20.848201 np0000001643 nova-compute[98269]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:20.848201 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:20.848201 np0000001643 nova-compute[98269]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2beb5733-1c15-49ef-97d9-21ef643cfab3 (non-flash)
May 28 14:14:20.848201 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:20.848640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:20.848640 np0000001643 nova-compute[98269]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21 (non-flash)
May 28 14:14:20.848640 np0000001643 nova-compute[98269]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:20.848640 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:20.848640 np0000001643 nova-compute[98269]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2beb5733-1c15-49ef-97d9-21ef643cfab3 (non-flash)
May 28 14:14:20.848640 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:20.848988 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2beb5733-1c15-49ef-97d9-21ef643cfab3', '129')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:14:20.849267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '125')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:14:20.850731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21', '126')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:14:20.851586 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c173c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:14:20.851829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:14:20.852351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Flush multipath device 330000000d69788fd {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:14:20.867044 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.871435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.875604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.887970 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:14:20.902611 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.904742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:20.937395 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:14:20.988861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:14:20.989069 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:14:20.990245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:14:21.001424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:14:21.001648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:14:21.013055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:21.048985 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.40.100,3260]
May 28 14:14:21.048985 np0000001643 nova-compute[98269]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.40.100,3260] successful.
May 28 14:14:21.048985 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:21.065064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:21.077354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:21.107432 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.50.100,3260]
May 28 14:14:21.107432 np0000001643 nova-compute[98269]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-79d29a5a-4281-46fd-b495-132885b4cb21, portal: 192.168.50.100,3260] successful.
May 28 14:14:21.107432 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:21.124059 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:21.124567 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:21.124756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] <== disconnect_volume: return (1165ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:21.124911 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:14:21.125218 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Deleting instance files /opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6_del
May 28 14:14:21.126893 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Deletion of /opt/stack/data/nova/instances/ed584e13-6fd9-4879-af22-995a2d47ceb6_del complete
May 28 14:14:21.230152 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-vif-plugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:21.231779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:21.231998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:21.232165 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:21.232325 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Processing event network-vif-plugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:14:21.232504 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-vif-plugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:21.232676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:21.232892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:21.233033 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:21.233218 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] No waiting events found dispatching network-vif-plugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:21.233437 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b65d3928-58c9-4cf8-83ab-03223d04f63c req-8310556b-d9a3-47f8-a9a6-d482bc599402 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received unexpected event network-vif-plugged-06677b0d-9214-446b-8dfe-871a0743bb62 for instance with vm_state building and task_state spawning.
May 28 14:14:21.401268 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977661.4006853, eadb7b17-f3e3-46c7-9149-04c4b94fc699 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:21.402229 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] VM Started (Lifecycle Event)
May 28 14:14:21.405979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:14:21.415937 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:14:21.424125 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Instance spawned successfully.
May 28 14:14:21.424498 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:14:21.503395 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d69c2bed-35ed-46e6-a13c-0d561891fb91 req-1dbe702c-32b1-480c-b234-6cab30979138 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-vif-unplugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:21.505806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d69c2bed-35ed-46e6-a13c-0d561891fb91 req-1dbe702c-32b1-480c-b234-6cab30979138 service nova] Acquiring lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:21.505960 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d69c2bed-35ed-46e6-a13c-0d561891fb91 req-1dbe702c-32b1-480c-b234-6cab30979138 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:21.506525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d69c2bed-35ed-46e6-a13c-0d561891fb91 req-1dbe702c-32b1-480c-b234-6cab30979138 service nova] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:21.507239 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d69c2bed-35ed-46e6-a13c-0d561891fb91 req-1dbe702c-32b1-480c-b234-6cab30979138 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] No waiting events found dispatching network-vif-unplugged-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:21.507427 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d69c2bed-35ed-46e6-a13c-0d561891fb91 req-1dbe702c-32b1-480c-b234-6cab30979138 service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-vif-unplugged-12c3b222-1d81-49f3-97f5-60154de00ec2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:14:21.637198 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Took 2.59 seconds to destroy the instance on the hypervisor.
May 28 14:14:21.638122 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:14:21.638122 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:14:21.638241 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:14:21.638440 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:21.763403 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:21.908702 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:21.910475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:21.937467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:21.937467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:21.937467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:21.937467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:21.937467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:21.937467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:22.126752 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d500f0b9-ea14-49c5-a9cc-9d918f539560 req-4f2d82c2-5aaa-4757-8874-bcc922f3485e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Received event network-vif-deleted-12c3b222-1d81-49f3-97f5-60154de00ec2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:22.127290 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-d500f0b9-ea14-49c5-a9cc-9d918f539560 req-4f2d82c2-5aaa-4757-8874-bcc922f3485e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Neutron deleted interface 12c3b222-1d81-49f3-97f5-60154de00ec2; detaching it from the instance and deleting it from the info cache
May 28 14:14:22.129221 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d500f0b9-ea14-49c5-a9cc-9d918f539560 req-4f2d82c2-5aaa-4757-8874-bcc922f3485e service nova] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Detach interface failed, port_id=12c3b222-1d81-49f3-97f5-60154de00ec2, reason: Instance ed584e13-6fd9-4879-af22-995a2d47ceb6 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:14:22.416108 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:14:22.416598 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977662.416378, eadb7b17-f3e3-46c7-9149-04c4b94fc699 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:22.417534 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] VM Paused (Lifecycle Event)
May 28 14:14:22.443314 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Took 7.15 seconds to spawn the instance on the hypervisor.
May 28 14:14:22.443482 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:22.484727 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.000450980000096024 future=<Future at 0x71a75c2819d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:22.485315 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Emitting event <LifecycleEvent: 1779977647.4840858, 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:22.485522 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:22.486187 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] VM Stopped (Lifecycle Event)
May 28 14:14:22.488731 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=11.898408904999997 future=<Future at 0x71a7781577a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:22.488997 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=11.898066019999987 future=<Future at 0x71a7781577a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:22.570408 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:22.921103 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:22.923875 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977662.9235437, eadb7b17-f3e3-46c7-9149-04c4b94fc699 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:22.924009 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] VM Resumed (Lifecycle Event)
May 28 14:14:22.952540 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Took 12.77 seconds to build instance.
May 28 14:14:22.991295 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-85d44b63-1be9-4870-9729-83a068f6a69a tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 9f7f10a5-9f1e-4dd8-8cce-024d48cedd1d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:23.074169 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Took 1.43 seconds to deallocate network for instance.
May 28 14:14:23.426248 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:23.428235 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:23.454338 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ac40a3ed-e068-47fc-8eae-09395a5049f3 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.278s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:23.645995 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Took 0.57 seconds to detach 1 volumes for instance.
May 28 14:14:23.648387 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Deleting volume: 79d29a5a-4281-46fd-b495-132885b4cb21 {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:14:24.199525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:24.199525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:24.509431 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:24.618755 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:14:24.619306 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:14:24.722954 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:24.815318 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-changed-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:24.815723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Refreshing instance network info cache due to event network-changed-06677b0d-9214-446b-8dfe-871a0743bb62. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:24.815723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] Acquiring lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:24.815723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] Acquired lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:24.815893 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Refreshing network info cache for port 06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:24.943105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:25.123312 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:25.318165 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:25.631604 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.432s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:25.721693 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Deleted allocations for instance ed584e13-6fd9-4879-af22-995a2d47ceb6
May 28 14:14:25.823868 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:26.034787 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Updated VIF entry in instance network info cache for port 06677b0d-9214-446b-8dfe-871a0743bb62. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:14:26.035142 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Updating instance_info_cache with network_info: [{"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:26.509521 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:26.538031 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d5d222d8-80c0-4c5a-9014-68858d45eb4b req-4d06f28f-c21f-439c-919b-8452c8156e45 service nova] Releasing lock "refresh_cache-eadb7b17-f3e3-46c7-9149-04c4b94fc699" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:26.736501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3511de82-e105-4d05-a51e-f832ff42b99d tempest-ImageDependencyTests-1134113524 tempest-ImageDependencyTests-1134113524-project-member] Lock "ed584e13-6fd9-4879-af22-995a2d47ceb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.194s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:29.722874 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:29.831316 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:29.834072 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:29.837181 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:14:29.878684 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:29.944071 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:30.829844 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:30.830362 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:30.831207 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:30.831323 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:14:30.831573 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:14:31.660128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:31.827038 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:32.335808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:32.336299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:32.336299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:32.336299 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:14:33.366025 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:33.470318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:33.470871 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:33.581925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:33.583788 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:14:33.588134 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:33.682622 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:33.683092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:33.774333 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:33.778266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:33.867575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:33.868077 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:33.963373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:33.968623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:34.079369 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:34.084653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:34.177543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:34.181559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:34.274002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:34.274462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:34.373221 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:34.378682 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:14:34.379856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:34.392408 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.005219744999976683 future=<Future at 0x71a7781577a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:34.392640 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:34.396846 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Emitting event <LifecycleEvent: 1779977659.3869278, ed584e13-6fd9-4879-af22-995a2d47ceb6 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:34.396846 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] VM Stopped (Lifecycle Event)
May 28 14:14:34.443676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.064s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:34.444818 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12140MB free_disk=72.91740036010742GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:14:34.445015 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:34.445285 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:34.654622 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:34.654828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:34.723929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:34.902973 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: ed584e13-6fd9-4879-af22-995a2d47ceb6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:34.944565 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:35.158074 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:14:35.510059 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance bfac770e-7430-4353-9f3c-ec438536a7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:14:35.510415 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance eee1e472-9a54-4213-a0ca-aba7284297c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:14:35.510415 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance a95922fd-8d79-43bc-9052-e05f100abb79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:14:35.510415 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 5b580f8d-61fa-4994-822f-0500e14eeced actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:14:35.510593 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance eadb7b17-f3e3-46c7-9149-04c4b94fc699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:14:35.713147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:36.013607 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 6b39455c-17b2-46bd-9207-1791f639eb08 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 14:14:36.013821 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:14:36.013955 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:14:34 up 41 min,  2 users,  load average: 6.81, 6.17, 4.62\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_161531d31b404ab1bc2c6c340124f03d': '1', 'io_workload': '0', 'num_proj_1bd0a26536e743c9a9eaeb956fc55b79': '1', 'num_proj_816dec0e07ba4bd596fac38e7df5e9db': '1', 'num_proj_db1dc6979a244982823fef41c57d1c75': '1', 'num_proj_503ff5746ac94b068fca926067617b52': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:14:36.068283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:36.068998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:36.320201 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:14:36.320380 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:14:36.572238 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid eee1e472-9a54-4213-a0ca-aba7284297c5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:36.823550 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:37.329363 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:14:37.329654 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.884s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:37.330047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.617s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:37.330574 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:14:37.333413 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:14:37.336480 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Claim successful on node np0000001643
May 28 14:14:37.576982 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:38.645175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:38.647232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:38.647232 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Attaching volume c22fafc1-1be8-4494-91b9-677c0effbcf3 to /dev/vdb
May 28 14:14:38.687083 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:38.699075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:14:38.719972 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:14:38.720269 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:14:38.728110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:38.771934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:14:38.772976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:14:38.784517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:14:38.784517 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef7:2f79', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe74:4b01', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe05:3b49', 'fe80::64c0:f7ff:fe14:ca9b', 'fe80::fc16:3eff:fe6b:b3c8', 'fe80::9885:a1ff:feb8:60ba'] 
May 28 14:14:38.784517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:14:38.784517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:14:38.784517 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:38.784517 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Updating existing volume attachment record: c62789aa-f400-4937-baac-3ab8c4372264 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:14:39.223229 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:39.349102 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:14:39.349102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c22fafc1-1be8-4494-91b9-677c0effbcf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:39.349102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:39.349102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:39.349102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c22fafc1-1be8-4494-91b9-677c0effbcf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:14:39.361393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:39.361903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:39.362220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:39.362382 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:39.362826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:39.363043 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:39.374547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:39.374547 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:39.377164 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:39.377164 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:39.384730 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3] added
May 28 14:14:39.384730 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:39.384730 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:39.384730 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:39.384730 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:39.384730 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:39.384730 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:39.385024 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:39.385185 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:39.385293 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:39.388461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3] added
May 28 14:14:39.388461 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:39.388461 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:39.388461 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:39.388461 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:39.388461 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:39.388461 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:39.388679 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:39.388797 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:39.388967 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:39.726275 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:39.730950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.401s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:39.731303 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:14:39.945825 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:40.239730 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:14:40.240172 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:14:40.240802 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:40.240943 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:40.315642 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:14:40.385775 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:40.390846 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:40.404427 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:40.404427 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:40.410561 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:40.410561 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.420826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.424875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.437547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.437547 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.437547 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.437547 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:40.437826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.437826 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.437826 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.437826 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:40.444184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.444184 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.444184 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.444184 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:40.444551 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.444551 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.444551 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.444551 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:40.474671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.40.100,3260]
May 28 14:14:40.474671 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.40.100,3260] successful.
May 28 14:14:40.474671 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.480315 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.50.100,3260]
May 28 14:14:40.480315 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.50.100,3260] successful.
May 28 14:14:40.480315 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.488861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.494147 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:40.505897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.505897 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.505897 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.505897 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.505897 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.505897 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:40.506247 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.506247 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.506247 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.506247 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.506247 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.506247 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:40.506398 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:40.506507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:40.507267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('8', '-', '-', 0) found on session 131 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:40.507364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:40.512716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.512716 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.512716 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.512716 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.512716 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.512716 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:40.512939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.512939 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:40.512939 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:40.512939 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.512939 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:40.512939 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:40.513259 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:40.513737 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:40.515406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] HCTL ('11', '-', '-', 0) found on session 132 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:40.515560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:40.528897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 131 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:40.529055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c22fafc1-1be8-4494-91b9-677c0effbcf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:40.537179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 132 and hctl ['11', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:40.701600 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:40.743309 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:14:40.883946 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Successfully created port: 46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:14:41.249668 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:14:41.330578 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:41.331068 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:41.331638 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:14:41.331638 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:14:41.374127 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Successfully updated port: 46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:14:41.393029 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:41.393810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:41.427067 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-changed-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:41.427231 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Refreshing instance network info cache due to event network-changed-46042212-fbbe-4c2c-8af9-af9381a5dff7. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:14:41.428258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] Acquiring lock "refresh_cache-6b39455c-17b2-46bd-9207-1791f639eb08" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:41.428258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] Acquired lock "refresh_cache-6b39455c-17b2-46bd-9207-1791f639eb08" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:41.428339 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Refreshing network info cache for port 46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:14:41.542215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Searching for a device in session 132 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:41.542337 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c22fafc1-1be8-4494-91b9-677c0effbcf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:41.754369 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Booting with volume 56aad7f5-1779-4a24-a5c9-d35b1c7e30cd at /dev/vda
May 28 14:14:41.788868 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:41.798999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:14:41.818009 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:41.857284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:14:41.857632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:14:41.865721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:14:41.866949 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef7:2f79', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe74:4b01', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe05:3b49', 'fe80::64c0:f7ff:fe14:ca9b', 'fe80::fc16:3eff:fe6b:b3c8', 'fe80::9885:a1ff:feb8:60ba'] 
May 28 14:14:41.867058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:14:41.867172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:14:41.867378 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:41.867595 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Updating existing volume attachment record: c6b8a380-80c4-471b-8159-d348085edfa7 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:14:41.877584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-6b39455c-17b2-46bd-9207-1791f639eb08" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:14:41.897900 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:41.930387 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:42.040572 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:42.049198 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:14:42.183139 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:42.381107 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found WWN 330000000809de523 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:14:42.381632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:42.381876 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000809de523', 'path': '/dev/dm-0', 'multipath_id': '330000000809de523'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:42.382039 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000809de523', 'path': '/dev/dm-0', 'multipath_id': '330000000809de523'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:14:42.387009 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid eee1e472-9a54-4213-a0ca-aba7284297c5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:42.686602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-cb23eb28-6a87-4c80-9472-6ff47f440e28 req-d3c8a473-3ab9-47e5-a5fb-75d917cba8b8 service nova] Releasing lock "refresh_cache-6b39455c-17b2-46bd-9207-1791f639eb08" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:42.687086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-6b39455c-17b2-46bd-9207-1791f639eb08" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:14:42.687414 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:14:42.891325 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Attempting to attach volume c22fafc1-1be8-4494-91b9-677c0effbcf3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:14:42.893080 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:14:42.893080 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:14:42.893080 np0000001643 nova-compute[98269]:   <alias name="ua-c22fafc1-1be8-4494-91b9-677c0effbcf3"/>
May 28 14:14:42.893080 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:14:42.893080 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:14:42.893080 np0000001643 nova-compute[98269]:   <serial>c22fafc1-1be8-4494-91b9-677c0effbcf3</serial>
May 28 14:14:42.893080 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:14:42.893080 np0000001643 nova-compute[98269]: </disk>
May 28 14:14:42.893080 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:14:42.911470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:43.267519 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:14:43.441337 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:43.599298 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Updating instance_info_cache with network_info: [{"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:43.963240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:14:43.964195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:14:43.964391 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Creating image(s)
May 28 14:14:43.964653 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:14:43.964784 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Ensure instance console log exists: /opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:14:43.964966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:43.965112 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:43.965225 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:44.002328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:44.002500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:44.002680 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attaching volume c7985125-715e-422f-97cc-2686f5ee33dc to /dev/vdb
May 28 14:14:44.037136 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:44.047238 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:14:44.067304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:44.103577 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-6b39455c-17b2-46bd-9207-1791f639eb08" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:14:44.104250 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Instance network_info: |[{"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:14:44.105222 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Start _get_guest_xml network_info=[{"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'c6b8a380-80c4-471b-8159-d348085edfa7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6b39455c-17b2-46bd-9207-1791f639eb08', 'attached_at': '', 'detached_at': '', 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'serial': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:14:44.105977 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:14:44.106227 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:14:44.112538 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:14:44.113982 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1154747943', uuid='6b39455c-17b2-46bd-9207-1791f639eb08'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977684.1135473) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:14:44.116053 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:14:44.116528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:14:44.117875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:14:44.118050 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef7:2f79', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe74:4b01', 'fe80::6cc2:e7ff:fe01:e7fd', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe05:3b49', 'fe80::64c0:f7ff:fe14:ca9b', 'fe80::fc16:3eff:fe6b:b3c8', 'fe80::9885:a1ff:feb8:60ba'] 
May 28 14:14:44.118172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:14:44.118267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:14:44.118486 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:44.118733 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating existing volume attachment record: ad67512e-caff-424c-ba70-982823b0d026 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:14:44.121666 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:14:44.122065 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:14:44.123178 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:14:44.123532 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:14:44.123822 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:14:44.123928 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:14:44.124143 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:14:44.124282 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:14:44.124331 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:14:44.124522 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:14:44.124632 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:14:44.124772 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:14:44.124883 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:14:44.125013 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:14:44.138038 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:14:44.138410 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:44.138590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:44.139022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:44.139233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:14:44.151063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:44.152292 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:44.152292 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:44.152827 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:44.152827 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:44.152976 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:44.164116 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:44.164116 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:44.169834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:44.169834 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:44.174198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd] added
May 28 14:14:44.174198 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:44.174198 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:44.174198 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:44.174198 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:44.174198 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:44.174198 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:44.174375 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:44.174569 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:44.174763 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:44.181623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd] added
May 28 14:14:44.181623 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:44.181623 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:44.181623 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:44.181623 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:44.181623 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:44.181623 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:44.181866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:44.181900 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:44.182036 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:44.565913 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:44.566104 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:44.566150 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:44.566281 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] No VIF found with MAC fa:16:3e:74:4b:01, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:14:44.687502 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:14:44.687502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7985125-715e-422f-97cc-2686f5ee33dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:44.687502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:44.729340 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:44.946802 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:45.175195 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:45.182410 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:45.189408 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:45.189408 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:45.195539 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:45.195539 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.202755 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.209079 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.218239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.218239 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.218239 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.218239 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.218239 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.218239 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:45.218492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.218492 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.218492 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.218492 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.218492 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.218492 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:45.224463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.224463 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.224463 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.224463 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.224463 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.224463 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:45.224920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.224920 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.224920 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.224920 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.224920 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.224920 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:45.260335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.40.100,3260]
May 28 14:14:45.260335 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.40.100,3260] successful.
May 28 14:14:45.260335 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.272866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.277880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.50.100,3260]
May 28 14:14:45.277880 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.50.100,3260] successful.
May 28 14:14:45.277880 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.288631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.288631 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.288631 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.288631 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.288631 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.288631 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.288631 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.288631 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:45.288860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.288860 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.288860 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.288860 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.288860 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.288860 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.288860 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.288860 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:45.289026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:45.289095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:45.289544 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:45.292253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('12', '-', '-', 0) found on session 133 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:45.292253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:45.309096 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:45.309422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:45.309422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:45.311287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 133 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:45.311287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:45.311287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('13', '-', '-', 0) found on session 134 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:45.311500 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:45.327984 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 134 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:45.327984 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:46.121648 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c75e56be-2c20-429f-8a1e-1302b64a01ee tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.475s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:46.153331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:14:46.637677 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:46.638079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:47.141141 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Detaching volume c22fafc1-1be8-4494-91b9-677c0effbcf3
May 28 14:14:47.168431 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 3300000003220df20 for multipath device dm-2 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:14:47.169369 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:47.170008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000003220df20', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '3300000003220df20'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:47.170257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003220df20', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '3300000003220df20'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:14:47.170505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.484s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:47.170631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7985125-715e-422f-97cc-2686f5ee33dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:14:47.184065 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:47.184822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:47.185102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:47.185308 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:47.185682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:47.186042 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:47.188585 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Attempting to driver detach volume c22fafc1-1be8-4494-91b9-677c0effbcf3 from mountpoint /dev/vdb
May 28 14:14:47.199574 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdb by alias ua-c22fafc1-1be8-4494-91b9-677c0effbcf3 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:14:47.201582 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:47.201582 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:47.203096 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Found disk vdb by alias ua-c22fafc1-1be8-4494-91b9-677c0effbcf3 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:14:47.203705 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Attempting to detach device vdb from instance eee1e472-9a54-4213-a0ca-aba7284297c5 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:14:47.204008 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:   <alias name="ua-c22fafc1-1be8-4494-91b9-677c0effbcf3"/>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:   <serial>c22fafc1-1be8-4494-91b9-677c0effbcf3</serial>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]: </disk>
May 28 14:14:47.204008 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:14:47.210069 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdb from instance eee1e472-9a54-4213-a0ca-aba7284297c5 from the persistent domain config.
May 28 14:14:47.210244 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] (1/8): Attempting to detach device vdb with device alias ua-c22fafc1-1be8-4494-91b9-677c0effbcf3 from instance eee1e472-9a54-4213-a0ca-aba7284297c5 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:14:47.210621 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:   <alias name="ua-c22fafc1-1be8-4494-91b9-677c0effbcf3"/>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:   <serial>c22fafc1-1be8-4494-91b9-677c0effbcf3</serial>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:   <shareable/>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]: </disk>
May 28 14:14:47.210621 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:14:47.211359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:14:47.211359 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:47.213966 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '6b39455c-17b2-46bd-9207-1791f639eb08', 'attached_at': '', 'detached_at': '', 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'serial': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:14:47.214581 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:14:47.214833 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:14:47.214913 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:14:47.223943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc] added
May 28 14:14:47.223943 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:47.223943 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:47.223943 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:47.223943 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:47.223943 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:47.223943 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:47.224243 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:47.224387 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:47.225258 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc] added
May 28 14:14:47.225258 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:14:47.225258 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:47.225258 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:47.225258 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:14:47.225258 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:14:47.225258 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:47.225567 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:47.225827 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:14:47.226037 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:14:47.226191 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:14:47.238858 np0000001643 nova-compute[98269]: WARNING os_brick.encryptors.luks [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 14:14:47.239176 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:14:47.239315 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:14:47.239464 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:14:47.239932 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x71a75c14e450>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '6b39455c-17b2-46bd-9207-1791f639eb08', 'attached_at': '', 'detached_at': '', 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'serial': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:14:47.240063 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] formatting encrypted volume /dev/dm-2 {{(pid=98269) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 14:14:47.709395 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977687.7090392, eee1e472-9a54-4213-a0ca-aba7284297c5 => ua-c22fafc1-1be8-4494-91b9-677c0effbcf3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:14:47.710150 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c22fafc1-1be8-4494-91b9-677c0effbcf3 for instance eee1e472-9a54-4213-a0ca-aba7284297c5 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:14:47.712254 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully detached device vdb from instance eee1e472-9a54-4213-a0ca-aba7284297c5 from the live domain config.
May 28 14:14:47.747330 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:14:47.747650 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c22fafc1-1be8-4494-91b9-677c0effbcf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:14:47.747866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:14:48.226693 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:14:48.226802 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:48.239632 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:48.239632 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:14:48.249590 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:14:48.249590 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.258818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.264596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.275066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.275066 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.275066 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.275066 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.275066 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.275066 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.275066 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.275066 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:48.275327 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.275327 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.275327 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.275327 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.275327 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.275327 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.275327 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.275327 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:48.283865 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.283865 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.283865 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.283865 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.283865 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.283865 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.283865 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.283865 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:48.284096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.284096 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.284096 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.284096 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.284096 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.284096 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.284096 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.284096 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:48.321835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.50.100,3260]
May 28 14:14:48.321835 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.50.100,3260] successful.
May 28 14:14:48.321835 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.336573 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.343350 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.40.100,3260]
May 28 14:14:48.343350 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.40.100,3260] successful.
May 28 14:14:48.343350 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.355042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.356198 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.356440 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:48.356727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:48.356862 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:48.357952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('14', '-', '-', 0) found on session 135 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:48.358088 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:48.375308 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:48.375308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:14:48.375965 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('15', '-', '-', 0) found on session 136 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:14:48.375965 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:14:48.376529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 135 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:48.378464 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c7985125-715e-422f-97cc-2686f5ee33dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:48.392311 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 136 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:14:48.392526 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7985125-715e-422f-97cc-2686f5ee33dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:14:49.186542 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:14:49.730706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:49.948139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:50.207091 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found WWN 330000000865bf761 for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:14:50.207091 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:50.207091 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== connect_volume: return (5519ms) {'type': 'block', 'scsi_wwn': '330000000865bf761', 'path': '/dev/dm-3', 'multipath_id': '330000000865bf761'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:50.207091 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000865bf761', 'path': '/dev/dm-3', 'multipath_id': '330000000865bf761'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:14:50.207772 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.459s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:14:50.207772 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c22fafc1-1be8-4494-91b9-677c0effbcf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:14:50.207921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:14:50.210845 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3 (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:14:50.236304 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-966a432a-8784-483e-a129-058c75ed416f', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '136')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:14:50.236304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', '131')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:14:50.239779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3', '132')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:14:50.239779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a78049e160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:14:50.239779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Removing multipathed devices sdf, sdc {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:14:50.239779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Flush multipath device 330000000809de523 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:14:50.274354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:14:50.332105 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:14:50.377013 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:14:50.377013 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:14:50.377013 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:14:50.391314 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:14:50.391314 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:14:50.403851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:50.441102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.40.100,3260]
May 28 14:14:50.441102 np0000001643 nova-compute[98269]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.40.100,3260] successful.
May 28 14:14:50.441102 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:50.459810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:50.471791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:50.507938 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.50.100,3260]
May 28 14:14:50.507938 np0000001643 nova-compute[98269]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-c22fafc1-1be8-4494-91b9-677c0effbcf3, portal: 192.168.50.100,3260] successful.
May 28 14:14:50.507938 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:50.528426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:14:50.531473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:14:50.531473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] <== disconnect_volume: return (2781ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:14:50.531473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:14:50.713476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to attach volume c7985125-715e-422f-97cc-2686f5ee33dc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:14:50.715214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:14:50.715214 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:14:50.715214 np0000001643 nova-compute[98269]:   <alias name="ua-c7985125-715e-422f-97cc-2686f5ee33dc"/>
May 28 14:14:50.715214 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:14:50.715214 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:14:50.715214 np0000001643 nova-compute[98269]:   <serial>c7985125-715e-422f-97cc-2686f5ee33dc</serial>
May 28 14:14:50.715214 np0000001643 nova-compute[98269]: </disk>
May 28 14:14:50.715214 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:14:51.092984 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'flavor' on Instance uuid eee1e472-9a54-4213-a0ca-aba7284297c5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:51.184989 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:14:51.184989 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:14:51.184989 np0000001643 nova-compute[98269]:     <volume>56aad7f5-1779-4a24-a5c9-d35b1c7e30cd</volume>
May 28 14:14:51.184989 np0000001643 nova-compute[98269]:   </usage>
May 28 14:14:51.184989 np0000001643 nova-compute[98269]: </secret>
May 28 14:14:51.184989 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:14:51.694834 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1154747943',display_name='tempest-TestVolumeBootPattern-server-1154747943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1154747943',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-v333pnmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:41Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=6b39455c-17b2-46bd-9207-1791f639eb08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:14:51.695275 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:51.695645 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:56,bridge_name='br-int',has_traffic_filtering=True,id=46042212-fbbe-4c2c-8af9-af9381a5dff7,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46042212-fb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:51.696673 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b39455c-17b2-46bd-9207-1791f639eb08 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:52.098248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86d30c4c-262d-4a23-990d-bd3d823914f9 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.460s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:52.201061 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] End _get_guest_xml xml=<domain type="qemu">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <uuid>6b39455c-17b2-46bd-9207-1791f639eb08</uuid>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <name>instance-00000036</name>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-1154747943</nova:name>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:14:44</nova:creationTime>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:properties/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <nova:port uuid="46042212-fbbe-4c2c-8af9-af9381a5dff7">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <system>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <entry name="serial">6b39455c-17b2-46bd-9207-1791f639eb08</entry>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <entry name="uuid">6b39455c-17b2-46bd-9207-1791f639eb08</entry>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </system>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <os>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   </os>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <features>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   </features>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   <devices>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08/disk.config"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <alias name="ua-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <serial>56aad7f5-1779-4a24-a5c9-d35b1c7e30cd</serial>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <encryption format="luks">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:         <secret type="passphrase" uuid="4a0bd9ac-34f8-40a3-8f9a-92f00a88591e"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       </encryption>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </disk>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:28:95:56"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <target dev="tap46042212-fb"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </interface>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08/console.log" append="off"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </serial>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <video>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </video>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </rng>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:   </devices>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]: </domain>
May 28 14:14:52.201061 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:14:52.203082 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Preparing to wait for external event network-vif-plugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:14:52.203082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:52.203082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:52.203082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:52.203082 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1154747943',display_name='tempest-TestVolumeBootPattern-server-1154747943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1154747943',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-v333pnmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:14:41Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=6b39455c-17b2-46bd-9207-1791f639eb08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:14:52.203082 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:52.203309 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:56,bridge_name='br-int',has_traffic_filtering=True,id=46042212-fbbe-4c2c-8af9-af9381a5dff7,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46042212-fb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:52.203603 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:56,bridge_name='br-int',has_traffic_filtering=True,id=46042212-fbbe-4c2c-8af9-af9381a5dff7,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46042212-fb') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:14:52.204019 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:52.204249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:52.204453 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:14:52.205512 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:52.205658 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53bf3e62-a198-50cb-b9b8-5b88c783d4cd', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:52.206341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:52.211634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:52.211634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:52.211634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46042212-fb, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:52.211634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46042212-fb, col_values=(('qos', UUID('47afc641-68bd-4558-a84f-470262216334')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:52.211634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46042212-fb, col_values=(('external_ids', {'iface-id': '46042212-fbbe-4c2c-8af9-af9381a5dff7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:95:56', 'vm-uuid': '6b39455c-17b2-46bd-9207-1791f639eb08'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:52.213716 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:52.214738 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:52.217297 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:52.218387 np0000001643 nova-compute[98269]: INFO os_vif [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:56,bridge_name='br-int',has_traffic_filtering=True,id=46042212-fbbe-4c2c-8af9-af9381a5dff7,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46042212-fb')
May 28 14:14:52.356588 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:52.356812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:52.356936 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:52.357053 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No VIF found with MAC fa:16:3e:12:ea:68, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:14:53.311834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:53.312224 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:53.312224 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:53.312830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:53.312981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:53.316160 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Terminating instance
May 28 14:14:53.738300 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:53.738434 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:14:53.738511 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:28:95:56, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:14:53.738918 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Using config drive
May 28 14:14:53.819205 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:14:53.843532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:53.847563 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:53.864687 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:53.868008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:53.903950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:53.915839 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-833417dc-e351-4124-b045-26e4351fef4d tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.912s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:54.008217 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-73e9b44e-a69b-4683-bf61-065554113ffa req-8cb0d2bb-1c1d-40e2-b3d0-a57faef883cb service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-vif-unplugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:54.009216 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-73e9b44e-a69b-4683-bf61-065554113ffa req-8cb0d2bb-1c1d-40e2-b3d0-a57faef883cb service nova] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:54.009544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-73e9b44e-a69b-4683-bf61-065554113ffa req-8cb0d2bb-1c1d-40e2-b3d0-a57faef883cb service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:54.009948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-73e9b44e-a69b-4683-bf61-065554113ffa req-8cb0d2bb-1c1d-40e2-b3d0-a57faef883cb service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:54.010242 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-73e9b44e-a69b-4683-bf61-065554113ffa req-8cb0d2bb-1c1d-40e2-b3d0-a57faef883cb service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] No waiting events found dispatching network-vif-unplugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:54.010517 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-73e9b44e-a69b-4683-bf61-065554113ffa req-8cb0d2bb-1c1d-40e2-b3d0-a57faef883cb service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-vif-unplugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:14:54.147671 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99965292800016 future=<Future at 0x71a75c18cb60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:54.148569 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Instance destroyed successfully.
May 28 14:14:54.149202 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lazy-loading 'resources' on Instance uuid eee1e472-9a54-4213-a0ca-aba7284297c5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:14:54.151233 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.996919775000151 future=<Future at 0x71a75c18cb60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:54.151422 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.995916204999958 future=<Future at 0x71a75c18cb60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:54.244300 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:54.366114 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Creating config drive at /opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08/disk.config
May 28 14:14:54.369314 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnvdjo7no {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:14:54.426659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnvdjo7no" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:14:54.653520 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1773821913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumemultiattachtests-server-1773821913',id=49,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0RVMtZNhpjNinm8LT6S/lQmXRaqEACYUmnYO+GCnv4tWH2kgY4R1WoypSEuAr+Xg+GvA6F+rqwQrFaHL8IbEQPIRnR9FvYDna/7R6AO97r7GBKKEEDeEISLwkiAhrq4w==',key_name='tempest-keypair-256979471',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:13:56Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bd0a26536e743c9a9eaeb956fc55b79',ramdisk_id='',reservation_id='r-8g4mdbtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-761556748',owner_user_name='tempest-VolumeMultiattachTests-761556748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='443210af2282478b862d252bfa3bb611',uuid=eee1e472-9a54-4213-a0ca-aba7284297c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:14:54.653878 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converting VIF {"id": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "address": "fa:16:3e:74:4b:01", "network": {"id": "9edc3321-58f6-4269-bae2-9cc435d79ca4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1687642644-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1bd0a26536e743c9a9eaeb956fc55b79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87fdcb95-0e", "ovs_interfaceid": "87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:14:54.654799 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcb95-0e') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:14:54.655145 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcb95-0e') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:14:54.657042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.657398 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87fdcb95-0e, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:54.658832 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.661606 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:54.665077 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.666101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.666247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ffc1171-a00d-40a7-868c-655a92947b71) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:14:54.667378 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.667883 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:14:54.671811 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.673666 np0000001643 nova-compute[98269]: INFO os_vif [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:4b:01,bridge_name='br-int',has_traffic_filtering=True,id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2,network=Network(9edc3321-58f6-4269-bae2-9cc435d79ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87fdcb95-0e')
May 28 14:14:54.673985 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Deleting instance files /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5_del
May 28 14:14:54.674759 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Deletion of /opt/stack/data/nova/instances/eee1e472-9a54-4213-a0ca-aba7284297c5_del complete
May 28 14:14:54.731255 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.834597 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.856372 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.856372 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:54.944274 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:55.188160 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 14:14:55.189183 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:14:55.189427 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:14:55.189587 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:14:55.189973 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:55.198875 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:55.204170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:55.206123 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:55.228619 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:55.263609 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:14:55.780672 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-04e8ea54-bba1-4824-8e73-0c1928ddb89f req-01b3ee5a-88ac-4a38-901e-beb50a8fd419 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-vif-deleted-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:55.780997 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-04e8ea54-bba1-4824-8e73-0c1928ddb89f req-01b3ee5a-88ac-4a38-901e-beb50a8fd419 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Neutron deleted interface 87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2; detaching it from the instance and deleting it from the info cache
May 28 14:14:55.782736 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-04e8ea54-bba1-4824-8e73-0c1928ddb89f req-01b3ee5a-88ac-4a38-901e-beb50a8fd419 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Detach interface failed, port_id=87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2, reason: Instance eee1e472-9a54-4213-a0ca-aba7284297c5 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:14:56.084793 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-vif-unplugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:56.085360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Acquiring lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:56.085360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:56.085360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:56.085472 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] No waiting events found dispatching network-vif-unplugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:56.085655 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Received event network-vif-unplugged-87fdcb95-0ede-4ba6-ba7a-7054c7ccc1e2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:14:56.085700 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-vif-plugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:56.085803 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:56.085974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:56.086110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:56.086211 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Processing event network-vif-plugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:14:56.086325 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-vif-plugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:56.086436 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:56.086789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:56.086917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:56.087241 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] No waiting events found dispatching network-vif-plugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:56.087366 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-dac47c69-949b-4c5e-8800-52210e0d7492 req-9c8520b2-c494-4fd5-976c-4ca84ea05024 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received unexpected event network-vif-plugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 for instance with vm_state building and task_state spawning.
May 28 14:14:56.237365 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:14:56.561539 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977696.5611713, 6b39455c-17b2-46bd-9207-1791f639eb08 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:56.561871 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] VM Started (Lifecycle Event)
May 28 14:14:56.563012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:14:56.565782 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:14:56.569315 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Instance spawned successfully.
May 28 14:14:56.569655 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:14:56.739300 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Took 1.55 seconds to deallocate network for instance.
May 28 14:14:57.065018 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:57.066868 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:57.077897 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:57.078054 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:57.078336 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:57.078618 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:57.078927 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:57.079157 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:14:57.247187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:57.247381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:57.571208 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:14:57.571208 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977697.570982, 6b39455c-17b2-46bd-9207-1791f639eb08 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:57.571350 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] VM Paused (Lifecycle Event)
May 28 14:14:57.576972 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:14:57.576972 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:14:57.585823 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Took 13.62 seconds to spawn the instance on the hypervisor.
May 28 14:14:57.586475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:58.075053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:58.076774 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977698.0765743, 6b39455c-17b2-46bd-9207-1791f639eb08 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:14:58.076892 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] VM Resumed (Lifecycle Event)
May 28 14:14:58.079837 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:14:58.094045 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Took 22.43 seconds to build instance.
May 28 14:14:58.487389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:58.487673 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:58.487823 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Shelving
May 28 14:14:58.585440 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:14:58.587518 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:14:58.590750 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.343s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:58.599701 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.945s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:58.643710 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Deleted allocations for instance eee1e472-9a54-4213-a0ca-aba7284297c5
May 28 14:14:59.520933 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:59.523460 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:59.557101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:59.583691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:59.654922 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7080605d-7a8b-4067-858e-bef62477cc92 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Lock "eee1e472-9a54-4213-a0ca-aba7284297c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.343s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:59.667320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:59.707534 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-567164f4-61ba-41b0-9f88-abc0e82d8529 req-1097ab9c-8c83-4faa-9c63-2881a28654c8 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:14:59.707979 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-567164f4-61ba-41b0-9f88-abc0e82d8529 req-1097ab9c-8c83-4faa-9c63-2881a28654c8 service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:14:59.708180 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-567164f4-61ba-41b0-9f88-abc0e82d8529 req-1097ab9c-8c83-4faa-9c63-2881a28654c8 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:14:59.708939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-567164f4-61ba-41b0-9f88-abc0e82d8529 req-1097ab9c-8c83-4faa-9c63-2881a28654c8 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:14:59.709344 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-567164f4-61ba-41b0-9f88-abc0e82d8529 req-1097ab9c-8c83-4faa-9c63-2881a28654c8 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] No waiting events found dispatching network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:14:59.709548 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-567164f4-61ba-41b0-9f88-abc0e82d8529 req-1097ab9c-8c83-4faa-9c63-2881a28654c8 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received unexpected event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 for instance with vm_state active and task_state shelving.
May 28 14:14:59.733071 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:14:59.852648 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999680788000205 future=<Future at 0x71a75c36c230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:14:59.855148 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance destroyed successfully.
May 28 14:14:59.855729 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:00.001631 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:00.001875 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:00.002041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:00.002170 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:00.002279 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:00.004259 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Terminating instance
May 28 14:15:00.442330 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Beginning cold snapshot process
May 28 14:15:00.510794 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:15:00.533587 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:00.536803 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:00.557639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:00.590495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:00.814641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:00.825607 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:00.837132 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999695826000334 future=<Future at 0x71a7801ed310 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:00.838417 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Instance destroyed successfully.
May 28 14:15:00.843135 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid 6b39455c-17b2-46bd-9207-1791f639eb08 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:01.146557 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:01.146747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:01.345172 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1154747943',display_name='tempest-TestVolumeBootPattern-server-1154747943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1154747943',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:14:57Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-v333pnmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:14:58Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=6b39455c-17b2-46bd-9207-1791f639eb08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:15:01.345383 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "address": "fa:16:3e:28:95:56", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46042212-fb", "ovs_interfaceid": "46042212-fbbe-4c2c-8af9-af9381a5dff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:01.346017 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:56,bridge_name='br-int',has_traffic_filtering=True,id=46042212-fbbe-4c2c-8af9-af9381a5dff7,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46042212-fb') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:01.346274 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:56,bridge_name='br-int',has_traffic_filtering=True,id=46042212-fbbe-4c2c-8af9-af9381a5dff7,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46042212-fb') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:15:01.347826 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:01.348098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46042212-fb, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:01.350465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:01.354938 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:01.355787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:01.355988 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47afc641-68bd-4558-a84f-470262216334) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:01.356501 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:01.357058 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:01.361822 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:01.363710 np0000001643 nova-compute[98269]: INFO os_vif [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:56,bridge_name='br-int',has_traffic_filtering=True,id=46042212-fbbe-4c2c-8af9-af9381a5dff7,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46042212-fb')
May 28 14:15:01.366078 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:01.367123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:01.367123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:01.367123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:01.367304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:01.367365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:01.397484 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:01.397484 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:01.397484 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:15:01.397484 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:15:01.397484 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:01.397484 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:01.397484 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:01.397804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:01.397804 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:01.397804 np0000001643 nova-compute[98269]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:15:01.397804 np0000001643 nova-compute[98269]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd (non-flash)
May 28 14:15:01.397804 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:01.397804 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:01.397804 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:01.397804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '136')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:01.398013 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', '133')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:01.398709 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd', '134')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:01.399370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c173920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'): ({'sdh'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:01.399575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sdg, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:15:01.399800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 3300000003220df20 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:15:01.439323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:01.498183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:01.552860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:15:01.553284 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:15:01.554033 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:15:01.566299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:15:01.566606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:01.580081 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:01.613603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.40.100,3260]
May 28 14:15:01.613603 np0000001643 nova-compute[98269]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.40.100,3260] successful.
May 28 14:15:01.613603 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:01.631144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:01.642602 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:01.650202 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'flavor' on Instance uuid eadb7b17-f3e3-46c7-9149-04c4b94fc699 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:01.676470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.50.100,3260]
May 28 14:15:01.676470 np0000001643 nova-compute[98269]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-56aad7f5-1779-4a24-a5c9-d35b1c7e30cd, portal: 192.168.50.100,3260] successful.
May 28 14:15:01.676470 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:01.691683 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:01.692126 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:01.692126 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (325ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:01.692281 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:01.692541 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Deleting instance files /opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08_del
May 28 14:15:01.692962 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Deletion of /opt/stack/data/nova/instances/6b39455c-17b2-46bd-9207-1791f639eb08_del complete
May 28 14:15:01.779372 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:01.779577 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:01.779726 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:01.780017 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:01.780568 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] No waiting events found dispatching network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:01.780780 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received unexpected event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 14:15:01.780780 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-vif-unplugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:01.781011 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:01.781088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:01.781297 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:01.781297 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] No waiting events found dispatching network-vif-unplugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:01.781379 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-vif-unplugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:01.781571 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-vif-unplugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:01.781625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Acquiring lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:01.781745 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:01.781845 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] Lock "6b39455c-17b2-46bd-9207-1791f639eb08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:01.781945 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] No waiting events found dispatching network-vif-unplugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:01.782040 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9bfd571-0805-465a-9bff-3a1d25111873 req-997fd4df-1af9-4808-adc4-dbc98530d811 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-vif-unplugged-46042212-fbbe-4c2c-8af9-af9381a5dff7 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:01.957426 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:15:01.957737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk /opt/stack/data/nova/instances/snapshots/tmp7ivfhbi1/cfe9a72646fb481e8f5daa3bd97f4249 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:02.159309 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Ignoring supplied device name: /dev/vdb
May 28 14:15:02.205860 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Took 1.69 seconds to destroy the instance on the hypervisor.
May 28 14:15:02.210358 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:15:02.211644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:15:02.211644 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:15:02.211644 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:02.226894 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk /opt/stack/data/nova/instances/snapshots/tmp7ivfhbi1/cfe9a72646fb481e8f5daa3bd97f4249" returned: 0 in 0.269s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:02.227246 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Snapshot extracted, beginning image upload
May 28 14:15:02.286182 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:02.461095 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:02.595148 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-866df5da-e65b-4481-9928-c044e913b8b7 req-0e9ec2cc-de31-4868-bd74-0453ed13c5a1 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Received event network-vif-deleted-46042212-fbbe-4c2c-8af9-af9381a5dff7 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:02.595826 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-866df5da-e65b-4481-9928-c044e913b8b7 req-0e9ec2cc-de31-4868-bd74-0453ed13c5a1 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Neutron deleted interface 46042212-fbbe-4c2c-8af9-af9381a5dff7; detaching it from the instance and deleting it from the info cache
May 28 14:15:02.598332 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-866df5da-e65b-4481-9928-c044e913b8b7 req-0e9ec2cc-de31-4868-bd74-0453ed13c5a1 service nova] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Detach interface failed, port_id=46042212-fbbe-4c2c-8af9-af9381a5dff7, reason: Instance 6b39455c-17b2-46bd-9207-1791f639eb08 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:15:02.666644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:03.041247 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:03.543406 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Took 1.33 seconds to deallocate network for instance.
May 28 14:15:03.827305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:03.827659 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:03.827844 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Attaching volume 0549aaef-1d53-481d-9953-5e23fed37a3a to /dev/vdb
May 28 14:15:03.870004 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:03.881409 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:15:03.903003 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:03.952839 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:15:03.953122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:15:03.963545 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:15:03.968980 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fef7:2f79', 'fe80::e864:8aff:fea0:d942', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe6b:b3c8', 'fe80::9885:a1ff:feb8:60ba'] 
May 28 14:15:03.968980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:15:03.968980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:15:03.968980 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:03.968980 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Updating existing volume attachment record: 96f9806f-3992-49da-8b7b-8bfd498a2729 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:15:04.112066 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Took 0.57 seconds to detach 1 volumes for instance.
May 28 14:15:04.379466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:04.515934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:15:04.516412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:04.516548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:04.517037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:04.517262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:15:04.531349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:04.532240 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:04.533327 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:04.533641 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:04.534304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:04.534580 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:04.547335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:04.547335 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:04.554005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:04.554005 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a] added
May 28 14:15:04.563467 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:04.563467 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:04.563467 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:04.568561 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a] added
May 28 14:15:04.568561 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:04.568561 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:04.568561 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:04.568561 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:04.568561 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:04.568561 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:04.568897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:04.569116 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:04.569116 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:04.622070 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:04.622270 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:04.734672 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:04.802311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:04.802536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:04.843743 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Snapshot image upload complete
May 28 14:15:04.844101 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:04.910686 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:04.910965 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:05.294259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:05.294627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:05.305316 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Detaching volume c7985125-715e-422f-97cc-2686f5ee33dc
May 28 14:15:05.344403 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to driver detach volume c7985125-715e-422f-97cc-2686f5ee33dc from mountpoint /dev/vdb
May 28 14:15:05.351198 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Shelve offloading
May 28 14:15:05.352428 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-c7985125-715e-422f-97cc-2686f5ee33dc {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:05.357207 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-c7985125-715e-422f-97cc-2686f5ee33dc {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:05.357340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Attempting to detach device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:15:05.357718 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:05.357718 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:05.357718 np0000001643 nova-compute[98269]:   <alias name="ua-c7985125-715e-422f-97cc-2686f5ee33dc"/>
May 28 14:15:05.357718 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:15:05.357718 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:05.357718 np0000001643 nova-compute[98269]:   <serial>c7985125-715e-422f-97cc-2686f5ee33dc</serial>
May 28 14:15:05.357718 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:05.357718 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:05.357718 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:05.365018 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config.
May 28 14:15:05.365198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] (1/8): Attempting to detach device vdb with device alias ua-c7985125-715e-422f-97cc-2686f5ee33dc from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:15:05.365440 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:05.365440 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:05.365440 np0000001643 nova-compute[98269]:   <alias name="ua-c7985125-715e-422f-97cc-2686f5ee33dc"/>
May 28 14:15:05.365440 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:15:05.365440 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:05.365440 np0000001643 nova-compute[98269]:   <serial>c7985125-715e-422f-97cc-2686f5ee33dc</serial>
May 28 14:15:05.365440 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:05.365440 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:05.365440 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:05.414660 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:05.562430 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:05.569586 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:05.575506 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:05.575506 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:05.583206 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:05.583206 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.592142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.598273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.605646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.605646 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.605646 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.605646 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.605646 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:05.605858 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.605858 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.605858 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.605858 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.605858 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:05.612156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.612156 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.612156 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.612156 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.612156 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:05.612369 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.612369 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.612369 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.612369 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.612369 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:05.632725 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.40.100,3260]
May 28 14:15:05.632725 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.40.100,3260] successful.
May 28 14:15:05.632725 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.643994 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.655006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.50.100,3260]
May 28 14:15:05.655006 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.50.100,3260] successful.
May 28 14:15:05.655006 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.660559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.660559 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.660559 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.660559 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.660559 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.660559 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.660559 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:05.660771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.660771 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.660771 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.660771 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.660771 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.660771 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.660771 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:05.661001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:05.661139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:05.662179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] HCTL ('7', '-', '-', 0) found on session 138 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:05.662329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:05.666974 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:05.677648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching for a device in session 138 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:05.677648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:05.689874 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.689874 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.689874 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.689874 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.689874 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.689874 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.689874 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:05.690156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.690156 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:05.690156 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.690156 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:05.690156 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.690156 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:05.690156 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:05.690265 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:05.690342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:05.690991 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] HCTL ('8', '-', '-', 0) found on session 139 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:05.691090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:05.704681 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching for a device in session 139 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:05.704681 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:05.797171 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Detaching volume 67d20bd7-a81b-4e18-be80-56ccf2995bbc
May 28 14:15:05.854842 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Attempting to driver detach volume 67d20bd7-a81b-4e18-be80-56ccf2995bbc from mountpoint /dev/vdb
May 28 14:15:05.861535 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Found disk vdb by alias ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:05.863382 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Found disk vdb by alias ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:05.863502 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Attempting to detach device vdb from instance bfac770e-7430-4353-9f3c-ec438536a7c3 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:15:05.864171 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:05.864171 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:05.864171 np0000001643 nova-compute[98269]:   <alias name="ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc"/>
May 28 14:15:05.864171 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:05.864171 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:05.864171 np0000001643 nova-compute[98269]:   <serial>67d20bd7-a81b-4e18-be80-56ccf2995bbc</serial>
May 28 14:15:05.864171 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:05.864171 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:05.864171 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:05.867458 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance destroyed successfully.
May 28 14:15:05.869072 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:05.871028 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:05.871028 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquired lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:05.871028 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:15:05.874514 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully detached device vdb from instance bfac770e-7430-4353-9f3c-ec438536a7c3 from the persistent domain config.
May 28 14:15:05.874671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] (1/8): Attempting to detach device vdb with device alias ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc from instance bfac770e-7430-4353-9f3c-ec438536a7c3 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:15:05.874997 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:05.874997 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:05.874997 np0000001643 nova-compute[98269]:   <alias name="ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc"/>
May 28 14:15:05.874997 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:05.874997 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:05.874997 np0000001643 nova-compute[98269]:   <serial>67d20bd7-a81b-4e18-be80-56ccf2995bbc</serial>
May 28 14:15:05.874997 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:05.874997 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:05.874997 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:05.884731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977705.8842566, a95922fd-8d79-43bc-9052-e05f100abb79 => ua-c7985125-715e-422f-97cc-2686f5ee33dc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:15:05.885697 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c7985125-715e-422f-97cc-2686f5ee33dc for instance a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:15:05.888194 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config.
May 28 14:15:05.889557 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:05.890081 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7985125-715e-422f-97cc-2686f5ee33dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:05.890299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:05.921792 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.299s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:05.971373 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance 6b39455c-17b2-46bd-9207-1791f639eb08
May 28 14:15:06.334991 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977706.3346233, bfac770e-7430-4353-9f3c-ec438536a7c3 => ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:15:06.335967 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-67d20bd7-a81b-4e18-be80-56ccf2995bbc for instance bfac770e-7430-4353-9f3c-ec438536a7c3 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:15:06.338756 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully detached device vdb from instance bfac770e-7430-4353-9f3c-ec438536a7c3 from the live domain config.
May 28 14:15:06.339706 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:06.339999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:06.340170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:06.357075 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:06.373765 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:06.533553 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:15:06.662316 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:06.776382 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:06.979792 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1f63e2eb-8023-48a1-acdd-3441883461c6 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "6b39455c-17b2-46bd-9207-1791f639eb08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.978s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:07.278350 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Releasing lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:07.278670 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:07.278921 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:07.554200 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Found WWN 330000000950db64f for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:15:07.554575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:07.554786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000950db64f', 'path': '/dev/dm-0', 'multipath_id': '330000000950db64f'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:07.554965 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000950db64f', 'path': '/dev/dm-0', 'multipath_id': '330000000950db64f'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:15:07.555439 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.665s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:07.555819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7985125-715e-422f-97cc-2686f5ee33dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:07.556007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:07.558183 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'flavor' on Instance uuid eadb7b17-f3e3-46c7-9149-04c4b94fc699 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:07.585475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.585475 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.585475 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:07.585475 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:07.585475 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.585475 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.585475 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:07.585734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.585734 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.585734 np0000001643 nova-compute[98269]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:07.585734 np0000001643 nova-compute[98269]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc (non-flash)
May 28 14:15:07.585734 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.585734 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.585734 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:07.585899 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '139')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:07.585999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '136')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:07.587192 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc', '135')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:07.588380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c1707c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:07.588659 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Removing multipathed devices sdj, sdi {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:15:07.589208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Flush multipath device 330000000865bf761 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:15:07.617173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:07.665849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:07.716612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:15:07.716612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:15:07.717532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:15:07.729110 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:15:07.729241 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:07.742507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:07.776363 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance destroyed successfully.
May 28 14:15:07.776813 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'resources' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:07.783229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.40.100,3260]
May 28 14:15:07.783229 np0000001643 nova-compute[98269]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.40.100,3260] successful.
May 28 14:15:07.783229 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:07.799442 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:07.811259 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:07.822671 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-changed-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:07.823008 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing instance network info cache due to event network-changed-9b754c38-a97e-4220-96e5-625800c5d818. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:07.823236 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] Acquiring lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:07.823289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] Acquired lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:07.823372 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing network info cache for port 9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:07.836682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.50.100,3260]
May 28 14:15:07.836682 np0000001643 nova-compute[98269]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-c7985125-715e-422f-97cc-2686f5ee33dc, portal: 192.168.50.100,3260] successful.
May 28 14:15:07.836682 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:07.850612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:07.850612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:07.850755 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== disconnect_volume: return (1960ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:07.851187 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:07.853074 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.513s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:07.853529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:07.853627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:07.877329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.877329 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.877329 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.877329 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.877329 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:07.877530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.877530 np0000001643 nova-compute[98269]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc (non-flash)
May 28 14:15:07.877530 np0000001643 nova-compute[98269]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.877530 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:07.877530 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:07.877687 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '139')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:07.877812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '127')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:07.878626 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', '128')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:07.879310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801e96c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:07.879517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:15:07.879740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Flush multipath device 3300000001f804708 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:15:07.918730 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:07.965068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:08.006806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:15:08.007196 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:15:08.007921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:15:08.019942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:15:08.020168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:08.030282 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:08.061364 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Attempting to attach volume 0549aaef-1d53-481d-9953-5e23fed37a3a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:15:08.062932 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:15:08.062932 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:08.062932 np0000001643 nova-compute[98269]:   <alias name="ua-0549aaef-1d53-481d-9953-5e23fed37a3a"/>
May 28 14:15:08.062932 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:15:08.062932 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:08.062932 np0000001643 nova-compute[98269]:   <serial>0549aaef-1d53-481d-9953-5e23fed37a3a</serial>
May 28 14:15:08.062932 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:08.062932 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:15:08.069919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.40.100,3260]
May 28 14:15:08.069919 np0000001643 nova-compute[98269]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.40.100,3260] successful.
May 28 14:15:08.069919 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:08.082812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:08.093841 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:08.120432 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.50.100,3260]
May 28 14:15:08.120432 np0000001643 nova-compute[98269]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, portal: 192.168.50.100,3260] successful.
May 28 14:15:08.120432 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:08.132192 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:08.132418 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:08.132588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== disconnect_volume: return (1792ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:08.132702 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:08.280669 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<5b580f8d-61fa-4994-822f-0500e14eeced> lazy-loaded attributes: numa_topology,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:15:08.281384 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-253298750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-253298750',id=52,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLBXqXRdQpsXsHQ6iLHpJqYQH+dvCxX6Exr6ArQUPgrr1nTlfq7cX3PQX7Td86IS/vefw/pPw9OQpYY7X2+qWdMKXosb7HRzQbCntkeyWx+D0/69JoffQsFfeK2LjGeuw==',key_name='tempest-keypair-1418715405',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:14:17Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-lw0yqruz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member',shelved_at='2026-05-28T14:15:04.843793',shelved_host='np0000001643',shelved_image_id='ce453fce-4c54-4515-adea-fc7683b8f88c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=5b580f8d-61fa-4994-822f-0500e14eeced,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:15:08.281624 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:08.282275 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:08.282575 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:15:08.284077 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:08.284333 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b754c38-a9, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:08.285324 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:08.286742 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:08.287310 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:08.287513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df73ceab-bd15-4780-a916-cf7924d1fdd7) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:08.287922 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:08.288316 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:08.288690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:08.290516 np0000001643 nova-compute[98269]: INFO os_vif [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9')
May 28 14:15:08.290516 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Deleting instance files /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced_del
May 28 14:15:08.295264 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Deletion of /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced_del complete
May 28 14:15:08.325696 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:08.401971 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:08.622256 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:08.675937 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'flavor' on Instance uuid bfac770e-7430-4353-9f3c-ec438536a7c3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:08.745254 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updated VIF entry in instance network info cache for port 9b754c38-a97e-4220-96e5-625800c5d818. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:15:08.745482 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9b754c38-a9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:08.845550 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Deleted allocations for instance 5b580f8d-61fa-4994-822f-0500e14eeced
May 28 14:15:09.147733 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003894839996974042 future=<Future at 0x71a75c18cb60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:09.148258 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Emitting event <LifecycleEvent: 1779977694.1472263, eee1e472-9a54-4213-a0ca-aba7284297c5 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:09.148387 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:09.148580 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] VM Stopped (Lifecycle Event)
May 28 14:15:09.149531 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.702759201999925 future=<Future at 0x71a75c36c230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:09.149603 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=5.7026713690002 future=<Future at 0x71a75c36c230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:09.247363 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e92fb2bc-6617-4419-b99e-6cf1f56c8f13 req-fd14dcff-349c-4891-861c-2529cd109f7b service nova] Releasing lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:09.351826 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:09.351994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:09.406893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-16256383-5ede-4e7a-9a3d-46c0d2199537 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.604s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:09.518188 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:09.518482 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:09.535785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:09.651384 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bcda60a9-78fe-4087-96b0-ebd47ead9d57 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: eee1e472-9a54-4213-a0ca-aba7284297c5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:09.681167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f9d5b55e-2c36-4c3e-aea2-3e6af1e89a70 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.387s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:09.681781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.146s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:09.682416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:09.682587 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:09.683174 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:09.684437 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Terminating instance
May 28 14:15:09.727519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:09.727685 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:09.727811 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:09.727935 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No VIF found with MAC fa:16:3e:6b:b3:c8, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:10.022922 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:10.187386 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:15:10.212294 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:10.214078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:10.232868 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:10.237237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:10.263041 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:10.264179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:10.310076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "cd89555b-2493-48a9-a79e-92cd51efcb1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:10.310280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:10.363314 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-147e5cc6-b993-48aa-9774-07e88efcf671 req-9255dd71-c6cb-4087-ab2c-3478e1fd6435 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-vif-unplugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:10.363524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-147e5cc6-b993-48aa-9774-07e88efcf671 req-9255dd71-c6cb-4087-ab2c-3478e1fd6435 service nova] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:10.364903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-147e5cc6-b993-48aa-9774-07e88efcf671 req-9255dd71-c6cb-4087-ab2c-3478e1fd6435 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:10.364903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-147e5cc6-b993-48aa-9774-07e88efcf671 req-9255dd71-c6cb-4087-ab2c-3478e1fd6435 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:10.364903 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-147e5cc6-b993-48aa-9774-07e88efcf671 req-9255dd71-c6cb-4087-ab2c-3478e1fd6435 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] No waiting events found dispatching network-vif-unplugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:10.364903 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-147e5cc6-b993-48aa-9774-07e88efcf671 req-9255dd71-c6cb-4087-ab2c-3478e1fd6435 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-vif-unplugged-80005835-4de3-4f71-b91a-589b63d1631c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:10.507688 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998058805000255 future=<Future at 0x71a75c35bda0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:10.509737 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Instance destroyed successfully.
May 28 14:15:10.510503 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lazy-loading 'resources' on Instance uuid bfac770e-7430-4353-9f3c-ec438536a7c3 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:10.528957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.177s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:10.812172 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:15:11.012752 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-410171301',display_name='tempest-VolumesBackupsTest-instance-410171301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesbackupstest-instance-410171301',id=48,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIkRZ9wEh/K7YInYJ6wY5fmRocdvxYBMVzxG+Tvns53o3WeqTn9Ai5CIi37NEf15FG201ctEogkJWgI5GvXlDEVjXKy3o5GmDze4zZfELXHtUxwpLd0Kdvs8c87SEx0Lg==',key_name='tempest-keypair-171131720',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:13:30Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='161531d31b404ab1bc2c6c340124f03d',ramdisk_id='',reservation_id='r-p5jd6kae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-654288917',owner_user_name='tempest-VolumesBackupsTest-654288917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d64d4218444093a2b86cfdda17f742',uuid=bfac770e-7430-4353-9f3c-ec438536a7c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:15:11.013008 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converting VIF {"id": "80005835-4de3-4f71-b91a-589b63d1631c", "address": "fa:16:3e:f7:2f:79", "network": {"id": "3452c395-c6eb-42c5-85a7-2a4fc4c11f59", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-234740394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "161531d31b404ab1bc2c6c340124f03d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80005835-4d", "ovs_interfaceid": "80005835-4de3-4f71-b91a-589b63d1631c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:11.013785 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=80005835-4de3-4f71-b91a-589b63d1631c,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80005835-4d') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:11.014083 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=80005835-4de3-4f71-b91a-589b63d1631c,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80005835-4d') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:15:11.015218 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:11.015519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80005835-4d, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:11.017486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:11.018250 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:11.018665 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:11.018805 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a929106e-a5dd-43dd-afd1-06a6a24cd043) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:11.020164 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:11.021824 np0000001643 nova-compute[98269]: INFO os_vif [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=80005835-4de3-4f71-b91a-589b63d1631c,network=Network(3452c395-c6eb-42c5-85a7-2a4fc4c11f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80005835-4d')
May 28 14:15:11.023590 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:11.023915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:11.024136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:11.025415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:11.025809 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67d20bd7-a81b-4e18-be80-56ccf2995bbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:11.025940 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:11.035458 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ddc9a711-06d9-4bcd-a43b-4478d775617e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 12.548s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:11.052308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:11.052308 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:11.052308 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:11.052308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:11.052308 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:11.052308 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:11.052308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '139')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:11.052308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:11.052308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:15:11.052673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:11.052673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67d20bd7-a81b-4e18-be80-56ccf2995bbc') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:15:11.052673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c7663e0>, {}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:11.053701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Disconnecting from: [] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:11.053701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:11.053701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] <== disconnect_volume: return (29ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:11.053701 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:11.053701 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Deleting instance files /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3_del
May 28 14:15:11.055033 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Deletion of /opt/stack/data/nova/instances/bfac770e-7430-4353-9f3c-ec438536a7c3_del complete
May 28 14:15:11.276594 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c1eaed8e-8756-43f4-b3b7-486b115beca1 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.449s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:11.380535 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:11.380535 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:11.386157 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:15:11.386157 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Claim successful on node np0000001643
May 28 14:15:11.460697 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:11.461087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:11.561490 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 14:15:11.561963 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:15:11.562180 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:15:11.562332 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:15:11.562650 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:11.664657 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:11.964721 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:12.065161 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e891f4a1-25d1-43dd-96bb-bf6671574296 req-6e879625-79e6-44e4-94fa-d03b8e73c86f service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-vif-deleted-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:12.065364 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-e891f4a1-25d1-43dd-96bb-bf6671574296 req-6e879625-79e6-44e4-94fa-d03b8e73c86f service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Neutron deleted interface 80005835-4de3-4f71-b91a-589b63d1631c; detaching it from the instance and deleting it from the info cache
May 28 14:15:12.066904 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e891f4a1-25d1-43dd-96bb-bf6671574296 req-6e879625-79e6-44e4-94fa-d03b8e73c86f service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Detach interface failed, port_id=80005835-4de3-4f71-b91a-589b63d1631c, reason: Instance bfac770e-7430-4353-9f3c-ec438536a7c3 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:15:12.416859 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a27cdcda-28cd-4494-bd2b-36bb87e34701 req-76c61557-4418-4174-b2e8-7139da5a4307 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-vif-unplugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:12.417290 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a27cdcda-28cd-4494-bd2b-36bb87e34701 req-76c61557-4418-4174-b2e8-7139da5a4307 service nova] Acquiring lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:12.417290 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a27cdcda-28cd-4494-bd2b-36bb87e34701 req-76c61557-4418-4174-b2e8-7139da5a4307 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:12.417344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a27cdcda-28cd-4494-bd2b-36bb87e34701 req-76c61557-4418-4174-b2e8-7139da5a4307 service nova] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:12.417515 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a27cdcda-28cd-4494-bd2b-36bb87e34701 req-76c61557-4418-4174-b2e8-7139da5a4307 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] No waiting events found dispatching network-vif-unplugged-80005835-4de3-4f71-b91a-589b63d1631c {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:12.417641 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a27cdcda-28cd-4494-bd2b-36bb87e34701 req-76c61557-4418-4174-b2e8-7139da5a4307 service nova] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Received event network-vif-unplugged-80005835-4de3-4f71-b91a-589b63d1631c for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:12.522745 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:12.665309 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:12.665566 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:12.810005 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:12.810187 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:12.810322 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Unshelving
May 28 14:15:12.970081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:13.024628 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Took 1.46 seconds to deallocate network for instance.
May 28 14:15:13.041514 np0000001643 nova-compute[98269]: WARNING nova.volume.cinder [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Attachment 3c637c85-54db-4860-930c-9311c89b9914 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3c637c85-54db-4860-930c-9311c89b9914. (HTTP 404) (Request-ID: req-2ec057e6-861e-4d7e-a230-57d4f7c70f86)
May 28 14:15:13.041763 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Took 0.02 seconds to detach 1 volumes for instance.
May 28 14:15:13.168313 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:13.546985 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:13.675052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.294s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:13.675587 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.128s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:13.676197 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:15:13.877289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:13.935726 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:13.935977 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:14.033591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:14.033806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:14.033977 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attaching volume 2f977427-94bd-4baa-8f9b-1a1284a74053 to /dev/vdb
May 28 14:15:14.072372 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:14.083883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:15:14.108591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:14.149911 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:15:14.150248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:15:14.159412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:15:14.160413 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe6b:b3c8', 'fe80::9885:a1ff:feb8:60ba'] 
May 28 14:15:14.160559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:15:14.160667 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:15:14.160913 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:14.161145 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating existing volume attachment record: 88c654c3-fa0f-4e32-a5f2-4915ce7d35d5 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:15:14.184853 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:15:14.186162 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:15:14.186605 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:14.186993 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:14.255484 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:15:14.438737 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:14.646444 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Successfully created port: 523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:15:14.690821 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:15:14.712988 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:15:14.713296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f977427-94bd-4baa-8f9b-1a1284a74053', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:14.713465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:14.713896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:14.714151 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f977427-94bd-4baa-8f9b-1a1284a74053', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:15:14.724824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:14.725285 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:14.725748 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:14.725933 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:14.726210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:14.726322 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:14.736059 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:14.737559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:14.737559 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:14.743245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:14.743245 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:14.749872 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053] added
May 28 14:15:14.749872 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:14.749872 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:14.749872 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:14.749872 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:14.749872 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:14.749872 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:14.750213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:14.750213 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:14.751150 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:14.752818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053] added
May 28 14:15:14.752818 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:14.752818 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:14.752818 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:14.752818 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:14.752818 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:14.752818 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:14.753062 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:14.753062 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:14.753202 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:14.852791 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004117779999432969 future=<Future at 0x71a75c36c230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:14.853147 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Emitting event <LifecycleEvent: 1779977699.852198, 5b580f8d-61fa-4994-822f-0500e14eeced => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:14.853262 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:14.853422 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Stopped (Lifecycle Event)
May 28 14:15:14.854315 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.9824805140001445 future=<Future at 0x71a7801ed310 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:14.854543 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.9823591090002992 future=<Future at 0x71a7801ed310 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:14.945292 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.270s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:14.946687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.068s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:14.948564 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:14.991513 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Deleted allocations for instance bfac770e-7430-4353-9f3c-ec438536a7c3
May 28 14:15:15.125645 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Successfully updated port: 523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:15:15.176087 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Received event network-changed-523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:15.176512 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Refreshing instance network info cache due to event network-changed-523bc512-052f-4da1-9254-e3e0e793f5a5. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:15.176720 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] Acquiring lock "refresh_cache-cd89555b-2493-48a9-a79e-92cd51efcb1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:15.176947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] Acquired lock "refresh_cache-cd89555b-2493-48a9-a79e-92cd51efcb1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:15.176947 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Refreshing network info cache for port 523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:15.194187 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:15:15.356250 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2a8a7862-2ea9-499e-bcf7-758f74f46cc1 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:15.451552 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:15.627706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-cd89555b-2493-48a9-a79e-92cd51efcb1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:15.679604 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:15.698678 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Booting with volume e07a66ec-c310-47ef-9689-c223103a4c5e at /dev/vda
May 28 14:15:15.740296 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:15.743718 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:15.750932 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:15.751675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:15:15.753743 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:15.765748 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:15.765748 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:15.775011 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:15.775011 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.781662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.782441 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:15.796349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.797158 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.797158 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.797158 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:15.797158 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.797158 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.797158 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:15.809811 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.809811 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.809811 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:15.809965 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.809965 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.809965 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:15.835877 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.40.100,3260]
May 28 14:15:15.835877 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.40.100,3260] successful.
May 28 14:15:15.835877 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.837772 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0009321079996880144 future=<Future at 0x71a7801ed310 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:15.837920 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:15.841239 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.664573548000135 future=<Future at 0x71a75c35bda0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:15.841239 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.664466580999942 future=<Future at 0x71a75c35bda0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:15.841529 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:15:15.841905 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] Emitting event <LifecycleEvent: 1779977700.8367295, 6b39455c-17b2-46bd-9207-1791f639eb08 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:15.842269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:15:15.842743 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] VM Stopped (Lifecycle Event)
May 28 14:15:15.849354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.854965 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:15:15.855824 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe6b:b3c8', 'fe80::9885:a1ff:feb8:60ba'] 
May 28 14:15:15.855969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:15:15.856033 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:15:15.856233 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:15.856422 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Updating existing volume attachment record: cd7382b8-7a07-48ed-90e1-62c2728c2cf7 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:15:15.858897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.50.100,3260]
May 28 14:15:15.858897 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.50.100,3260] successful.
May 28 14:15:15.858897 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.864920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.864920 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.864920 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.864920 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.864920 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:15.865131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.865131 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.865131 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.865131 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.865131 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:15.865464 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:15.865597 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:15.866336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('9', '-', '-', 0) found on session 140 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:15.866521 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:15.873705 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:15.883762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 140 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:15.884351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f977427-94bd-4baa-8f9b-1a1284a74053', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:15.888796 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.888796 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.888796 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.888796 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.888796 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:15.888975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.888975 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:15.888975 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.888975 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:15.888975 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:15.889267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:15.889419 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:15.890026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('10', '-', '-', 0) found on session 141 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:15.890026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:15.894224 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:15.905196 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 141 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:15.905509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f977427-94bd-4baa-8f9b-1a1284a74053', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:15.953788 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:15:15.953974 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Claim successful on node np0000001643
May 28 14:15:16.002546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-786f99e3-38e6-47de-b9e0-c088a89b7a16 tempest-VolumesBackupsTest-654288917 tempest-VolumesBackupsTest-654288917-project-member] Lock "bfac770e-7430-4353-9f3c-ec438536a7c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.321s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:16.029148 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:16.346796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec8579d3-a0d3-436b-ba46-e643f0bae095 tempest-VolumeMultiattachTests-761556748 tempest-VolumeMultiattachTests-761556748-project-member] [instance: 6b39455c-17b2-46bd-9207-1791f639eb08] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:16.396522 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-038eafec-7885-4261-86a8-bfcbe63aaabf req-a772fa0d-f726-4c48-ba53-fde3abd9a4a5 service nova] Releasing lock "refresh_cache-cd89555b-2493-48a9-a79e-92cd51efcb1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:16.397234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-cd89555b-2493-48a9-a79e-92cd51efcb1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:16.397234 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:15:16.726516 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:15:16.956322 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:17.127887 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:17.196855 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:17.197043 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:17.281994 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Updating instance_info_cache with network_info: [{"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:17.699394 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:17.745083 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found WWN 3300000004d3b8ac8 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:15:17.745461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:17.745461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000004d3b8ac8', 'path': '/dev/dm-1', 'multipath_id': '3300000004d3b8ac8'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:17.745598 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004d3b8ac8', 'path': '/dev/dm-1', 'multipath_id': '3300000004d3b8ac8'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:15:17.748969 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:17.784212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-cd89555b-2493-48a9-a79e-92cd51efcb1e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:17.784647 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Instance network_info: |[{"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:15:17.951510 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:15:17.952627 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:15:17.952875 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Creating image(s)
May 28 14:15:17.953318 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:15:17.953490 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Ensure instance console log exists: /opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:15:17.953974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:17.954157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:17.954280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:17.954786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Start _get_guest_xml network_info=[{"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'cd7382b8-7a07-48ed-90e1-62c2728c2cf7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cd89555b-2493-48a9-a79e-92cd51efcb1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'serial': 'e07a66ec-c310-47ef-9689-c223103a4c5e'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:15:17.956906 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:15:17.957964 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1418566921', uuid='cd89555b-2493-48a9-a79e-92cd51efcb1e'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977717.9576404) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:15:17.958961 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:15:17.959266 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:15:17.960102 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:15:17.960265 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:15:17.961303 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:15:17.961601 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:15:17.961749 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:15:17.961864 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:15:17.961994 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:15:17.962086 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:15:17.962187 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:15:17.962347 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:15:17.962482 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:15:17.962605 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:15:17.962715 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:15:17.962840 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:15:17.975027 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:15:17.975377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:17.975596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:17.975933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:17.976128 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:15:17.987680 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:17.988402 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:17.989001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:17.989430 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:17.989774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:17.989934 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:18.001123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:18.001123 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:18.005226 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:18.005226 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:18.014642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e] added
May 28 14:15:18.014642 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:18.014642 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:18.014642 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:18.014642 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:18.014642 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:18.014642 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:18.014860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:18.015162 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:18.015365 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:18.016437 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e] added
May 28 14:15:18.016437 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:18.016437 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:18.016437 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:18.016437 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:18.016437 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:18.016437 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:18.016657 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:18.016738 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:18.016876 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:18.128814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:18.128980 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:18.193114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:18.205354 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.260s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:18.205727 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:18.251684 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to attach volume 2f977427-94bd-4baa-8f9b-1a1284a74053 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:15:18.252787 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:15:18.252787 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:18.252787 np0000001643 nova-compute[98269]:   <alias name="ua-2f977427-94bd-4baa-8f9b-1a1284a74053"/>
May 28 14:15:18.252787 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:18.252787 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:18.252787 np0000001643 nova-compute[98269]:   <serial>2f977427-94bd-4baa-8f9b-1a1284a74053</serial>
May 28 14:15:18.252787 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:18.252787 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:15:18.260237 np0000001643 nova-compute[98269]: INFO nova.network.neutron [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating port 9b754c38-a97e-4220-96e5-625800c5d818 with attributes {'binding:host_id': 'np0000001643', 'device_owner': 'compute:nova'}
May 28 14:15:18.631580 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Detaching volume 0549aaef-1d53-481d-9953-5e23fed37a3a
May 28 14:15:18.674993 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Attempting to driver detach volume 0549aaef-1d53-481d-9953-5e23fed37a3a from mountpoint /dev/vdb
May 28 14:15:18.680486 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Found disk vdb by alias ua-0549aaef-1d53-481d-9953-5e23fed37a3a {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:18.681587 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Found disk vdb by alias ua-0549aaef-1d53-481d-9953-5e23fed37a3a {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:18.681709 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Attempting to detach device vdb from instance eadb7b17-f3e3-46c7-9149-04c4b94fc699 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:15:18.681925 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:18.681925 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:18.681925 np0000001643 nova-compute[98269]:   <alias name="ua-0549aaef-1d53-481d-9953-5e23fed37a3a"/>
May 28 14:15:18.681925 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:15:18.681925 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:18.681925 np0000001643 nova-compute[98269]:   <serial>0549aaef-1d53-481d-9953-5e23fed37a3a</serial>
May 28 14:15:18.681925 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:18.681925 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:18.681925 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:18.686919 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully detached device vdb from instance eadb7b17-f3e3-46c7-9149-04c4b94fc699 from the persistent domain config.
May 28 14:15:18.687056 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] (1/8): Attempting to detach device vdb with device alias ua-0549aaef-1d53-481d-9953-5e23fed37a3a from instance eadb7b17-f3e3-46c7-9149-04c4b94fc699 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:15:18.687259 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:18.687259 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:18.687259 np0000001643 nova-compute[98269]:   <alias name="ua-0549aaef-1d53-481d-9953-5e23fed37a3a"/>
May 28 14:15:18.687259 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:15:18.687259 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:18.687259 np0000001643 nova-compute[98269]:   <serial>0549aaef-1d53-481d-9953-5e23fed37a3a</serial>
May 28 14:15:18.687259 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:18.687259 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:18.687259 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:18.820756 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:18.821163 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquired lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:18.821163 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:15:18.870093 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-changed-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:18.870434 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing instance network info cache due to event network-changed-9b754c38-a97e-4220-96e5-625800c5d818. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:18.870586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] Acquiring lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:19.015801 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:19.017348 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:19.025544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:19.029079 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:19.029079 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:19.034620 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:19.034620 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.040306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.045369 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.056914 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.056914 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.056914 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.056914 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.056914 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:19.057089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.057089 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.057089 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.057089 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.057089 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:19.057684 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.057684 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.057684 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.057684 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.057684 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:19.057911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.057911 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.057911 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.057911 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.057911 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:19.097819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.40.100,3260]
May 28 14:15:19.097819 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.40.100,3260] successful.
May 28 14:15:19.097819 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.099751 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.50.100,3260]
May 28 14:15:19.099751 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.50.100,3260] successful.
May 28 14:15:19.099751 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.110143 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.115930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:19.125109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.125109 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.125109 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.125109 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.125109 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.125109 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.125109 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:19.125323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.125323 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.125323 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.125323 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.125323 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.125323 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.125323 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:19.125581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:19.125719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:19.126566 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('11', '-', '-', 0) found on session 142 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:19.126692 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:19.131224 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.131224 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.131224 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.131224 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.131224 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.131224 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.131224 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:19.131381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.131381 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:19.131381 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.131381 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:19.131381 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.131381 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:19.131381 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:19.131623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:19.131724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:19.132392 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('12', '-', '-', 0) found on session 143 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:19.132524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:19.141710 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 142 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:19.141710 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:19.147293 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 143 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:19.147580 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:19.175506 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977719.1751382, eadb7b17-f3e3-46c7-9149-04c4b94fc699 => ua-0549aaef-1d53-481d-9953-5e23fed37a3a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:15:19.176801 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0549aaef-1d53-481d-9953-5e23fed37a3a for instance eadb7b17-f3e3-46c7-9149-04c4b94fc699 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:15:19.178704 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully detached device vdb from instance eadb7b17-f3e3-46c7-9149-04c4b94fc699 from the live domain config.
May 28 14:15:19.179641 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:19.179897 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:19.180054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:19.322972 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:19.646743 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:19.784503 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:19.904772 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:19.905210 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:19.905210 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:19.905210 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No VIF found with MAC fa:16:3e:12:ea:68, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:19.990263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:15:20.286402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Releasing lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:20.287378 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:15:20.287647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] Acquired lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:20.287890 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Creating image(s)
May 28 14:15:20.288382 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Refreshing network info cache for port 9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:20.289400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:20.289640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:20.290166 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:20.290393 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:20.792095 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:20.794066 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<5b580f8d-61fa-4994-822f-0500e14eeced> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:15:20.794655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "29421d96836d3c110a7d59b57cb8941591e81c9d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:20.795076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "29421d96836d3c110a7d59b57cb8941591e81c9d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:21.006042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 330000000e5b524fc for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:15:21.006517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:21.007098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.827s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:21.007931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000e5b524fc', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000e5b524fc'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:21.008208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:21.008468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e5b524fc', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000e5b524fc'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:15:21.008675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:21.030842 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:21.038113 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:21.038678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '143')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:21.038678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '138')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:21.040087 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': 'cd89555b-2493-48a9-a79e-92cd51efcb1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'serial': 'e07a66ec-c310-47ef-9689-c223103a4c5e'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:15:21.040821 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:15:21.041093 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:15:21.041304 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:15:21.042268 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71a75c31fda0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': 'cd89555b-2493-48a9-a79e-92cd51efcb1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'serial': 'e07a66ec-c310-47ef-9689-c223103a4c5e'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:15:21.042480 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98269) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 14:15:21.042683 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] opening encrypted volume /dev/dm-3 {{(pid=98269) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 14:15:21.043296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', '139')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:21.044465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c2c8f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:21.044697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:15:21.044923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Flush multipath device 330000000950db64f {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:15:21.080557 np0000001643 nova-compute[98269]: WARNING os_brick.encryptors.luks [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 14:15:21.080728 np0000001643 nova-compute[98269]: INFO os_brick.encryptors.luks [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] /dev/dm-3 is not a valid LUKS device; formatting device for first use
May 28 14:15:21.080871 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] formatting encrypted volume /dev/dm-3 {{(pid=98269) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 14:15:21.091981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:21.128341 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:21.141349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:21.200862 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:15:21.201551 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:15:21.202837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:15:21.214816 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:15:21.215097 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:21.228773 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:21.266798 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.40.100,3260]
May 28 14:15:21.266798 np0000001643 nova-compute[98269]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.40.100,3260] successful.
May 28 14:15:21.266798 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:21.286288 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:21.301046 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:21.304367 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updated VIF entry in instance network info cache for port 9b754c38-a97e-4220-96e5-625800c5d818. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:15:21.304644 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:21.339362 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.50.100,3260]
May 28 14:15:21.339362 np0000001643 nova-compute[98269]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, portal: 192.168.50.100,3260] successful.
May 28 14:15:21.339362 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:21.357001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:21.357707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:21.357869 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== disconnect_volume: return (2178ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:21.358730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:21.460989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e365b581-7355-4326-be98-932d3248be91 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.427s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:21.635670 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:21.638050 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:21.638796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:21.727287 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.part --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:21.727938 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] ce453fce-4c54-4515-adea-fc7683b8f88c was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:15:21.728726 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:15:21.729063 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.part /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:21.807814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e52c8d81-6ae6-4b89-b213-1caef99b9a6d req-ff86e1dc-a86f-42dc-9710-e23b63db322a service nova] Releasing lock "refresh_cache-5b580f8d-61fa-4994-822f-0500e14eeced" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:21.888299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.part /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.converted" returned: 0 in 0.159s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:21.900319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:21.944785 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'flavor' on Instance uuid eadb7b17-f3e3-46c7-9149-04c4b94fc699 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:21.999387 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d.converted --force-share --output=json" returned: 0 in 0.099s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:22.000286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "29421d96836d3c110a7d59b57cb8941591e81c9d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.205s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:22.000780 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:22.003879 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:22.005044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:22.106882 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:22.107318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "29421d96836d3c110a7d59b57cb8941591e81c9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:22.107942 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "29421d96836d3c110a7d59b57cb8941591e81c9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:22.108376 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:22.111267 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:22.111584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:22.206823 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:22.207462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d,backing_fmt=raw /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:22.280994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d,backing_fmt=raw /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk 1073741824" returned: 0 in 0.073s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:22.281518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "29421d96836d3c110a7d59b57cb8941591e81c9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:22.281868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:22.383043 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:22.383605 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'migration_context' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:22.891525 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<5b580f8d-61fa-4994-822f-0500e14eeced> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:15:22.891525 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Rebasing disk image.
May 28 14:15:22.891525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:22.954879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-eabda5ed-e84b-4afe-86c4-23116d0483ab tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.825s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:22.960478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 4.764s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:22.960478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:22.960478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:22.960478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:22.967988 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Terminating instance
May 28 14:15:22.995843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.108s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:22.996205 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 -F raw /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:23.475471 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:15:23.496592 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:23.503574 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:23.523634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:23.529677 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:23.558093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:23.757813 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-70573a14-af77-4708-948f-3798d023c509 req-8b9349dd-4b63-454c-a269-eac61728fbc7 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-vif-unplugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:23.761022 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70573a14-af77-4708-948f-3798d023c509 req-8b9349dd-4b63-454c-a269-eac61728fbc7 service nova] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:23.762226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70573a14-af77-4708-948f-3798d023c509 req-8b9349dd-4b63-454c-a269-eac61728fbc7 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:23.762472 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70573a14-af77-4708-948f-3798d023c509 req-8b9349dd-4b63-454c-a269-eac61728fbc7 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:23.762912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-70573a14-af77-4708-948f-3798d023c509 req-8b9349dd-4b63-454c-a269-eac61728fbc7 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] No waiting events found dispatching network-vif-unplugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:23.763435 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-70573a14-af77-4708-948f-3798d023c509 req-8b9349dd-4b63-454c-a269-eac61728fbc7 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-vif-unplugged-06677b0d-9214-446b-8dfe-871a0743bb62 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:23.836694 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99961941499987 future=<Future at 0x71a7801b4cb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:23.842690 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Instance destroyed successfully.
May 28 14:15:23.843399 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'resources' on Instance uuid eadb7b17-f3e3-46c7-9149-04c4b94fc699 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:24.092909 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 -F raw /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk" returned: 0 in 1.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:24.093488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:15:24.093610 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Ensure instance console log exists: /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:15:24.094484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:24.094484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:24.094484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:24.095833 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Start _get_guest_xml network_info=[{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='605175ed046ffe3bb4fb6474fc2fe480',container_format='bare',created_at=2026-05-28T14:14:58Z,direct_url=<?>,disk_format='qcow2',id=ce453fce-4c54-4515-adea-fc7683b8f88c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-253298750-shelved',owner='db1dc6979a244982823fef41c57d1c75',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-28T14:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:15:24.098924 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:15:24.100271 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-253298750', uuid='5b580f8d-61fa-4994-822f-0500e14eeced'), owner=OwnerMeta(userid='b666f3c9eb914e2dba854ed4e0d8fb20', username='tempest-AttachVolumeShelveTestJSON-1300734613-project-member', projectid='db1dc6979a244982823fef41c57d1c75', projectname='tempest-AttachVolumeShelveTestJSON-1300734613'), image=ImageMeta(id='ce453fce-4c54-4515-adea-fc7683b8f88c', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977724.0999157) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:15:24.101442 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:15:24.101780 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:15:24.102613 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:15:24.102786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:15:24.103845 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:15:24.104144 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='605175ed046ffe3bb4fb6474fc2fe480',container_format='bare',created_at=2026-05-28T14:14:58Z,direct_url=<?>,disk_format='qcow2',id=ce453fce-4c54-4515-adea-fc7683b8f88c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-253298750-shelved',owner='db1dc6979a244982823fef41c57d1c75',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-28T14:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:15:24.104273 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:15:24.104377 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:15:24.104513 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:15:24.104590 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:15:24.104675 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:15:24.104812 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:15:24.104894 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:15:24.105023 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:15:24.105123 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:15:24.105229 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:15:24.105363 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:24.346694 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-105321707',display_name='tempest-VolumesSnapshotTestJSON-instance-105321707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumessnapshottestjson-instance-105321707',id=53,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOVGuDuDz6Z1IfK2G72oFANrLzwi/+vFsMlhJvOqbJEB5qG2PgtUdlWU5qTUOQBjEMJkwyzTzq/729ZrjA7GjiHoLy9tO1z62N3rNz5BrIZcZh3e/SwDDWT0n39ZG/g/Q==',key_name='tempest-keypair-522639749',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:14:22Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='503ff5746ac94b068fca926067617b52',ramdisk_id='',reservation_id='r-9jtxchqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-33088366',owner_user_name='tempest-VolumesSnapshotTestJSON-33088366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:14:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4fa943716494225849fb8aac46fb662',uuid=eadb7b17-f3e3-46c7-9149-04c4b94fc699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:15:24.347041 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converting VIF {"id": "06677b0d-9214-446b-8dfe-871a0743bb62", "address": "fa:16:3e:6b:b3:c8", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06677b0d-92", "ovs_interfaceid": "06677b0d-9214-446b-8dfe-871a0743bb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:24.347921 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=06677b0d-9214-446b-8dfe-871a0743bb62,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06677b0d-92') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:24.348247 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=06677b0d-9214-446b-8dfe-871a0743bb62,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06677b0d-92') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:15:24.349959 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:24.350601 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06677b0d-92, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:24.362271 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:24.363465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:24.364464 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:24.365234 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:24.365461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fb0fc4a-d4aa-4537-ac66-e75c2d8372e4) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:24.366144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:24.366752 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:24.367651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:24.370126 np0000001643 nova-compute[98269]: INFO os_vif [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=06677b0d-9214-446b-8dfe-871a0743bb62,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06677b0d-92')
May 28 14:15:24.372566 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:24.372925 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:24.373138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:24.373541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:24.373856 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0549aaef-1d53-481d-9953-5e23fed37a3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:24.374007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:24.398843 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:24.398843 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:24.398843 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:24.398843 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:24.398843 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:24.399091 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:24.399091 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:24.399091 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:24.399091 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:24.399091 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:24.399431 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '143')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:24.399803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:24.400066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:15:24.400225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:24.400521 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0549aaef-1d53-481d-9953-5e23fed37a3a') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:15:24.400689 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780187880>, {}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:24.400864 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Disconnecting from: [] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:24.401074 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:24.401329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== disconnect_volume: return (28ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:24.401488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:24.402106 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Deleting instance files /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699_del
May 28 14:15:24.402944 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Deletion of /opt/stack/data/nova/instances/eadb7b17-f3e3-46c7-9149-04c4b94fc699_del complete
May 28 14:15:24.607530 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<5b580f8d-61fa-4994-822f-0500e14eeced> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:15:24.630675 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-253298750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-253298750',id=52,image_ref='ce453fce-4c54-4515-adea-fc7683b8f88c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1418715405',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:14:17Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-lw0yqruz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member',shelved_at='2026-05-28T14:15:04.843793',shelved_host='np0000001643',shelved_image_id='ce453fce-4c54-4515-adea-fc7683b8f88c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=5b580f8d-61fa-4994-822f-0500e14eeced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:15:24.630955 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:24.631746 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:24.632821 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:24.740612 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:24.916343 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 14:15:24.917085 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:15:24.917329 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:15:24.917485 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:15:24.917826 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:25.021019 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:25.145138 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<5b580f8d-61fa-4994-822f-0500e14eeced> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:15:25.146597 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] End _get_guest_xml xml=<domain type="qemu">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <uuid>5b580f8d-61fa-4994-822f-0500e14eeced</uuid>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <name>instance-00000034</name>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-253298750</nova:name>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:15:24</nova:creationTime>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:user uuid="b666f3c9eb914e2dba854ed4e0d8fb20">tempest-AttachVolumeShelveTestJSON-1300734613-project-member</nova:user>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:project uuid="db1dc6979a244982823fef41c57d1c75">tempest-AttachVolumeShelveTestJSON-1300734613</nova:project>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         <nova:port uuid="9b754c38-a97e-4220-96e5-625800c5d818">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <system>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <entry name="serial">5b580f8d-61fa-4994-822f-0500e14eeced</entry>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <entry name="uuid">5b580f8d-61fa-4994-822f-0500e14eeced</entry>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </system>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <os>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   </os>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <features>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   </features>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   <devices>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:05:3b:49"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <target dev="tap9b754c38-a9"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </interface>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/console.log" append="off"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </serial>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <video>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </video>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </rng>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:   </devices>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]: </domain>
May 28 14:15:25.146597 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:15:25.148610 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Preparing to wait for external event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:15:25.148610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:25.148610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:25.148610 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:25.148747 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-253298750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-253298750',id=52,image_ref='ce453fce-4c54-4515-adea-fc7683b8f88c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1418715405',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:14:17Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-lw0yqruz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member',shelved_at='2026-05-28T14:15:04.843793',shelved_host='np0000001643',shelved_image_id='ce453fce-4c54-4515-adea-fc7683b8f88c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=5b580f8d-61fa-4994-822f-0500e14eeced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:15:25.149545 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:25.149545 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:25.149893 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:15:25.150118 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:25.150305 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:25.150547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:15:25.151605 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:25.151823 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab813fb1-b30e-52cf-bc02-c295725871d1', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:25.152720 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:25.154180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:25.155841 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:25.156032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b754c38-a9, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:25.156594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b754c38-a9, col_values=(('qos', UUID('0717a641-e584-4ef4-ad21-e5119d99fc1c')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:25.156772 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b754c38-a9, col_values=(('external_ids', {'iface-id': '9b754c38-a97e-4220-96e5-625800c5d818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:3b:49', 'vm-uuid': '5b580f8d-61fa-4994-822f-0500e14eeced'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:25.157730 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:25.159188 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:25.162846 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:25.164766 np0000001643 nova-compute[98269]: INFO os_vif [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9')
May 28 14:15:25.266126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:25.266126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:25.506229 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004491029999371676 future=<Future at 0x71a75c35bda0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:25.507650 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779977710.505649, bfac770e-7430-4353-9f3c-ec438536a7c3 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:25.507870 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:25.508196 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] VM Stopped (Lifecycle Event)
May 28 14:15:25.508991 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=13.327366093999899 future=<Future at 0x71a7801b4cb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:25.510270 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=13.326299819999804 future=<Future at 0x71a7801b4cb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:25.531165 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1444708d-e444-41a5-88c4-55da54427854 req-4a6d5eb3-ff7e-4058-bcb9-53ec1485750f service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-vif-deleted-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:25.531165 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-1444708d-e444-41a5-88c4-55da54427854 req-4a6d5eb3-ff7e-4058-bcb9-53ec1485750f service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Neutron deleted interface 06677b0d-9214-446b-8dfe-871a0743bb62; detaching it from the instance and deleting it from the info cache
May 28 14:15:25.533994 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1444708d-e444-41a5-88c4-55da54427854 req-4a6d5eb3-ff7e-4058-bcb9-53ec1485750f service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Detach interface failed, port_id=06677b0d-9214-446b-8dfe-871a0743bb62, reason: Instance eadb7b17-f3e3-46c7-9149-04c4b94fc699 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:15:25.768704 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Detaching volume 2f977427-94bd-4baa-8f9b-1a1284a74053
May 28 14:15:25.811993 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to driver detach volume 2f977427-94bd-4baa-8f9b-1a1284a74053 from mountpoint /dev/vdb
May 28 14:15:25.819523 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-2f977427-94bd-4baa-8f9b-1a1284a74053 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:25.821800 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-2f977427-94bd-4baa-8f9b-1a1284a74053 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:25.821800 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Attempting to detach device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:15:25.821800 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:25.821800 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:25.821800 np0000001643 nova-compute[98269]:   <alias name="ua-2f977427-94bd-4baa-8f9b-1a1284a74053"/>
May 28 14:15:25.821800 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:25.821800 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:25.821800 np0000001643 nova-compute[98269]:   <serial>2f977427-94bd-4baa-8f9b-1a1284a74053</serial>
May 28 14:15:25.821800 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:25.821800 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:25.821800 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:25.832373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e055d7d0-5a12-46bc-9774-25f9a8d71a2c req-e70c49eb-d4ba-44d2-80d6-ad38279453a7 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-vif-unplugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:25.832373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e055d7d0-5a12-46bc-9774-25f9a8d71a2c req-e70c49eb-d4ba-44d2-80d6-ad38279453a7 service nova] Acquiring lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:25.832373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e055d7d0-5a12-46bc-9774-25f9a8d71a2c req-e70c49eb-d4ba-44d2-80d6-ad38279453a7 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:25.832373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e055d7d0-5a12-46bc-9774-25f9a8d71a2c req-e70c49eb-d4ba-44d2-80d6-ad38279453a7 service nova] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:25.832373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e055d7d0-5a12-46bc-9774-25f9a8d71a2c req-e70c49eb-d4ba-44d2-80d6-ad38279453a7 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] No waiting events found dispatching network-vif-unplugged-06677b0d-9214-446b-8dfe-871a0743bb62 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:25.832373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e055d7d0-5a12-46bc-9774-25f9a8d71a2c req-e70c49eb-d4ba-44d2-80d6-ad38279453a7 service nova] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Received event network-vif-unplugged-06677b0d-9214-446b-8dfe-871a0743bb62 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:25.836790 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config.
May 28 14:15:25.836790 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] (1/8): Attempting to detach device vdb with device alias ua-2f977427-94bd-4baa-8f9b-1a1284a74053 from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:15:25.836790 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:25.836790 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:25.836790 np0000001643 nova-compute[98269]:   <alias name="ua-2f977427-94bd-4baa-8f9b-1a1284a74053"/>
May 28 14:15:25.836790 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:25.836790 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:25.836790 np0000001643 nova-compute[98269]:   <serial>2f977427-94bd-4baa-8f9b-1a1284a74053</serial>
May 28 14:15:25.836790 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:25.836790 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:25.836790 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:25.993809 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:26.013456 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: bfac770e-7430-4353-9f3c-ec438536a7c3] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:26.396774 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977726.396328, a95922fd-8d79-43bc-9052-e05f100abb79 => ua-2f977427-94bd-4baa-8f9b-1a1284a74053> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:15:26.400420 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2f977427-94bd-4baa-8f9b-1a1284a74053 for instance a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:15:26.403516 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config.
May 28 14:15:26.404920 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:26.405229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f977427-94bd-4baa-8f9b-1a1284a74053', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:26.405412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:26.405818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:26.406121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f977427-94bd-4baa-8f9b-1a1284a74053', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:26.406277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053 (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:26.436826 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:26.437226 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '143')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:26.437226 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '140')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:26.438346 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053', '141')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:26.439099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c173ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:26.439339 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:15:26.439619 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Flush multipath device 3300000004d3b8ac8 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:15:26.476853 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:26.496122 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Took 1.58 seconds to deallocate network for instance.
May 28 14:15:26.526750 np0000001643 nova-compute[98269]: WARNING nova.volume.cinder [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Attachment 96f9806f-3992-49da-8b7b-8bfd498a2729 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 96f9806f-3992-49da-8b7b-8bfd498a2729. (HTTP 404) (Request-ID: req-441348f0-a248-45be-8769-d48cb66b98c6)
May 28 14:15:26.527127 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Took 0.03 seconds to detach 1 volumes for instance.
May 28 14:15:26.548514 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:26.584195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:15:26.584363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:15:26.585134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:15:26.599895 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:15:26.599895 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:26.611213 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:26.637025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.40.100,3260]
May 28 14:15:26.637025 np0000001643 nova-compute[98269]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.40.100,3260] successful.
May 28 14:15:26.637025 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:26.652994 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:26.664227 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:26.684986 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:26.686487 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:26.686487 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] No VIF found with MAC fa:16:3e:05:3b:49, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:26.686487 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Using config drive
May 28 14:15:26.694722 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.50.100,3260]
May 28 14:15:26.694722 np0000001643 nova-compute[98269]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-2f977427-94bd-4baa-8f9b-1a1284a74053, portal: 192.168.50.100,3260] successful.
May 28 14:15:26.694722 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:26.707217 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:26.707477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:26.707584 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== disconnect_volume: return (301ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:26.707711 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:27.033779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:27.036933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:27.037175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:27.102641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:27.102853 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:27.191313 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:27.262473 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:27.344985 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:27.345249 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:27.595083 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] opening encrypted volume /dev/dm-3 {{(pid=98269) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 14:15:27.604565 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:15:27.692464 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<5b580f8d-61fa-4994-822f-0500e14eeced> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:15:27.692664 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'keypairs' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:27.848135 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:28.177998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:28.195243 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Object Instance<5b580f8d-61fa-4994-822f-0500e14eeced> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:15:28.198916 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:28.269539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3c1996d0-b558-4afd-a442-9e8e4829e9e9 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:28.355160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.318s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:28.357747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.179s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:28.365199 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:15:28.365199 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Claim successful on node np0000001643
May 28 14:15:28.375944 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Creating config drive at /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config
May 28 14:15:28.380900 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp93ncnnyk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:28.448400 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Deleted allocations for instance eadb7b17-f3e3-46c7-9149-04c4b94fc699
May 28 14:15:28.456747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp93ncnnyk" returned: 0 in 0.076s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:28.796547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:28.944819 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:28.968060 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:29.089800 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:29.141141 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ac02b823-5ba7-4fa5-a397-04608ad61ed5 req-4a1c6b92-c4c3-4350-88ce-ee73606d28fe service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:29.142414 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac02b823-5ba7-4fa5-a397-04608ad61ed5 req-4a1c6b92-c4c3-4350-88ce-ee73606d28fe service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:29.144255 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac02b823-5ba7-4fa5-a397-04608ad61ed5 req-4a1c6b92-c4c3-4350-88ce-ee73606d28fe service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:29.145931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac02b823-5ba7-4fa5-a397-04608ad61ed5 req-4a1c6b92-c4c3-4350-88ce-ee73606d28fe service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:29.146173 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ac02b823-5ba7-4fa5-a397-04608ad61ed5 req-4a1c6b92-c4c3-4350-88ce-ee73606d28fe service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Processing event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:15:29.353634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:29.354480 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:29.356456 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:29.378569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:29.468180 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-759a10e1-51c7-4e44-a88f-8680745a08e9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "eadb7b17-f3e3-46c7-9149-04c4b94fc699" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.511s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:29.679852 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:29.680202 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:29.741483 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:29.799169 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977729.7987232, 5b580f8d-61fa-4994-822f-0500e14eeced => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:29.799391 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Started (Lifecycle Event)
May 28 14:15:29.801634 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:15:29.805024 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:15:29.808464 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance spawned successfully.
May 28 14:15:29.869298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:29.869668 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:30.136565 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1418566921',display_name='tempest-TestVolumeBootPattern-server-1418566921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1418566921',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-pw1me006',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:15Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=cd89555b-2493-48a9-a79e-92cd51efcb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:15:30.136565 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:30.136565 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:1e,bridge_name='br-int',has_traffic_filtering=True,id=523bc512-052f-4da1-9254-e3e0e793f5a5,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523bc512-05') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:30.137473 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid cd89555b-2493-48a9-a79e-92cd51efcb1e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:30.159224 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.183218 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:30.266184 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:30.304171 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:30.306625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:30.373701 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] End _get_guest_xml xml=<domain type="qemu">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <uuid>cd89555b-2493-48a9-a79e-92cd51efcb1e</uuid>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <name>instance-00000037</name>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-1418566921</nova:name>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:15:17</nova:creationTime>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:properties/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         <nova:port uuid="523bc512-052f-4da1-9254-e3e0e793f5a5">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <system>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <entry name="serial">cd89555b-2493-48a9-a79e-92cd51efcb1e</entry>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <entry name="uuid">cd89555b-2493-48a9-a79e-92cd51efcb1e</entry>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </system>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <os>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   </os>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <features>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   </features>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   <devices>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e/disk.config"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <alias name="ua-e07a66ec-c310-47ef-9689-c223103a4c5e"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <serial>e07a66ec-c310-47ef-9689-c223103a4c5e</serial>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:6f:71:1e"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <target dev="tap523bc512-05"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </interface>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e/console.log" append="off"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </serial>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <video>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </video>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </rng>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:   </devices>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: </domain>
May 28 14:15:30.643953 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Preparing to wait for external event network-vif-plugged-523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1418566921',display_name='tempest-TestVolumeBootPattern-server-1418566921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1418566921',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-pw1me006',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:15Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=cd89555b-2493-48a9-a79e-92cd51efcb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:1e,bridge_name='br-int',has_traffic_filtering=True,id=523bc512-052f-4da1-9254-e3e0e793f5a5,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523bc512-05') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:30.643953 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:1e,bridge_name='br-int',has_traffic_filtering=True,id=523bc512-052f-4da1-9254-e3e0e793f5a5,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523bc512-05') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:15:30.647086 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.647403 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:30.647664 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:15:30.648974 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.649168 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '242f4866-ec8e-5104-b7b3-fdf802cd8a90', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:30.650150 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.650829 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:30.650881 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.652705 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.652918 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap523bc512-05, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:30.653175 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap523bc512-05, col_values=(('qos', UUID('d119f4f9-f409-4390-85d0-cfd28b0fe72e')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:30.653372 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap523bc512-05, col_values=(('external_ids', {'iface-id': '523bc512-052f-4da1-9254-e3e0e793f5a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:71:1e', 'vm-uuid': 'cd89555b-2493-48a9-a79e-92cd51efcb1e'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:30.654294 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.655339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:30.659864 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:30.661338 np0000001643 nova-compute[98269]: INFO os_vif [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:1e,bridge_name='br-int',has_traffic_filtering=True,id=523bc512-052f-4da1-9254-e3e0e793f5a5,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523bc512-05')
May 28 14:15:30.692328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.335s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:30.692848 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:15:30.774482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a7d39aeb-85c0-41a7-8643-a39950531363 tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.964s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:30.809388 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:15:30.809688 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977730.8095016, 5b580f8d-61fa-4994-822f-0500e14eeced => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:30.809818 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Paused (Lifecycle Event)
May 28 14:15:30.827047 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:30.827369 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:30.827617 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:30.827965 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:30.828111 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:15:30.828442 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:15:31.202039 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:15:31.202039 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:15:31.202039 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:31.202039 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:31.248847 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b24db25b-bf34-4948-aadc-42ea9357dbe3 req-8438ee21-08a7-4bc0-b223-ae165b744645 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:31.249017 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b24db25b-bf34-4948-aadc-42ea9357dbe3 req-8438ee21-08a7-4bc0-b223-ae165b744645 service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:31.249180 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b24db25b-bf34-4948-aadc-42ea9357dbe3 req-8438ee21-08a7-4bc0-b223-ae165b744645 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:31.249290 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b24db25b-bf34-4948-aadc-42ea9357dbe3 req-8438ee21-08a7-4bc0-b223-ae165b744645 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:31.249401 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b24db25b-bf34-4948-aadc-42ea9357dbe3 req-8438ee21-08a7-4bc0-b223-ae165b744645 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] No waiting events found dispatching network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:31.249557 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b24db25b-bf34-4948-aadc-42ea9357dbe3 req-8438ee21-08a7-4bc0-b223-ae165b744645 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received unexpected event network-vif-plugged-9b754c38-a97e-4220-96e5-625800c5d818 for instance with vm_state active and task_state None.
May 28 14:15:31.312969 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:31.316982 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977731.316738, 5b580f8d-61fa-4994-822f-0500e14eeced => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:31.317139 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Resumed (Lifecycle Event)
May 28 14:15:31.336057 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7176e758f6d947a2b2003d06c1d4746d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572d5a96a90c4dd8931ed98ccfafc8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:15:31.380133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:31.703417 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:15:31.819538 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:31.821270 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:31.827067 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:31.970254 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Successfully created port: 38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:15:32.180975 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:32.181124 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:32.181291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:6f:71:1e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:32.181749 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Using config drive
May 28 14:15:32.207949 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:15:32.319840 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:32.331232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:32.331433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:32.331582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:32.331707 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:15:32.454176 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:32.456696 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:32.456696 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attaching volume 067a2fbf-35ce-478a-92e1-224b7939ed73 to /dev/vdb
May 28 14:15:32.509870 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:32.516962 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Successfully updated port: 38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:15:32.524159 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:15:32.549095 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:32.596781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:15:32.597121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:15:32.610184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:15:32.611574 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe05:3b49', 'fe80::64c0:f7ff:fe14:ca9b'] 
May 28 14:15:32.611676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:15:32.611801 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:15:32.612121 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:32.612440 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating existing volume attachment record: dd2ffbf2-33be-4b24-b5e5-e067f16ac754 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:15:32.688655 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:32.825471 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Creating config drive at /opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e/disk.config
May 28 14:15:32.828270 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4g0uqmn4 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:32.881138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4g0uqmn4" returned: 0 in 0.053s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.021994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "refresh_cache-1e9ba9ee-c26c-4306-b19f-02404513e577" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:33.022124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquired lock "refresh_cache-1e9ba9ee-c26c-4306-b19f-02404513e577" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:33.022312 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:15:33.175806 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:15:33.176187 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '067a2fbf-35ce-478a-92e1-224b7939ed73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:33.176341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:33.176696 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:33.176911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '067a2fbf-35ce-478a-92e1-224b7939ed73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:15:33.188137 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:33.188818 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:33.189319 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:33.189549 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:33.189952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:33.190165 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:33.202082 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:33.202082 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:33.203989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:33.203989 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:33.215489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73] added
May 28 14:15:33.215489 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:33.215489 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:33.215489 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:33.215489 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:33.215489 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:33.215489 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:33.215761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:33.215875 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:33.216049 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:33.217617 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:15:33.219741 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73] added
May 28 14:15:33.219741 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:33.219741 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:33.219741 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:33.219741 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:33.219741 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:33.219741 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:33.220038 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:15:33.220214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:33.220410 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:33.220565 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:33.221778 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Creating image(s)
May 28 14:15:33.222313 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:33.222535 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "/opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:33.222991 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "/opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:33.223511 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:33.226680 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:33.228100 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.322900 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-changed-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:33.323138 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Refreshing instance network info cache due to event network-changed-38c0b70c-ba07-4948-9381-4062929b055f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:33.323914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] Acquiring lock "refresh_cache-1e9ba9ee-c26c-4306-b19f-02404513e577" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:33.324161 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.324528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:33.324876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:33.325261 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:33.327902 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:33.329210 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:33.331007 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.353777 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:33.375584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.441752 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:33.443615 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.112s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.444169 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.500709 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.501344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.524868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk 1073741824" returned: 0 in 0.080s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.534289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:33.540470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.612537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.617527 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-3 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:15:33.620432 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:33.625101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.652537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.114s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.654726 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:15:33.654726 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.719344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.719830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.747759 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:33.751722 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:33.752507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:33.771661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.773429 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Cannot resize image /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:15:33.773429 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:15:33.773429 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Ensure instance console log exists: /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:15:33.774235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:33.774671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:33.774859 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:33.776792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:33.835820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.850014 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:15:33.851285 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:33.913895 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:33.916120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.065s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:33.916120 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=13147MB free_disk=72.91022491455078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:15:33.916120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:33.916388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:34.055283 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Updating instance_info_cache with network_info: [{"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:34.136331 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977734.1359668, cd89555b-2493-48a9-a79e-92cd51efcb1e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:34.136580 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] VM Started (Lifecycle Event)
May 28 14:15:34.218556 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:34.220976 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:34.229461 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:34.229461 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:34.234682 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:34.234682 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.240042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.245776 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.251953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.251953 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.251953 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:34.252168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.252168 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.252168 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:34.258671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.258671 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.258671 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:34.258671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.258671 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.258671 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:34.283840 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.40.100,3260]
May 28 14:15:34.283840 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.40.100,3260] successful.
May 28 14:15:34.283840 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.295789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.308248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.50.100,3260]
May 28 14:15:34.308248 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.50.100,3260] successful.
May 28 14:15:34.308248 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.308870 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.308870 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.308870 np0000001643 nova-compute[98269]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.308870 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.308870 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:34.309131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.309131 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.309131 np0000001643 nova-compute[98269]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.309131 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.309131 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:34.309524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:34.309647 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:34.310316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('7', '-', '-', 0) found on session 144 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:34.310424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:34.319386 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:34.328695 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 144 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:34.328695 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '067a2fbf-35ce-478a-92e1-224b7939ed73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:34.333987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.333987 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.333987 np0000001643 nova-compute[98269]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.333987 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.333987 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:34.334202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.334202 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:34.334202 np0000001643 nova-compute[98269]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.334202 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:34.334202 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:34.334574 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:34.334732 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:34.335482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('8', '-', '-', 0) found on session 145 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:34.335627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:34.350335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 145 and hctl ['8', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:34.558550 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Releasing lock "refresh_cache-1e9ba9ee-c26c-4306-b19f-02404513e577" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:34.558550 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Instance network_info: |[{"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:15:34.558550 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] Acquired lock "refresh_cache-1e9ba9ee-c26c-4306-b19f-02404513e577" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:34.558550 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Refreshing network info cache for port 38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:34.563884 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Start _get_guest_xml network_info=[{"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:15:34.571078 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:15:34.573296 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-1163851675', uuid='1e9ba9ee-c26c-4306-b19f-02404513e577'), owner=OwnerMeta(userid='7176e758f6d947a2b2003d06c1d4746d', username='tempest-VolumesNegativeTest-1180157317-project-member', projectid='572d5a96a90c4dd8931ed98ccfafc8e7', projectname='tempest-VolumesNegativeTest-1180157317'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977734.572778) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:15:34.574981 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:15:34.576353 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:15:34.579675 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:15:34.579921 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:15:34.580928 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:15:34.581283 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:15:34.581421 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:15:34.581529 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:15:34.581654 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:15:34.581763 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:15:34.581885 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:15:34.582026 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:15:34.582123 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:15:34.582239 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:15:34.582346 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:15:34.585073 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:15:34.597371 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1163851675',display_name='tempest-VolumesNegativeTest-instance-1163851675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesnegativetest-instance-1163851675',id=56,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572d5a96a90c4dd8931ed98ccfafc8e7',ramdisk_id='',reservation_id='r-kyvenody',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1180157317',owner_user_name='tempest-VolumesNegativeTest-1180157317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:32Z,user_data=None,user_id='7176e758f6d947a2b2003d06c1d4746d',uuid=1e9ba9ee-c26c-4306-b19f-02404513e577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:15:34.597624 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Converting VIF {"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:34.598128 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:29:7b,bridge_name='br-int',has_traffic_filtering=True,id=38c0b70c-ba07-4948-9381-4062929b055f,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c0b70c-ba') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:34.598655 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e9ba9ee-c26c-4306-b19f-02404513e577 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:34.640490 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:34.642508 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977734.6422539, cd89555b-2493-48a9-a79e-92cd51efcb1e => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:34.642644 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] VM Paused (Lifecycle Event)
May 28 14:15:34.745268 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:34.894350 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:34.980741 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance a95922fd-8d79-43bc-9052-e05f100abb79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:15:34.980857 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance cd89555b-2493-48a9-a79e-92cd51efcb1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:15:34.980975 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 5b580f8d-61fa-4994-822f-0500e14eeced actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:15:34.981038 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 1e9ba9ee-c26c-4306-b19f-02404513e577 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:15:34.981220 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:15:34.981355 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:15:33 up 42 min,  2 users,  load average: 5.14, 5.82, 4.60\n', 'num_instances': '4', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_816dec0e07ba4bd596fac38e7df5e9db': '1', 'io_workload': '2', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1', 'num_proj_572d5a96a90c4dd8931ed98ccfafc8e7': '1', 'num_proj_db1dc6979a244982823fef41c57d1c75': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:15:35.065346 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:35.102814 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] End _get_guest_xml xml=<domain type="qemu">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <uuid>1e9ba9ee-c26c-4306-b19f-02404513e577</uuid>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <name>instance-00000038</name>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesNegativeTest-instance-1163851675</nova:name>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:15:34</nova:creationTime>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:user uuid="7176e758f6d947a2b2003d06c1d4746d">tempest-VolumesNegativeTest-1180157317-project-member</nova:user>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:project uuid="572d5a96a90c4dd8931ed98ccfafc8e7">tempest-VolumesNegativeTest-1180157317</nova:project>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         <nova:port uuid="38c0b70c-ba07-4948-9381-4062929b055f">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="192.168.233.66" ipVersion="4"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <system>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <entry name="serial">1e9ba9ee-c26c-4306-b19f-02404513e577</entry>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <entry name="uuid">1e9ba9ee-c26c-4306-b19f-02404513e577</entry>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </system>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <os>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   </os>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <features>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   </features>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   <devices>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk.config"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:e2:29:7b"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <target dev="tap38c0b70c-ba"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </interface>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/console.log" append="off"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </serial>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <video>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </video>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </rng>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:   </devices>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]: </domain>
May 28 14:15:35.102814 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:15:35.104543 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Preparing to wait for external event network-vif-plugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:15:35.104543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:35.104543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:35.104543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:35.104543 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1163851675',display_name='tempest-VolumesNegativeTest-instance-1163851675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesnegativetest-instance-1163851675',id=56,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572d5a96a90c4dd8931ed98ccfafc8e7',ramdisk_id='',reservation_id='r-kyvenody',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1180157317',owner_user_name='tempest-VolumesNegativeTest-1180157317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:32Z,user_data=None,user_id='7176e758f6d947a2b2003d06c1d4746d',uuid=1e9ba9ee-c26c-4306-b19f-02404513e577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:15:35.104543 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Converting VIF {"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:35.106749 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:29:7b,bridge_name='br-int',has_traffic_filtering=True,id=38c0b70c-ba07-4948-9381-4062929b055f,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c0b70c-ba') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:35.108397 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:29:7b,bridge_name='br-int',has_traffic_filtering=True,id=38c0b70c-ba07-4948-9381-4062929b055f,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c0b70c-ba') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:15:35.109062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:35.109464 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:35.109706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:15:35.110459 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:35.110652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b51e1159-17a5-5c6b-a019-76bf2c36e6db', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:35.112744 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:35.114891 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:35.114891 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38c0b70c-ba, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:35.115249 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38c0b70c-ba, col_values=(('qos', UUID('901b95fc-8114-478a-83d0-e27f85d8bb36')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:35.115412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38c0b70c-ba, col_values=(('external_ids', {'iface-id': '38c0b70c-ba07-4948-9381-4062929b055f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:29:7b', 'vm-uuid': '1e9ba9ee-c26c-4306-b19f-02404513e577'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:35.117580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:35.122506 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:35.123552 np0000001643 nova-compute[98269]: INFO os_vif [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:29:7b,bridge_name='br-int',has_traffic_filtering=True,id=38c0b70c-ba07-4948-9381-4062929b055f,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c0b70c-ba')
May 28 14:15:35.148126 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:35.150012 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:35.230485 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:35.230746 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:35.350570 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 145 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:35.350570 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '067a2fbf-35ce-478a-92e1-224b7939ed73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:35.412876 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:35.555437 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Updated VIF entry in instance network info cache for port 38c0b70c-ba07-4948-9381-4062929b055f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:15:35.555728 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Updating instance_info_cache with network_info: [{"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:35.651964 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:15:35.733511 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:36.058273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe93d78c-5f96-41c0-9efe-779f0b7a2ff0 req-b260ab1a-2444-4f63-981e-1a589df76724 service nova] Releasing lock "refresh_cache-1e9ba9ee-c26c-4306-b19f-02404513e577" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:36.214377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found WWN 330000000e621dbfe for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:15:36.214752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:36.214993 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000e621dbfe', 'path': '/dev/dm-1', 'multipath_id': '330000000e621dbfe'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:36.215179 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e621dbfe', 'path': '/dev/dm-1', 'multipath_id': '330000000e621dbfe'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:15:36.218506 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:36.240969 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:15:36.240969 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.324s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:36.245000 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:15:36.643893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:36.644112 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:36.644301 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] No VIF found with MAC fa:16:3e:e2:29:7b, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:36.645228 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Using config drive
May 28 14:15:36.721485 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to attach volume 067a2fbf-35ce-478a-92e1-224b7939ed73 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:15:36.723266 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:15:36.723266 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:36.723266 np0000001643 nova-compute[98269]:   <alias name="ua-067a2fbf-35ce-478a-92e1-224b7939ed73"/>
May 28 14:15:36.723266 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:36.723266 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:36.723266 np0000001643 nova-compute[98269]:   <serial>067a2fbf-35ce-478a-92e1-224b7939ed73</serial>
May 28 14:15:36.723266 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:36.723266 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:15:37.150734 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:37.244691 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:37.245251 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.58 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:15:37.303631 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Creating config drive at /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk.config
May 28 14:15:37.306736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8bscifnf {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:37.378699 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-acf99562-3c26-4387-a818-c63e9b0adbbd req-f671f9a1-0e6d-47e4-bab0-a9247256e116 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Received event network-vif-plugged-523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:37.378996 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-acf99562-3c26-4387-a818-c63e9b0adbbd req-f671f9a1-0e6d-47e4-bab0-a9247256e116 service nova] Acquiring lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:37.379220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-acf99562-3c26-4387-a818-c63e9b0adbbd req-f671f9a1-0e6d-47e4-bab0-a9247256e116 service nova] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:37.379367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-acf99562-3c26-4387-a818-c63e9b0adbbd req-f671f9a1-0e6d-47e4-bab0-a9247256e116 service nova] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:37.379817 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-acf99562-3c26-4387-a818-c63e9b0adbbd req-f671f9a1-0e6d-47e4-bab0-a9247256e116 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Processing event network-vif-plugged-523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:15:37.383088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8bscifnf" returned: 0 in 0.074s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:37.388584 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:15:37.401289 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:15:37.402439 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977737.4016786, cd89555b-2493-48a9-a79e-92cd51efcb1e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:37.402439 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] VM Resumed (Lifecycle Event)
May 28 14:15:37.411671 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Instance spawned successfully.
May 28 14:15:37.412476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:15:37.437317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:37.437543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:37.826960 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:37.827385 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:15:37.900461 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:37.908366 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:37.920183 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:37.926817 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:37.927015 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:37.927338 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:37.927585 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:37.927803 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:37.928051 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:37.940821 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:15:37.978730 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:38.039533 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:38.167747 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe13f07a-533b-43f4-98f3-034fbabba7c7 req-a0215d1c-a08a-4f96-862f-4e471ac71073 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-vif-plugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:38.169319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe13f07a-533b-43f4-98f3-034fbabba7c7 req-a0215d1c-a08a-4f96-862f-4e471ac71073 service nova] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:38.171110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe13f07a-533b-43f4-98f3-034fbabba7c7 req-a0215d1c-a08a-4f96-862f-4e471ac71073 service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:38.171110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fe13f07a-533b-43f4-98f3-034fbabba7c7 req-a0215d1c-a08a-4f96-862f-4e471ac71073 service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:38.171110 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe13f07a-533b-43f4-98f3-034fbabba7c7 req-a0215d1c-a08a-4f96-862f-4e471ac71073 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Processing event network-vif-plugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:15:38.311015 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:38.314035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:38.341786 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:38.396900 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:38.397012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:38.397131 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:38.397259 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No VIF found with MAC fa:16:3e:12:ea:68, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:38.426326 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:15:38.436580 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Took 20.48 seconds to spawn the instance on the hypervisor.
May 28 14:15:38.436987 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:38.520261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:38.520476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:38.523970 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:15:38.523970 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Claim successful on node np0000001643
May 28 14:15:38.734991 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977738.7347066, 1e9ba9ee-c26c-4306-b19f-02404513e577 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:38.735122 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] VM Started (Lifecycle Event)
May 28 14:15:38.736587 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:15:38.742055 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:15:38.745734 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Instance spawned successfully.
May 28 14:15:38.746235 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:15:38.836764 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00046883400000297115 future=<Future at 0x71a7801b4cb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:38.837266 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Emitting event <LifecycleEvent: 1779977723.836123, eadb7b17-f3e3-46c7-9149-04c4b94fc699 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:38.837396 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:38.837546 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] VM Stopped (Lifecycle Event)
May 28 14:15:38.946926 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Took 27.63 seconds to build instance.
May 28 14:15:39.101628 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:39.101791 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:39.238207 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:39.241194 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:39.252795 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:39.252951 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:39.253265 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:39.255500 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:39.255500 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:39.255500 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:39.340077 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: eadb7b17-f3e3-46c7-9149-04c4b94fc699] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:39.447987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-783c4994-46c9-4baf-874b-9ebd594d6b04 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.138s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:39.457861 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f0dfc9a3-e805-41fd-b187-2fc5887c0e39 req-ba011b13-707c-4ce1-8318-80ea8dcacc1b service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Received event network-vif-plugged-523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:39.458038 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f0dfc9a3-e805-41fd-b187-2fc5887c0e39 req-ba011b13-707c-4ce1-8318-80ea8dcacc1b service nova] Acquiring lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:39.458218 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f0dfc9a3-e805-41fd-b187-2fc5887c0e39 req-ba011b13-707c-4ce1-8318-80ea8dcacc1b service nova] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:39.458320 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f0dfc9a3-e805-41fd-b187-2fc5887c0e39 req-ba011b13-707c-4ce1-8318-80ea8dcacc1b service nova] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:39.458428 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f0dfc9a3-e805-41fd-b187-2fc5887c0e39 req-ba011b13-707c-4ce1-8318-80ea8dcacc1b service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] No waiting events found dispatching network-vif-plugged-523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:39.458581 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-f0dfc9a3-e805-41fd-b187-2fc5887c0e39 req-ba011b13-707c-4ce1-8318-80ea8dcacc1b service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Received unexpected event network-vif-plugged-523bc512-052f-4da1-9254-e3e0e793f5a5 for instance with vm_state active and task_state deleting.
May 28 14:15:39.603490 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:15:39.743340 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:15:39.743614 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977739.7434106, 1e9ba9ee-c26c-4306-b19f-02404513e577 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:39.743755 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] VM Paused (Lifecycle Event)
May 28 14:15:39.744769 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:39.759596 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Took 6.54 seconds to spawn the instance on the hypervisor.
May 28 14:15:39.759800 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:39.824470 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:15:39.824470 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:15:39.833266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "cd89555b-2493-48a9-a79e-92cd51efcb1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:39.833266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:39.833266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:39.833266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:39.833266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:39.836918 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Terminating instance
May 28 14:15:39.870756 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:39.872168 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:39.956795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-b3482620-72ac-49aa-adb7-77b1157bf795 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.502s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:40.132474 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:40.159601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:40.229471 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6bd3a269-1bd9-404b-bf9f-bad5f8dc80c7 req-251aeccf-82c7-439b-83f6-5200e5fc8bab service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-vif-plugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:40.229471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6bd3a269-1bd9-404b-bf9f-bad5f8dc80c7 req-251aeccf-82c7-439b-83f6-5200e5fc8bab service nova] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:40.229471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6bd3a269-1bd9-404b-bf9f-bad5f8dc80c7 req-251aeccf-82c7-439b-83f6-5200e5fc8bab service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:40.229471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6bd3a269-1bd9-404b-bf9f-bad5f8dc80c7 req-251aeccf-82c7-439b-83f6-5200e5fc8bab service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:40.229471 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6bd3a269-1bd9-404b-bf9f-bad5f8dc80c7 req-251aeccf-82c7-439b-83f6-5200e5fc8bab service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] No waiting events found dispatching network-vif-plugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:40.229471 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6bd3a269-1bd9-404b-bf9f-bad5f8dc80c7 req-251aeccf-82c7-439b-83f6-5200e5fc8bab service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received unexpected event network-vif-plugged-38c0b70c-ba07-4948-9381-4062929b055f for instance with vm_state active and task_state None.
May 28 14:15:40.248593 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:40.252884 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977740.2505903, 1e9ba9ee-c26c-4306-b19f-02404513e577 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:40.252884 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] VM Resumed (Lifecycle Event)
May 28 14:15:40.274663 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Took 12.16 seconds to build instance.
May 28 14:15:40.345461 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:15:40.366283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:40.374953 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:40.391439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:40.411832 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:40.419579 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:40.669750 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Instance destroyed successfully.
May 28 14:15:40.670295 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid cd89555b-2493-48a9-a79e-92cd51efcb1e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:40.753625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:40.756987 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:40.776211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-54b691e8-f70d-47ba-84b4-e910f0d678e6 tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.673s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:40.884329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.364s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:40.884891 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:15:40.889283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.725s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:40.893477 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:15:40.893477 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Claim successful on node np0000001643
May 28 14:15:41.174033 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1418566921',display_name='tempest-TestVolumeBootPattern-server-1418566921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1418566921',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:15:38Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-pw1me006',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:15:38Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=cd89555b-2493-48a9-a79e-92cd51efcb1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:15:41.174227 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "523bc512-052f-4da1-9254-e3e0e793f5a5", "address": "fa:16:3e:6f:71:1e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap523bc512-05", "ovs_interfaceid": "523bc512-052f-4da1-9254-e3e0e793f5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:41.174768 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:1e,bridge_name='br-int',has_traffic_filtering=True,id=523bc512-052f-4da1-9254-e3e0e793f5a5,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523bc512-05') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:41.175038 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:1e,bridge_name='br-int',has_traffic_filtering=True,id=523bc512-052f-4da1-9254-e3e0e793f5a5,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523bc512-05') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:15:41.176160 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:41.176358 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap523bc512-05, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:41.177211 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:41.178365 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:41.178365 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:41.178725 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:41.178835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d119f4f9-f409-4390-85d0-cfd28b0fe72e) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:41.179367 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:41.180012 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:41.180012 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:41.185804 np0000001643 nova-compute[98269]: INFO os_vif [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:1e,bridge_name='br-int',has_traffic_filtering=True,id=523bc512-052f-4da1-9254-e3e0e793f5a5,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap523bc512-05')
May 28 14:15:41.219665 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': 'cd89555b-2493-48a9-a79e-92cd51efcb1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'serial': 'e07a66ec-c310-47ef-9689-c223103a4c5e'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:15:41.220179 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:15:41.220399 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:15:41.220585 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:15:41.221087 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71a75c18c8f0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': 'cd89555b-2493-48a9-a79e-92cd51efcb1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'serial': 'e07a66ec-c310-47ef-9689-c223103a4c5e'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:15:41.221256 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] closing encrypted volume /dev/dm-0 {{(pid=98269) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 14:15:41.245862 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:41.246144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:41.246318 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:41.246728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:41.246987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e07a66ec-c310-47ef-9689-c223103a4c5e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:41.247154 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:41.258013 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999716335000358 future=<Future at 0x71a7801ec2c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:41.258427 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999282141000094 future=<Future at 0x71a7801ec2c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:41.258833 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998835985000369 future=<Future at 0x71a7801ec2c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:41.275500 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:41.275500 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:41.275500 np0000001643 nova-compute[98269]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:41.275500 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:41.275500 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:41.275762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:41.275762 np0000001643 nova-compute[98269]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e (non-flash)
May 28 14:15:41.275762 np0000001643 nova-compute[98269]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:41.275762 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:41.275762 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:41.275863 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', '145')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:41.275930 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '142')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:41.276756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e', '143')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:41.277565 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780dced40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'): ({'sdg'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:41.277761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:15:41.277990 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 330000000e5b524fc {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:15:41.311176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:41.356050 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:41.391961 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:15:41.392613 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:15:41.393040 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:41.393622 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:41.401100 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:15:41.401276 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:15:41.402061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:15:41.415743 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:15:41.415959 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:41.430289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:41.462157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.40.100,3260]
May 28 14:15:41.462157 np0000001643 nova-compute[98269]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.40.100,3260] successful.
May 28 14:15:41.462157 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:41.479262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:41.479465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:41.479660 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:41.479800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:41.479915 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:41.481623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:41.482983 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Terminating instance
May 28 14:15:41.488732 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4fa943716494225849fb8aac46fb662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503ff5746ac94b068fca926067617b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:15:41.496351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:41.530175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.50.100,3260]
May 28 14:15:41.530175 np0000001643 nova-compute[98269]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-e07a66ec-c310-47ef-9689-c223103a4c5e, portal: 192.168.50.100,3260] successful.
May 28 14:15:41.530175 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:41.543848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:41.545244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:41.545393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (298ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:41.545624 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:41.546024 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Deleting instance files /opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e_del
May 28 14:15:41.547191 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Deletion of /opt/stack/data/nova/instances/cd89555b-2493-48a9-a79e-92cd51efcb1e_del complete
May 28 14:15:41.821513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:41.896892 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:15:41.993715 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:15:42.015999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.023645 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.048494 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Successfully created port: 5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:15:42.055792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.065741 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Took 1.72 seconds to destroy the instance on the hypervisor.
May 28 14:15:42.066467 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:15:42.066654 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:15:42.066722 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:15:42.066924 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:42.078046 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.080809 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.192659 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:42.317322 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-559704c2-58cd-43b2-8285-89cf6609f3df req-ac6ffb50-cebe-4efc-8ae3-01b6983cf07a service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-vif-unplugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:42.317906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-559704c2-58cd-43b2-8285-89cf6609f3df req-ac6ffb50-cebe-4efc-8ae3-01b6983cf07a service nova] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:42.318122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-559704c2-58cd-43b2-8285-89cf6609f3df req-ac6ffb50-cebe-4efc-8ae3-01b6983cf07a service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:42.318310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-559704c2-58cd-43b2-8285-89cf6609f3df req-ac6ffb50-cebe-4efc-8ae3-01b6983cf07a service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:42.318416 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-559704c2-58cd-43b2-8285-89cf6609f3df req-ac6ffb50-cebe-4efc-8ae3-01b6983cf07a service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] No waiting events found dispatching network-vif-unplugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:42.318557 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-559704c2-58cd-43b2-8285-89cf6609f3df req-ac6ffb50-cebe-4efc-8ae3-01b6983cf07a service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-vif-unplugged-38c0b70c-ba07-4948-9381-4062929b055f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:42.357870 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999708671000008 future=<Future at 0x71a77818d850 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:42.359402 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Instance destroyed successfully.
May 28 14:15:42.359735 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lazy-loading 'resources' on Instance uuid 1e9ba9ee-c26c-4306-b19f-02404513e577 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:42.405996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:42.406220 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:42.408306 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:15:42.530637 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9cfbfa5-b68b-450f-a322-677ea7df133a req-cba9f163-906d-49f6-8896-128654bd7909 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Received event network-vif-deleted-523bc512-052f-4da1-9254-e3e0e793f5a5 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:42.530637 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-b9cfbfa5-b68b-450f-a322-677ea7df133a req-cba9f163-906d-49f6-8896-128654bd7909 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Neutron deleted interface 523bc512-052f-4da1-9254-e3e0e793f5a5; detaching it from the instance and deleting it from the info cache
May 28 14:15:42.533027 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9cfbfa5-b68b-450f-a322-677ea7df133a req-cba9f163-906d-49f6-8896-128654bd7909 service nova] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Detach interface failed, port_id=523bc512-052f-4da1-9254-e3e0e793f5a5, reason: Instance cd89555b-2493-48a9-a79e-92cd51efcb1e could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:15:42.748726 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Successfully updated port: 5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:15:42.808198 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-changed-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:42.808585 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Refreshing instance network info cache due to event network-changed-5fd8cc08-7766-472e-80e9-764f3b5820f3. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:42.808751 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] Acquiring lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:42.809069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] Acquired lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:42.809324 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Refreshing network info cache for port 5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:42.866544 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1163851675',display_name='tempest-VolumesNegativeTest-instance-1163851675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesnegativetest-instance-1163851675',id=56,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:15:39Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='572d5a96a90c4dd8931ed98ccfafc8e7',ramdisk_id='',reservation_id='r-kyvenody',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1180157317',owner_user_name='tempest-VolumesNegativeTest-1180157317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:15:40Z,user_data=None,user_id='7176e758f6d947a2b2003d06c1d4746d',uuid=1e9ba9ee-c26c-4306-b19f-02404513e577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:15:42.866827 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Converting VIF {"id": "38c0b70c-ba07-4948-9381-4062929b055f", "address": "fa:16:3e:e2:29:7b", "network": {"id": "8200b736-8dc1-40de-b57d-0dab75537d7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20c487217eff4dc8b342518997c3e985", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c0b70c-ba", "ovs_interfaceid": "38c0b70c-ba07-4948-9381-4062929b055f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:42.867680 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:29:7b,bridge_name='br-int',has_traffic_filtering=True,id=38c0b70c-ba07-4948-9381-4062929b055f,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c0b70c-ba') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:42.868121 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:29:7b,bridge_name='br-int',has_traffic_filtering=True,id=38c0b70c-ba07-4948-9381-4062929b055f,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c0b70c-ba') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:15:42.869388 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.869573 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38c0b70c-ba, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:42.870535 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.871648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:42.871885 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.872559 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.872723 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=901b95fc-8114-478a-83d0-e27f85d8bb36) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:42.873333 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.873887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:42.874314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:42.876058 np0000001643 nova-compute[98269]: INFO os_vif [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:29:7b,bridge_name='br-int',has_traffic_filtering=True,id=38c0b70c-ba07-4948-9381-4062929b055f,network=Network(8200b736-8dc1-40de-b57d-0dab75537d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c0b70c-ba')
May 28 14:15:42.876402 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Deleting instance files /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577_del
May 28 14:15:42.877190 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Deletion of /opt/stack/data/nova/instances/1e9ba9ee-c26c-4306-b19f-02404513e577_del complete
May 28 14:15:42.918961 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:42.978859 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:43.250695 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:43.314779 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:43.384078 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:43.386187 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 14:15:43.386989 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:15:43.387247 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:15:43.387588 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:15:43.387846 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:43.443643 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:15:43.446280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.562s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:43.447268 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:15:43.447554 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:15:43.450494 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Creating image(s)
May 28 14:15:43.451183 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "/opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:43.451332 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "/opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:43.451789 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "/opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:43.452318 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:43.456779 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:43.458164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:43.483891 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Took 1.42 seconds to deallocate network for instance.
May 28 14:15:43.517429 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:43.583343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.125s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:43.583805 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:43.584371 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:43.584986 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:43.588787 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:43.589273 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:43.614201 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:43.644304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:43.644304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:43.702677 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.113s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:43.703253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:43.768089 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk 1073741824" returned: 0 in 0.065s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:43.771206 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:43.771206 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:43.860565 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:43.861147 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:15:43.861348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:43.961896 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:15:43.962305 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:15:43.962538 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:43.962717 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:43.970542 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:43.970893 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Cannot resize image /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:15:43.971742 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:15:43.971858 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Ensure instance console log exists: /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:15:43.972318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:43.973347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:43.973602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:44.033163 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c9efc3ab17f435ca354ca8c621f6ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bedb01ef5467881b271a665929681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:15:44.060818 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Took 0.57 seconds to detach 1 volumes for instance.
May 28 14:15:44.120777 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa42d9f8-a7d1-4641-8222-3044a5ab3e39 req-c2380620-7dc6-439e-8948-d6d671f18546 service nova] Releasing lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:44.121343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquired lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:44.121569 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:15:44.148078 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Detaching volume 067a2fbf-35ce-478a-92e1-224b7939ed73
May 28 14:15:44.193382 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to driver detach volume 067a2fbf-35ce-478a-92e1-224b7939ed73 from mountpoint /dev/vdb
May 28 14:15:44.200879 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-067a2fbf-35ce-478a-92e1-224b7939ed73 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:44.201378 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-067a2fbf-35ce-478a-92e1-224b7939ed73 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:15:44.201580 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Attempting to detach device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:15:44.201892 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:44.201892 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:44.201892 np0000001643 nova-compute[98269]:   <alias name="ua-067a2fbf-35ce-478a-92e1-224b7939ed73"/>
May 28 14:15:44.201892 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:44.201892 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:44.201892 np0000001643 nova-compute[98269]:   <serial>067a2fbf-35ce-478a-92e1-224b7939ed73</serial>
May 28 14:15:44.201892 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:44.201892 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:44.201892 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:44.209480 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config.
May 28 14:15:44.209707 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] (1/8): Attempting to detach device vdb with device alias ua-067a2fbf-35ce-478a-92e1-224b7939ed73 from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:15:44.210010 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:15:44.210010 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:44.210010 np0000001643 nova-compute[98269]:   <alias name="ua-067a2fbf-35ce-478a-92e1-224b7939ed73"/>
May 28 14:15:44.210010 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-1"/>
May 28 14:15:44.210010 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:44.210010 np0000001643 nova-compute[98269]:   <serial>067a2fbf-35ce-478a-92e1-224b7939ed73</serial>
May 28 14:15:44.210010 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:15:44.210010 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:44.210010 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:15:44.269348 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:44.414636 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b4ad9e71-e330-468b-af96-62f22d1c5e2e req-0bd194a8-2455-46a3-9d7e-cc7480e7ca52 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-vif-unplugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:44.414884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b4ad9e71-e330-468b-af96-62f22d1c5e2e req-0bd194a8-2455-46a3-9d7e-cc7480e7ca52 service nova] Acquiring lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:44.415101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b4ad9e71-e330-468b-af96-62f22d1c5e2e req-0bd194a8-2455-46a3-9d7e-cc7480e7ca52 service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:44.415265 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b4ad9e71-e330-468b-af96-62f22d1c5e2e req-0bd194a8-2455-46a3-9d7e-cc7480e7ca52 service nova] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:44.415405 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b4ad9e71-e330-468b-af96-62f22d1c5e2e req-0bd194a8-2455-46a3-9d7e-cc7480e7ca52 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] No waiting events found dispatching network-vif-unplugged-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:44.415586 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b4ad9e71-e330-468b-af96-62f22d1c5e2e req-0bd194a8-2455-46a3-9d7e-cc7480e7ca52 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-vif-unplugged-38c0b70c-ba07-4948-9381-4062929b055f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:15:44.415710 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b4ad9e71-e330-468b-af96-62f22d1c5e2e req-0bd194a8-2455-46a3-9d7e-cc7480e7ca52 service nova] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Received event network-vif-deleted-38c0b70c-ba07-4948-9381-4062929b055f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:44.452720 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Successfully created port: c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:15:44.466109 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:15:44.567937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:44.567937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:44.695474 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977744.6931434, a95922fd-8d79-43bc-9052-e05f100abb79 => ua-067a2fbf-35ce-478a-92e1-224b7939ed73> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:15:44.695474 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-067a2fbf-35ce-478a-92e1-224b7939ed73 for instance a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:15:44.697230 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config.
May 28 14:15:44.700676 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:15:44.701087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '067a2fbf-35ce-478a-92e1-224b7939ed73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:44.701272 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:44.701650 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:44.701940 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '067a2fbf-35ce-478a-92e1-224b7939ed73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:15:44.702075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:15:44.707193 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:44.731329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:44.731329 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:44.731329 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:44.731570 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:44.731570 np0000001643 nova-compute[98269]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73 (non-flash)
May 28 14:15:44.731570 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:44.731669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', '145')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:15:44.731745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', '144')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:44.732524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73', '145')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:15:44.733153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c15ad40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:15:44.733374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:15:44.736468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Flush multipath device 330000000e621dbfe {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:15:44.749632 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:44.767201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:44.770578 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Took 1.38 seconds to deallocate network for instance.
May 28 14:15:44.839244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:15:44.904470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:15:44.904470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:15:44.904470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:15:44.918058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:15:44.918058 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:15:44.932852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:44.939784 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:44.967519 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Successfully updated port: c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:15:44.968293 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.40.100,3260]
May 28 14:15:44.968293 np0000001643 nova-compute[98269]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.40.100,3260] successful.
May 28 14:15:44.968293 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:44.969330 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:15:44.984141 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:44.996699 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:45.034308 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.50.100,3260]
May 28 14:15:45.034308 np0000001643 nova-compute[98269]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-067a2fbf-35ce-478a-92e1-224b7939ed73, portal: 192.168.50.100,3260] successful.
May 28 14:15:45.034308 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:45.038069 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:45.038069 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:45.041894 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-changed-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:45.041894 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Refreshing instance network info cache due to event network-changed-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:45.041894 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] Acquiring lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:45.041894 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] Acquired lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:45.041894 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Refreshing network info cache for port c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:45.049474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:45.049474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:45.049474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== disconnect_volume: return (345ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:45.049474 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:15:45.111196 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Updating instance_info_cache with network_info: [{"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:45.282033 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:45.478884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:45.546698 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:45.552160 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:45.603954 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:45.613054 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Releasing lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:45.613431 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Instance network_info: |[{"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:15:45.616213 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Start _get_guest_xml network_info=[{"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:15:45.623524 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:15:45.624633 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-806804829', uuid='e17be93d-817c-4da2-8867-bc483843b6a6'), owner=OwnerMeta(userid='d4fa943716494225849fb8aac46fb662', username='tempest-VolumesSnapshotTestJSON-33088366-project-member', projectid='503ff5746ac94b068fca926067617b52', projectname='tempest-VolumesSnapshotTestJSON-33088366'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977745.624226) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:15:45.627933 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:15:45.628321 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:15:45.631242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:15:45.631438 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:15:45.632548 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:15:45.632903 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:15:45.633052 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:15:45.633165 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:15:45.633284 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:15:45.633370 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:15:45.633488 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:15:45.633636 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:15:45.633768 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:15:45.633886 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:15:45.633991 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:15:45.634119 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:15:45.649400 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:45.654495 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-806804829',display_name='tempest-VolumesSnapshotTestJSON-instance-806804829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumessnapshottestjson-instance-806804829',id=57,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9FaHWf6eJ47ui0v2Qy7LIwD9lpFD3A1H6JEw/5fcSHclLA0OwHF08USmk5xNvDVxM42mFTDHtgG9L1nmZKOAUoHBk48JJa5IW5d0HwxTbFo4EQlok44huuphS1HUAJgw==',key_name='tempest-keypair-922566510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='503ff5746ac94b068fca926067617b52',ramdisk_id='',reservation_id='r-45t2uvmu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-33088366',owner_user_name='tempest-VolumesSnapshotTestJSON-33088366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4fa943716494225849fb8aac46fb662',uuid=e17be93d-817c-4da2-8867-bc483843b6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:15:45.654713 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converting VIF {"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:45.655228 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:68:58,bridge_name='br-int',has_traffic_filtering=True,id=5fd8cc08-7766-472e-80e9-764f3b5820f3,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd8cc08-77') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:45.655955 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'pci_devices' on Instance uuid e17be93d-817c-4da2-8867-bc483843b6a6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:45.775175 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:45.988303 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:15:45.989358 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:15:45.989649 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Creating image(s)
May 28 14:15:45.990154 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "/opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:45.990341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "/opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:45.992865 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "/opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:45.993509 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:46.000856 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:46.003611 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:46.059438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.491s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:46.061350 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.779s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:46.093525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:46.093999 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:46.094505 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:46.095035 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:46.099008 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:15:46.099575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:46.159660 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] End _get_guest_xml xml=<domain type="qemu">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <uuid>e17be93d-817c-4da2-8867-bc483843b6a6</uuid>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <name>instance-00000039</name>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-806804829</nova:name>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:15:45</nova:creationTime>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:user uuid="d4fa943716494225849fb8aac46fb662">tempest-VolumesSnapshotTestJSON-33088366-project-member</nova:user>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:project uuid="503ff5746ac94b068fca926067617b52">tempest-VolumesSnapshotTestJSON-33088366</nova:project>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         <nova:port uuid="5fd8cc08-7766-472e-80e9-764f3b5820f3">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <system>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <entry name="serial">e17be93d-817c-4da2-8867-bc483843b6a6</entry>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <entry name="uuid">e17be93d-817c-4da2-8867-bc483843b6a6</entry>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </system>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <os>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   </os>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <features>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   </features>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   <devices>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk.config"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:a5:68:58"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <target dev="tap5fd8cc08-77"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </interface>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/console.log" append="off"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </serial>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <video>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </video>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </rng>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:   </devices>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]: </domain>
May 28 14:15:46.159660 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:15:46.162098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Preparing to wait for external event network-vif-plugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:15:46.162098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:46.162098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:46.162098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:46.162098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-806804829',display_name='tempest-VolumesSnapshotTestJSON-instance-806804829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumessnapshottestjson-instance-806804829',id=57,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9FaHWf6eJ47ui0v2Qy7LIwD9lpFD3A1H6JEw/5fcSHclLA0OwHF08USmk5xNvDVxM42mFTDHtgG9L1nmZKOAUoHBk48JJa5IW5d0HwxTbFo4EQlok44huuphS1HUAJgw==',key_name='tempest-keypair-922566510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='503ff5746ac94b068fca926067617b52',ramdisk_id='',reservation_id='r-45t2uvmu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-33088366',owner_user_name='tempest-VolumesSnapshotTestJSON-33088366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4fa943716494225849fb8aac46fb662',uuid=e17be93d-817c-4da2-8867-bc483843b6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:15:46.162098 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converting VIF {"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:46.162404 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:68:58,bridge_name='br-int',has_traffic_filtering=True,id=5fd8cc08-7766-472e-80e9-764f3b5820f3,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd8cc08-77') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:46.162582 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:68:58,bridge_name='br-int',has_traffic_filtering=True,id=5fd8cc08-7766-472e-80e9-764f3b5820f3,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd8cc08-77') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:15:46.163675 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:46.164057 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:46.164472 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:15:46.165746 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:46.166003 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ee3f551-0ca5-5e74-a471-c9e72eaa5ea0', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:46.168570 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:46.170604 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:46.173461 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance cd89555b-2493-48a9-a79e-92cd51efcb1e
May 28 14:15:46.176694 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:46.176989 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fd8cc08-77, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:46.177462 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fd8cc08-77, col_values=(('qos', UUID('e058c8bf-a2ed-4ed3-a2fc-98fe14a016c5')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:46.177664 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fd8cc08-77, col_values=(('external_ids', {'iface-id': '5fd8cc08-7766-472e-80e9-764f3b5820f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:68:58', 'vm-uuid': 'e17be93d-817c-4da2-8867-bc483843b6a6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:46.180984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:46.188053 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:46.189415 np0000001643 nova-compute[98269]: INFO os_vif [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:68:58,bridge_name='br-int',has_traffic_filtering=True,id=5fd8cc08-7766-472e-80e9-764f3b5820f3,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd8cc08-77')
May 28 14:15:46.223836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.124s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:46.224408 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:46.279261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ded27225-f981-470a-a243-014aa8e38679 req-73da18d4-5919-422f-8d6c-11ab900df938 service nova] Releasing lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:46.281627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquired lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:46.281627 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:15:46.288602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk 1073741824" returned: 0 in 0.064s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:46.289141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:46.290718 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:46.392687 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:46.392979 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:15:46.393189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:46.503062 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:46.504464 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Cannot resize image /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:15:46.504464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:15:46.504464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Ensure instance console log exists: /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:15:46.504464 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:46.504639 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:46.504639 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:46.520181 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:46.520498 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:46.646738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1945580f-6507-4d79-b140-10478c479848 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:46.843977 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:46.980055 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:47.024015 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:47.117619 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Updating instance_info_cache with network_info: [{"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:47.184861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-454a738c-2ebe-47fe-8f91-c029629c9619 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "cd89555b-2493-48a9-a79e-92cd51efcb1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.353s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:47.531793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.471s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:47.597722 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Deleted allocations for instance 1e9ba9ee-c26c-4306-b19f-02404513e577
May 28 14:15:47.619764 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Releasing lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:47.620520 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Instance network_info: |[{"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:15:47.622255 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Start _get_guest_xml network_info=[{"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:15:47.625988 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:15:47.627558 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1516289022', uuid='315479ab-df1d-4a37-8483-12526e101ef7'), owner=OwnerMeta(userid='8c9efc3ab17f435ca354ca8c621f6ac7', username='tempest-VolumesExtendAttachedTest-2074693502-project-member', projectid='294bedb01ef5467881b271a665929681', projectname='tempest-VolumesExtendAttachedTest-2074693502'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977747.627083) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:15:47.628924 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:15:47.629274 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:15:47.630585 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:15:47.630824 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:15:47.632137 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:15:47.632571 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:15:47.632744 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:15:47.632889 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:15:47.633081 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:15:47.633734 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:15:47.633734 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:15:47.634225 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:15:47.634387 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:15:47.634571 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:15:47.634725 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:15:47.634915 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:15:47.648823 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1516289022',display_name='tempest-VolumesExtendAttachedTest-instance-1516289022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesextendattachedtest-instance-1516289022',id=58,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB05zyOAYWovr9BR5aSdMaJRX3yCowl+xeRWRE4fWtDKmtYjw9WlkRJXEQtNmTs3BAYV0FsnqI/WuBSDxIzLuhX9jpbleuteP3ONO1tYNMzhbRoZGkXbylFrOeXkVAHHHQ==',key_name='tempest-keypair-123890844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294bedb01ef5467881b271a665929681',ramdisk_id='',reservation_id='r-rsiwjn1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-2074693502',owner_user_name='tempest-VolumesExtendAttachedTest-2074693502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9efc3ab17f435ca354ca8c621f6ac7',uuid=315479ab-df1d-4a37-8483-12526e101ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:15:47.649136 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Converting VIF {"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:47.649665 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6d:3d,bridge_name='br-int',has_traffic_filtering=True,id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06,network=Network(a6bcb0d8-9f34-4d35-b721-0e231f41e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b14d29-40') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:47.650470 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lazy-loading 'pci_devices' on Instance uuid 315479ab-df1d-4a37-8483-12526e101ef7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:47.708038 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:47.708196 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:47.708426 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No VIF found with MAC fa:16:3e:a5:68:58, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:47.708916 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Using config drive
May 28 14:15:48.124882 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:48.125469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:48.154888 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] End _get_guest_xml xml=<domain type="qemu">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <uuid>315479ab-df1d-4a37-8483-12526e101ef7</uuid>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <name>instance-0000003a</name>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1516289022</nova:name>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:15:47</nova:creationTime>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:user uuid="8c9efc3ab17f435ca354ca8c621f6ac7">tempest-VolumesExtendAttachedTest-2074693502-project-member</nova:user>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:project uuid="294bedb01ef5467881b271a665929681">tempest-VolumesExtendAttachedTest-2074693502</nova:project>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         <nova:port uuid="c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <system>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <entry name="serial">315479ab-df1d-4a37-8483-12526e101ef7</entry>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <entry name="uuid">315479ab-df1d-4a37-8483-12526e101ef7</entry>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </system>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <os>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   </os>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <features>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   </features>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   <devices>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk.config"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </disk>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:f2:6d:3d"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <target dev="tapc4b14d29-40"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </interface>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/console.log" append="off"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </serial>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <video>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </video>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </rng>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:   </devices>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]: </domain>
May 28 14:15:48.154888 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:15:48.156810 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Preparing to wait for external event network-vif-plugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:15:48.156810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:48.156810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:48.156810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:48.156810 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1516289022',display_name='tempest-VolumesExtendAttachedTest-instance-1516289022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesextendattachedtest-instance-1516289022',id=58,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB05zyOAYWovr9BR5aSdMaJRX3yCowl+xeRWRE4fWtDKmtYjw9WlkRJXEQtNmTs3BAYV0FsnqI/WuBSDxIzLuhX9jpbleuteP3ONO1tYNMzhbRoZGkXbylFrOeXkVAHHHQ==',key_name='tempest-keypair-123890844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294bedb01ef5467881b271a665929681',ramdisk_id='',reservation_id='r-rsiwjn1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-2074693502',owner_user_name='tempest-VolumesExtendAttachedTest-2074693502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9efc3ab17f435ca354ca8c621f6ac7',uuid=315479ab-df1d-4a37-8483-12526e101ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:15:48.156810 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Converting VIF {"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:15:48.156810 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6d:3d,bridge_name='br-int',has_traffic_filtering=True,id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06,network=Network(a6bcb0d8-9f34-4d35-b721-0e231f41e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b14d29-40') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:15:48.157196 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6d:3d,bridge_name='br-int',has_traffic_filtering=True,id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06,network=Network(a6bcb0d8-9f34-4d35-b721-0e231f41e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b14d29-40') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:15:48.158271 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.158622 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:48.158960 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:15:48.159779 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.160035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7afd0889-276a-59da-8fa9-9cf037d0a775', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:48.167329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.167903 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:48.173664 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.175589 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.175769 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4b14d29-40, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:48.176150 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4b14d29-40, col_values=(('qos', UUID('22e757b0-bac6-4cb6-a64f-09bbf99007fc')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:48.176356 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4b14d29-40, col_values=(('external_ids', {'iface-id': 'c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:6d:3d', 'vm-uuid': '315479ab-df1d-4a37-8483-12526e101ef7'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:15:48.177175 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.178269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:15:48.188589 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.189822 np0000001643 nova-compute[98269]: INFO os_vif [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:6d:3d,bridge_name='br-int',has_traffic_filtering=True,id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06,network=Network(a6bcb0d8-9f34-4d35-b721-0e231f41e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b14d29-40')
May 28 14:15:48.215570 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:48.336578 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Creating config drive at /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk.config
May 28 14:15:48.341258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpai_lapa0 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:48.401269 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpai_lapa0" returned: 0 in 0.060s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:48.608481 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c7653757-47e0-40be-b825-9af836f9f6ff tempest-VolumesNegativeTest-1180157317 tempest-VolumesNegativeTest-1180157317-project-member] Lock "1e9ba9ee-c26c-4306-b19f-02404513e577" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.129s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:48.630289 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:48.852524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.885887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.887869 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:48.984727 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:49.098862 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6b75fe98-bac1-4db5-84c1-bab006a503b2 req-f820c4f6-d303-41e0-b7fb-a60e560c882a service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-vif-plugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:49.099076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6b75fe98-bac1-4db5-84c1-bab006a503b2 req-f820c4f6-d303-41e0-b7fb-a60e560c882a service nova] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:49.099307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6b75fe98-bac1-4db5-84c1-bab006a503b2 req-f820c4f6-d303-41e0-b7fb-a60e560c882a service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:49.099464 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6b75fe98-bac1-4db5-84c1-bab006a503b2 req-f820c4f6-d303-41e0-b7fb-a60e560c882a service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:49.103911 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6b75fe98-bac1-4db5-84c1-bab006a503b2 req-f820c4f6-d303-41e0-b7fb-a60e560c882a service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Processing event network-vif-plugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:15:49.246055 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:49.253650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:49.256621 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:49.284165 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:49.291642 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:49.637826 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:49.707058 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:49.707296 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:49.707393 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] No VIF found with MAC fa:16:3e:f2:6d:3d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:49.707921 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Using config drive
May 28 14:15:49.740202 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977749.7398024, e17be93d-817c-4da2-8867-bc483843b6a6 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:49.740593 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:15:49.740972 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] VM Started (Lifecycle Event)
May 28 14:15:49.743706 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:15:49.748174 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Instance spawned successfully.
May 28 14:15:49.748670 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:15:49.750134 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:50.215272 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:50.245172 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:50.256887 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:50.259727 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:50.260257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:50.260760 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:50.261155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:50.261647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:50.262130 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:50.373270 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Creating config drive at /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk.config
May 28 14:15:50.379525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu0hax3kw {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:50.434412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu0hax3kw" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:15:50.728150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:50.728299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:50.728534 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attaching volume b9643e58-125e-4209-9d49-938e0f49d7e5 to /dev/vdb
May 28 14:15:50.760067 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:15:50.760491 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977750.7602623, e17be93d-817c-4da2-8867-bc483843b6a6 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:50.760633 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] VM Paused (Lifecycle Event)
May 28 14:15:50.769699 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Took 7.33 seconds to spawn the instance on the hypervisor.
May 28 14:15:50.769699 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:50.783537 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:50.795227 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:15:50.821531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:50.867155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:50.886737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:15:50.887850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:15:50.895138 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:50.898768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:50.904943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:15:50.908476 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe05:3b49', 'fe80::64c0:f7ff:fe14:ca9b', 'fe80::fc16:3eff:fea5:6858', 'fe80::9885:a1ff:feb8:60ba', 'fe80::fc16:3eff:fef2:6d3d'] 
May 28 14:15:50.908476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:15:50.908476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:15:50.908476 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:50.908476 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating existing volume attachment record: b4f4cce7-0f55-4a19-b0f5-1179a2da8bf4 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:15:50.982114 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:51.180863 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2ce5bd8b-0717-45e3-a19d-997738cafacf req-476a9381-4333-4bd6-abe5-35cd451f3b72 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-vif-plugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:51.182562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2ce5bd8b-0717-45e3-a19d-997738cafacf req-476a9381-4333-4bd6-abe5-35cd451f3b72 service nova] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:51.186420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2ce5bd8b-0717-45e3-a19d-997738cafacf req-476a9381-4333-4bd6-abe5-35cd451f3b72 service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:51.186420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2ce5bd8b-0717-45e3-a19d-997738cafacf req-476a9381-4333-4bd6-abe5-35cd451f3b72 service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:51.186650 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2ce5bd8b-0717-45e3-a19d-997738cafacf req-476a9381-4333-4bd6-abe5-35cd451f3b72 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] No waiting events found dispatching network-vif-plugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:51.186869 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2ce5bd8b-0717-45e3-a19d-997738cafacf req-476a9381-4333-4bd6-abe5-35cd451f3b72 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received unexpected event network-vif-plugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 for instance with vm_state active and task_state None.
May 28 14:15:51.264046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:51.273582 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977751.2731185, e17be93d-817c-4da2-8867-bc483843b6a6 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:51.273817 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] VM Resumed (Lifecycle Event)
May 28 14:15:51.283560 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-48a2acd4-f879-40ca-9030-f4729b1f1e5c req-32e0dc59-2e07-428d-aa92-0b41f08d5bbb service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-vif-plugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:51.283825 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-48a2acd4-f879-40ca-9030-f4729b1f1e5c req-32e0dc59-2e07-428d-aa92-0b41f08d5bbb service nova] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:51.283909 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-48a2acd4-f879-40ca-9030-f4729b1f1e5c req-32e0dc59-2e07-428d-aa92-0b41f08d5bbb service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:51.284001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-48a2acd4-f879-40ca-9030-f4729b1f1e5c req-32e0dc59-2e07-428d-aa92-0b41f08d5bbb service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:51.284561 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-48a2acd4-f879-40ca-9030-f4729b1f1e5c req-32e0dc59-2e07-428d-aa92-0b41f08d5bbb service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Processing event network-vif-plugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:15:51.286106 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Took 12.84 seconds to build instance.
May 28 14:15:51.298518 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:51.300741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:51.308922 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:51.331440 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:51.332090 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:51.486611 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:15:51.487267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9643e58-125e-4209-9d49-938e0f49d7e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:51.487267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:51.487786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:51.488615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9643e58-125e-4209-9d49-938e0f49d7e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:15:51.502402 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:51.503255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:15:51.503752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:51.503992 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:51.504769 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:15:51.505312 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:51.518335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:51.518335 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:51.528230 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:15:51.528230 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:51.536406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5] added
May 28 14:15:51.536406 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:51.536406 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:51.536406 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:51.536406 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:51.536406 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:51.536406 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:51.537001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:51.537001 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:51.537001 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:51.547008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5] added
May 28 14:15:51.547008 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:15:51.547008 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:51.547008 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:51.547008 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:15:51.547008 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:15:51.547008 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:51.547008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:15:51.547307 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.042(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:15:51.547421 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:15:51.778477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:51.785135 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:51.787987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.350s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:51.841245 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:15:51.844760 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:15:51.850476 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Instance spawned successfully.
May 28 14:15:51.850476 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:15:52.126388 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-changed-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:52.130342 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Refreshing instance network info cache due to event network-changed-5fd8cc08-7766-472e-80e9-764f3b5820f3. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:52.130697 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] Acquiring lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:52.130776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] Acquired lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:52.130919 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Refreshing network info cache for port 5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:52.291975 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977752.2916582, 315479ab-df1d-4a37-8483-12526e101ef7 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:52.292374 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] VM Started (Lifecycle Event)
May 28 14:15:52.356888 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:52.357091 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:52.357519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:52.357846 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:52.358216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:52.358579 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:15:52.537569 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:15:52.548587 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:52.555911 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:52.555911 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:15:52.567210 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:15:52.567210 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:52.577964 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:52.590106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:52.598699 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:15:52.598699 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:52.598940 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:15:52.598940 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:52.599097 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:15:52.599097 np0000001643 nova-compute[98269]: 
May 28 14:15:52.609569 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:15:52.609569 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:52.612478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:15:52.612478 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:52.612478 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:15:52.612478 np0000001643 nova-compute[98269]: 
May 28 14:15:52.633299 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:52.649849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.50.100,3260]
May 28 14:15:52.649849 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.50.100,3260] successful.
May 28 14:15:52.649849 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:52.675705 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:52.691881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:15:52.691881 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:52.692102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:15:52.692102 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:52.692411 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:52.692620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:52.693110 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('7', '-', '-', 0) found on session 146 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:52.693239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:52.720617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 146 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:52.720617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b9643e58-125e-4209-9d49-938e0f49d7e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:52.798171 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:52.804808 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:52.864048 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Took 6.88 seconds to spawn the instance on the hypervisor.
May 28 14:15:52.864240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:53.066971 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:53.180034 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:53.227082 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Updated VIF entry in instance network info cache for port 5fd8cc08-7766-472e-80e9-764f3b5820f3. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:15:53.227345 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Updating instance_info_cache with network_info: [{"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:53.312488 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:15:53.312488 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977753.3112264, 315479ab-df1d-4a37-8483-12526e101ef7 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:53.312488 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] VM Paused (Lifecycle Event)
May 28 14:15:53.337910 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:53.338147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:53.357917 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2229bb2c-0e80-467d-a746-d3fe11e7c1e0 req-11b41d0e-e18f-4b73-9a69-4594a89c9f84 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-vif-plugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:53.358170 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2229bb2c-0e80-467d-a746-d3fe11e7c1e0 req-11b41d0e-e18f-4b73-9a69-4594a89c9f84 service nova] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:53.358336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2229bb2c-0e80-467d-a746-d3fe11e7c1e0 req-11b41d0e-e18f-4b73-9a69-4594a89c9f84 service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:53.358587 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2229bb2c-0e80-467d-a746-d3fe11e7c1e0 req-11b41d0e-e18f-4b73-9a69-4594a89c9f84 service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:53.358673 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2229bb2c-0e80-467d-a746-d3fe11e7c1e0 req-11b41d0e-e18f-4b73-9a69-4594a89c9f84 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] No waiting events found dispatching network-vif-plugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:15:53.358817 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2229bb2c-0e80-467d-a746-d3fe11e7c1e0 req-11b41d0e-e18f-4b73-9a69-4594a89c9f84 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received unexpected event network-vif-plugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 for instance with vm_state active and task_state None.
May 28 14:15:53.377666 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Took 13.27 seconds to build instance.
May 28 14:15:53.653022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.40.100,3260]
May 28 14:15:53.653022 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.40.100,3260] successful.
May 28 14:15:53.653022 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:53.664968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:15:53.679578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:15:53.679578 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:15:53.679578 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:15:53.679780 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:15:53.679780 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:15:53.679780 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:15:53.680161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.177s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:53.680301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:15:53.680833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] HCTL ('8', '-', '-', 0) found on session 147 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:15:53.680975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:15:53.696254 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Searching for a device in session 147 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:15:53.696254 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9643e58-125e-4209-9d49-938e0f49d7e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:15:53.729419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3bfb6a1e-167e-471d-9afb-c5c5e0cbb32d req-bb9e0819-048d-49f2-b2f2-7a72acdf0207 service nova] Releasing lock "refresh_cache-e17be93d-817c-4da2-8867-bc483843b6a6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:53.815220 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:53.818791 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977753.8173168, 315479ab-df1d-4a37-8483-12526e101ef7 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:53.818791 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] VM Resumed (Lifecycle Event)
May 28 14:15:53.839965 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:15:53.879531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a595f5bc-e8fe-49b8-8b99-608e302d16d3 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.778s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:54.320892 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:54.322775 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:15:54.386251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:15:54.386506 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:15:54.390303 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:15:54.390519 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Claim successful on node np0000001643
May 28 14:15:54.531298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:15:54.752165 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:55.443745 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-changed-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:55.444147 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Refreshing instance network info cache due to event network-changed-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:55.444147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] Acquiring lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:55.444317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] Acquired lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:55.445292 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Refreshing network info cache for port c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:55.551473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799147 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:15:55.551473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.063s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:15:55.551473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== connect_volume: return (4064ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799147', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799147'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:55.551473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799147', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799147'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:15:55.555793 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:15:55.732400 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:15:55.732748 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:15:55.949163 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:56.057397 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to attach volume b9643e58-125e-4209-9d49-938e0f49d7e5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:15:56.058871 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:15:56.058871 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:15:56.058871 np0000001643 nova-compute[98269]:   <alias name="ua-b9643e58-125e-4209-9d49-938e0f49d7e5"/>
May 28 14:15:56.058871 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:15:56.058871 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:15:56.058871 np0000001643 nova-compute[98269]:   <serial>b9643e58-125e-4209-9d49-938e0f49d7e5</serial>
May 28 14:15:56.058871 np0000001643 nova-compute[98269]: </disk>
May 28 14:15:56.058871 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:15:56.236420 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:15:56.266732 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0020129499998802203 future=<Future at 0x71a7801ec2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:56.266732 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:56.266732 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.0975539389996811 future=<Future at 0x71a77818d850 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:56.266732 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.097385476999989 future=<Future at 0x71a77818d850 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:56.266732 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Emitting event <LifecycleEvent: 1779977741.257596, cd89555b-2493-48a9-a79e-92cd51efcb1e => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:56.266732 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] VM Stopped (Lifecycle Event)
May 28 14:15:56.419412 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:56.626424 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Updated VIF entry in instance network info cache for port c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:15:56.627053 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Updating instance_info_cache with network_info: [{"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:56.747410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.361s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:56.747723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:15:56.767989 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: cd89555b-2493-48a9-a79e-92cd51efcb1e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:57.129411 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-56ac1754-04bf-4477-a173-55b71ab29d7c req-ec41a109-f128-4e14-9468-4c315ce25072 service nova] Releasing lock "refresh_cache-315479ab-df1d-4a37-8483-12526e101ef7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:15:57.256791 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:15:57.256791 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:15:57.256791 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:57.256791 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:57.349962 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:15:57.358056 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004332120001890871 future=<Future at 0x71a77818d850 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:57.358334 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:15:57.358661 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Emitting event <LifecycleEvent: 1779977742.357497, 1e9ba9ee-c26c-4306-b19f-02404513e577 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:15:57.358805 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] VM Stopped (Lifecycle Event)
May 28 14:15:57.758806 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:15:57.766757 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:57.767081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:57.767221 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:15:57.767409 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] No VIF found with MAC fa:16:3e:12:ea:68, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:15:57.861439 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: 1e9ba9ee-c26c-4306-b19f-02404513e577] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:15:57.981961 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Successfully created port: 56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:15:58.194010 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:58.264083 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:15:58.624673 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:15:58.760800 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Successfully updated port: 56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:15:58.770738 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Booting with volume 582dc770-0f28-43bd-acc4-712f6c4cfc50 at /dev/vda
May 28 14:15:58.820879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received event network-changed-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:15:58.821348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Refreshing instance network info cache due to event network-changed-56c966c2-cf64-4255-aa13-82847ace6c7a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:15:58.822587 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] Acquiring lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:58.822714 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] Acquired lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:15:58.822898 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Refreshing network info cache for port 56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:15:58.831091 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:15:58.846064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:15:58.871740 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:15:58.926566 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:15:58.926819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:15:58.936599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:15:58.937731 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe12:ea68', 'fe80::bce2:21ff:fe9f:c707', 'fe80::fc16:3eff:fe05:3b49', 'fe80::64c0:f7ff:fe14:ca9b', 'fe80::fc16:3eff:fea5:6858', 'fe80::9885:a1ff:feb8:60ba', 'fe80::fc16:3eff:fef2:6d3d', 'fe80::f410:c8ff:fe38:9c26'] 
May 28 14:15:58.937850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:15:58.938257 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:15:58.938515 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:15:58.938731 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Updating existing volume attachment record: 554a8806-66a4-4921-a194-97d4cf0a410c {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:15:59.263813 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:15:59.327250 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:15:59.339755 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5275b57a-c213-4405-be6a-59208b13e390 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.611s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:15:59.424577 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:15:59.697278 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:15:59.754231 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:00.201988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e4a1cacb-f08b-46b6-86db-e46967a8a402 req-1a382998-2989-44fc-a999-743b1031f2d6 service nova] Releasing lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:16:00.201988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:16:00.202546 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:16:00.624879 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:00.793252 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:16:01.014647 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:01.067644 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:16:01.070531 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:16:01.070531 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Creating image(s)
May 28 14:16:01.070531 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:16:01.070531 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Ensure instance console log exists: /opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:16:01.070531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:01.070781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:01.070781 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:01.175644 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Updating instance_info_cache with network_info: [{"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:01.678351 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:16:01.678879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Instance network_info: |[{"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:16:01.679640 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Start _get_guest_xml network_info=[{"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '554a8806-66a4-4921-a194-97d4cf0a410c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd004d34f-24bd-44de-ac98-1500665bbe5e', 'attached_at': '', 'detached_at': '', 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'serial': '582dc770-0f28-43bd-acc4-712f6c4cfc50'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:16:01.685119 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:16:01.686828 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1361233749', uuid='d004d34f-24bd-44de-ac98-1500665bbe5e'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977761.6863747) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:16:01.688781 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:16:01.689173 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:16:01.690368 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:16:01.693472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:16:01.694245 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:16:01.694540 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:16:01.694808 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:16:01.695082 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:16:01.717133 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:16:01.717133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:01.717133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:01.717133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:01.717133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:16:01.735026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:01.735613 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:01.735844 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:01.736324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:01.736883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:01.737160 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:01.748715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:01.748715 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:01.756124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:01.756124 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:01.765211 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50] added
May 28 14:16:01.765211 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:01.765211 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:01.765211 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:01.765211 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:01.765211 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:01.765211 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:01.765563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:01.765639 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:01.765826 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:01.773583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50] added
May 28 14:16:01.773583 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:01.773583 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:01.773583 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:01.773583 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:01.773583 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:01.773583 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:01.773810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:01.773921 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:01.774126 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:02.766590 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:02.774655 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:02.782024 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:02.782024 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:02.793781 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:02.793781 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.799405 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.810861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.817788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.817788 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.817788 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:02.818098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.818098 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.818098 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:02.824860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.824860 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.824860 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:02.825107 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.825107 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.825107 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:02.854313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.40.100,3260]
May 28 14:16:02.854313 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.40.100,3260] successful.
May 28 14:16:02.854313 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.871268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.50.100,3260]
May 28 14:16:02.871268 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.50.100,3260] successful.
May 28 14:16:02.871268 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.877890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.887685 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:02.899131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.899131 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.899131 np0000001643 nova-compute[98269]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.899131 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.899131 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:02.899376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.899376 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.899376 np0000001643 nova-compute[98269]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.899376 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.899376 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:02.899623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:02.899723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:02.900492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('9', '-', '-', 0) found on session 148 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:02.900634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:02.908265 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.908265 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.908265 np0000001643 nova-compute[98269]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.908265 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.908265 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:02.908544 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.908544 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:02.908544 np0000001643 nova-compute[98269]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.908544 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:02.908544 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:02.908922 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:02.909066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:02.909827 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('10', '-', '-', 0) found on session 149 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:02.909980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:02.924857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 148 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:02.925153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:02.937806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 149 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:02.937989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:03.196245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:03.524838 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:03.525014 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:03.737820 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:16:03.866098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:04.028027 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Detaching volume b9643e58-125e-4209-9d49-938e0f49d7e5
May 28 14:16:04.073682 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Attempting to driver detach volume b9643e58-125e-4209-9d49-938e0f49d7e5 from mountpoint /dev/vdb
May 28 14:16:04.077919 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-b9643e58-125e-4209-9d49-938e0f49d7e5 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:16:04.078987 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Found disk vdb by alias ua-b9643e58-125e-4209-9d49-938e0f49d7e5 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:16:04.079122 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Attempting to detach device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:16:04.079369 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:16:04.079369 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:04.079369 np0000001643 nova-compute[98269]:   <alias name="ua-b9643e58-125e-4209-9d49-938e0f49d7e5"/>
May 28 14:16:04.079369 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:16:04.079369 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:04.079369 np0000001643 nova-compute[98269]:   <serial>b9643e58-125e-4209-9d49-938e0f49d7e5</serial>
May 28 14:16:04.079369 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:16:04.079369 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:04.079369 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:16:04.085636 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the persistent domain config.
May 28 14:16:04.085768 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] (1/8): Attempting to detach device vdb with device alias ua-b9643e58-125e-4209-9d49-938e0f49d7e5 from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:16:04.086121 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:16:04.086121 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:04.086121 np0000001643 nova-compute[98269]:   <alias name="ua-b9643e58-125e-4209-9d49-938e0f49d7e5"/>
May 28 14:16:04.086121 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:16:04.086121 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:04.086121 np0000001643 nova-compute[98269]:   <serial>b9643e58-125e-4209-9d49-938e0f49d7e5</serial>
May 28 14:16:04.086121 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:16:04.086121 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:04.086121 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:16:04.621202 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977764.6202042, a95922fd-8d79-43bc-9052-e05f100abb79 => ua-b9643e58-125e-4209-9d49-938e0f49d7e5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:16:04.621996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b9643e58-125e-4209-9d49-938e0f49d7e5 for instance a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:16:04.624529 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully detached device vdb from instance a95922fd-8d79-43bc-9052-e05f100abb79 from the live domain config.
May 28 14:16:04.625836 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:16:04.626214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9643e58-125e-4209-9d49-938e0f49d7e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:04.626361 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:04.756672 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:04.758469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 3300000007e0aa9ef for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:16:04.758721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:04.758890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000007e0aa9ef', 'path': '/dev/dm-1', 'multipath_id': '3300000007e0aa9ef'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:04.759040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007e0aa9ef', 'path': '/dev/dm-1', 'multipath_id': '3300000007e0aa9ef'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:16:04.759803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.133s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:04.760370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9643e58-125e-4209-9d49-938e0f49d7e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:16:04.760780 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:16:04.789431 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:04.789431 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:04.789431 np0000001643 nova-compute[98269]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:04.789431 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:04.789431 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:04.789761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:04.789761 np0000001643 nova-compute[98269]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5 (non-flash)
May 28 14:16:04.789761 np0000001643 nova-compute[98269]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:04.789761 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:04.789761 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:04.789761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '149')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:16:04.790025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', '147')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:04.790828 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5', '146')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:04.791917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801ce480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:16:04.792291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:16:04.792663 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Flush multipath device 330000000575fd13d {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:16:04.824722 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:16:04.887391 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:16:04.934168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:16:04.934694 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:16:04.935637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:16:04.949789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:16:04.950040 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:16:04.964631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:04.997550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.40.100,3260]
May 28 14:16:04.997550 np0000001643 nova-compute[98269]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.40.100,3260] successful.
May 28 14:16:04.997550 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:05.015441 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:05.030387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:05.065148 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.50.100,3260]
May 28 14:16:05.065148 np0000001643 nova-compute[98269]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-b9643e58-125e-4209-9d49-938e0f49d7e5, portal: 192.168.50.100,3260] successful.
May 28 14:16:05.065148 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:05.078366 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:05.078635 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:05.078794 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] <== disconnect_volume: return (452ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:05.078911 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:16:05.264759 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1361233749',display_name='tempest-TestVolumeBootPattern-server-1361233749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1361233749',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBFCdao0wVABAopvi9ez4NFFUXw1yrlBU4tNdd5z1ZMnrTqXTeoUjykzTeSu5Jz0KVuBF3ULJsp7TFau2Q/G+Dg5OnwuiGtlYuuIi+G3nr55XMUEDEbN5hB7JcYP7b4yw==',key_name='tempest-keypair-1997457095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-oqe8e9l5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=d004d34f-24bd-44de-ac98-1500665bbe5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:16:05.265040 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:05.265577 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:3d:3e,bridge_name='br-int',has_traffic_filtering=True,id=56c966c2-cf64-4255-aa13-82847ace6c7a,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c966c2-cf') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:05.266129 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid d004d34f-24bd-44de-ac98-1500665bbe5e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:05.642294 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'flavor' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:05.768971 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] End _get_guest_xml xml=<domain type="qemu">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <uuid>d004d34f-24bd-44de-ac98-1500665bbe5e</uuid>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <name>instance-0000003b</name>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-1361233749</nova:name>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:16:01</nova:creationTime>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         <nova:port uuid="56c966c2-cf64-4255-aa13-82847ace6c7a">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <system>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <entry name="serial">d004d34f-24bd-44de-ac98-1500665bbe5e</entry>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <entry name="uuid">d004d34f-24bd-44de-ac98-1500665bbe5e</entry>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </system>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <os>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   </os>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <features>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   </features>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   <devices>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e/disk.config"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </disk>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <alias name="ua-582dc770-0f28-43bd-acc4-712f6c4cfc50"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-1"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <serial>582dc770-0f28-43bd-acc4-712f6c4cfc50</serial>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </disk>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:14:3d:3e"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <target dev="tap56c966c2-cf"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </interface>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e/console.log" append="off"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </serial>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <video>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </video>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </rng>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:   </devices>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]: </domain>
May 28 14:16:05.768971 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Preparing to wait for external event network-vif-plugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1361233749',display_name='tempest-TestVolumeBootPattern-server-1361233749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1361233749',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBFCdao0wVABAopvi9ez4NFFUXw1yrlBU4tNdd5z1ZMnrTqXTeoUjykzTeSu5Jz0KVuBF3ULJsp7TFau2Q/G+Dg5OnwuiGtlYuuIi+G3nr55XMUEDEbN5hB7JcYP7b4yw==',key_name='tempest-keypair-1997457095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-oqe8e9l5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=d004d34f-24bd-44de-ac98-1500665bbe5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:3d:3e,bridge_name='br-int',has_traffic_filtering=True,id=56c966c2-cf64-4255-aa13-82847ace6c7a,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c966c2-cf') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:3d:3e,bridge_name='br-int',has_traffic_filtering=True,id=56c966c2-cf64-4255-aa13-82847ace6c7a,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c966c2-cf') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:05.772323 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:05.772903 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:16:05.773339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:05.773522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a96155c-c69e-5e46-be8b-c3c2eb8fa634', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:05.774958 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:05.775570 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:05.777198 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:05.779233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:05.779384 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56c966c2-cf, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:05.780172 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56c966c2-cf, col_values=(('qos', UUID('dcf56a6b-9971-4bde-ac5d-9cb6d7874a3e')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:05.780172 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56c966c2-cf, col_values=(('external_ids', {'iface-id': '56c966c2-cf64-4255-aa13-82847ace6c7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:3d:3e', 'vm-uuid': 'd004d34f-24bd-44de-ac98-1500665bbe5e'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:05.780746 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:05.783206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:05.788042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:05.788976 np0000001643 nova-compute[98269]: INFO os_vif [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:3d:3e,bridge_name='br-int',has_traffic_filtering=True,id=56c966c2-cf64-4255-aa13-82847ace6c7a,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c966c2-cf')
May 28 14:16:06.651950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ae9e18ef-3416-4302-8cf5-f49f705ec712 tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.127s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:07.306163 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:07.306163 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:07.306371 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:14:3d:3e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:16:07.306660 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Using config drive
May 28 14:16:07.382250 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:07.813372 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:07.999294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:07.999527 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:07.999716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:07.999814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:07.999985 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:08.002339 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Terminating instance
May 28 14:16:08.017355 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Creating config drive at /opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e/disk.config
May 28 14:16:08.022834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppj5mvw8p {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:08.098778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppj5mvw8p" returned: 0 in 0.076s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:08.508625 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:16:08.538792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.542734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.565207 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.574236 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.614017 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.621385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.655112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.731085 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:08.754470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bf7369aa-5813-4ddb-8bd2-6353dc8c6f62 req-98469e1d-58f7-4e3c-aa8a-d7d9e38026b5 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:08.754470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bf7369aa-5813-4ddb-8bd2-6353dc8c6f62 req-98469e1d-58f7-4e3c-aa8a-d7d9e38026b5 service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:08.754470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bf7369aa-5813-4ddb-8bd2-6353dc8c6f62 req-98469e1d-58f7-4e3c-aa8a-d7d9e38026b5 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:08.754470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bf7369aa-5813-4ddb-8bd2-6353dc8c6f62 req-98469e1d-58f7-4e3c-aa8a-d7d9e38026b5 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:08.754470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bf7369aa-5813-4ddb-8bd2-6353dc8c6f62 req-98469e1d-58f7-4e3c-aa8a-d7d9e38026b5 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] No waiting events found dispatching network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:08.754911 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bf7369aa-5813-4ddb-8bd2-6353dc8c6f62 req-98469e1d-58f7-4e3c-aa8a-d7d9e38026b5 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:08.859176 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999563861999832 future=<Future at 0x71a75c4eaf60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:08.859602 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999118246999842 future=<Future at 0x71a75c4eaf60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:08.859755 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998962869000025 future=<Future at 0x71a75c4eaf60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:08.864585 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Instance destroyed successfully.
May 28 14:16:08.864585 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lazy-loading 'resources' on Instance uuid 5b580f8d-61fa-4994-822f-0500e14eeced {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:09.134119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.141214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.144322 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.170989 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.368005 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T14:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-253298750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-attachvolumeshelvetestjson-server-253298750',id=52,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLBXqXRdQpsXsHQ6iLHpJqYQH+dvCxX6Exr6ArQUPgrr1nTlfq7cX3PQX7Td86IS/vefw/pPw9OQpYY7X2+qWdMKXosb7HRzQbCntkeyWx+D0/69JoffQsFfeK2LjGeuw==',key_name='tempest-keypair-1418715405',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:15:30Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db1dc6979a244982823fef41c57d1c75',ramdisk_id='',reservation_id='r-lw0yqruz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1300734613',owner_user_name='tempest-AttachVolumeShelveTestJSON-1300734613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b666f3c9eb914e2dba854ed4e0d8fb20',uuid=5b580f8d-61fa-4994-822f-0500e14eeced,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:16:09.368223 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converting VIF {"id": "9b754c38-a97e-4220-96e5-625800c5d818", "address": "fa:16:3e:05:3b:49", "network": {"id": "f0d9bc24-2887-4d05-88b3-506f3bbab907", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-661287492-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db1dc6979a244982823fef41c57d1c75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b754c38-a9", "ovs_interfaceid": "9b754c38-a97e-4220-96e5-625800c5d818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:09.368847 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:09.369073 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:16:09.370385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.370690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b754c38-a9, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:09.371775 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.372943 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:09.373619 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.374270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.374427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0717a641-e584-4ef4-ad21-e5119d99fc1c) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:09.374935 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.375531 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:09.376878 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.378887 np0000001643 nova-compute[98269]: INFO os_vif [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3b:49,bridge_name='br-int',has_traffic_filtering=True,id=9b754c38-a97e-4220-96e5-625800c5d818,network=Network(f0d9bc24-2887-4d05-88b3-506f3bbab907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b754c38-a9')
May 28 14:16:09.379225 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Deleting instance files /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced_del
May 28 14:16:09.389920 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Deletion of /opt/stack/data/nova/instances/5b580f8d-61fa-4994-822f-0500e14eeced_del complete
May 28 14:16:09.642437 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977769.6420777, d004d34f-24bd-44de-ac98-1500665bbe5e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:09.642628 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] VM Started (Lifecycle Event)
May 28 14:16:09.758317 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:09.898124 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 14:16:09.899649 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:16:09.900062 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:16:09.900208 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:16:09.900612 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:09.978038 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:10.149525 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:10.149525 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977770.1487727, d004d34f-24bd-44de-ac98-1500665bbe5e => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:10.149525 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] VM Paused (Lifecycle Event)
May 28 14:16:10.459616 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe9fd84b-1ac4-4684-a897-91c32605fabc req-30eebd44-5efa-48f7-a15a-b0bfa1885324 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-deleted-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:10.459910 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-fe9fd84b-1ac4-4684-a897-91c32605fabc req-30eebd44-5efa-48f7-a15a-b0bfa1885324 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Neutron deleted interface 9b754c38-a97e-4220-96e5-625800c5d818; detaching it from the instance and deleting it from the info cache
May 28 14:16:10.461289 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fe9fd84b-1ac4-4684-a897-91c32605fabc req-30eebd44-5efa-48f7-a15a-b0bfa1885324 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Detach interface failed, port_id=9b754c38-a97e-4220-96e5-625800c5d818, reason: Instance 5b580f8d-61fa-4994-822f-0500e14eeced could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:16:10.651514 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:10.653342 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:16:10.809631 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fad1646d-fe17-4986-a580-2713d3aa511a req-002499df-2e5b-4160-b924-0fb9dd2cc900 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:10.809631 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fad1646d-fe17-4986-a580-2713d3aa511a req-002499df-2e5b-4160-b924-0fb9dd2cc900 service nova] Acquiring lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:10.809631 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fad1646d-fe17-4986-a580-2713d3aa511a req-002499df-2e5b-4160-b924-0fb9dd2cc900 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:10.809631 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fad1646d-fe17-4986-a580-2713d3aa511a req-002499df-2e5b-4160-b924-0fb9dd2cc900 service nova] Lock "5b580f8d-61fa-4994-822f-0500e14eeced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:10.809631 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fad1646d-fe17-4986-a580-2713d3aa511a req-002499df-2e5b-4160-b924-0fb9dd2cc900 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] No waiting events found dispatching network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:10.809631 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fad1646d-fe17-4986-a580-2713d3aa511a req-002499df-2e5b-4160-b924-0fb9dd2cc900 service nova] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Received event network-vif-unplugged-9b754c38-a97e-4220-96e5-625800c5d818 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:10.878982 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:10.879179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:10.901065 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:11.155865 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:16:11.381201 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:16:11.402970 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Took 1.50 seconds to deallocate network for instance.
May 28 14:16:11.912582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:11.912983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:11.926120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:12.180372 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:16:12.180372 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:16:12.682967 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:16:12.701180 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-258108f9-a814-4f9a-8def-d8ea28a070a7 req-ecfa2a28-8739-4dc3-84e2-b8ff3cf387f8 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received event network-vif-plugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:12.701561 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-258108f9-a814-4f9a-8def-d8ea28a070a7 req-ecfa2a28-8739-4dc3-84e2-b8ff3cf387f8 service nova] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:12.701736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-258108f9-a814-4f9a-8def-d8ea28a070a7 req-ecfa2a28-8739-4dc3-84e2-b8ff3cf387f8 service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:12.701907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-258108f9-a814-4f9a-8def-d8ea28a070a7 req-ecfa2a28-8739-4dc3-84e2-b8ff3cf387f8 service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:12.702046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-258108f9-a814-4f9a-8def-d8ea28a070a7 req-ecfa2a28-8739-4dc3-84e2-b8ff3cf387f8 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Processing event network-vif-plugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:16:12.702403 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:16:12.704989 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977772.704674, d004d34f-24bd-44de-ac98-1500665bbe5e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:12.705400 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:16:12.705638 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] VM Resumed (Lifecycle Event)
May 28 14:16:12.709968 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Instance spawned successfully.
May 28 14:16:12.710363 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:16:13.189815 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.277s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:13.192501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.264s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:13.197458 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:16:13.197632 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Claim successful on node np0000001643
May 28 14:16:13.207911 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:13.213125 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:16:13.228374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:13.228374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:13.228374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:13.228374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:13.228374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:13.228374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:13.246908 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Deleted allocations for instance 5b580f8d-61fa-4994-822f-0500e14eeced
May 28 14:16:13.716726 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:16:13.733996 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Took 12.67 seconds to spawn the instance on the hypervisor.
May 28 14:16:13.733996 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:14.242130 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Took 19.90 seconds to build instance.
May 28 14:16:14.254455 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-86dd6379-8e81-42a1-b64c-7ee92b83861e tempest-AttachVolumeShelveTestJSON-1300734613 tempest-AttachVolumeShelveTestJSON-1300734613-project-member] Lock "5b580f8d-61fa-4994-822f-0500e14eeced" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.255s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:14.377415 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:14.467028 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:16:14.468861 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:16:14.743564 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d253e7e-d6e1-4374-adf1-c169db178fbd tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.405s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:14.758611 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:14.761646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-12b8fdae-ebeb-418e-894a-74b14e5da6a4 req-5e4a6d21-08b1-4ee2-890a-2b3d3ab16bed service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received event network-vif-plugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:14.762251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-12b8fdae-ebeb-418e-894a-74b14e5da6a4 req-5e4a6d21-08b1-4ee2-890a-2b3d3ab16bed service nova] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:14.762251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-12b8fdae-ebeb-418e-894a-74b14e5da6a4 req-5e4a6d21-08b1-4ee2-890a-2b3d3ab16bed service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:14.762251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-12b8fdae-ebeb-418e-894a-74b14e5da6a4 req-5e4a6d21-08b1-4ee2-890a-2b3d3ab16bed service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:14.762391 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-12b8fdae-ebeb-418e-894a-74b14e5da6a4 req-5e4a6d21-08b1-4ee2-890a-2b3d3ab16bed service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] No waiting events found dispatching network-vif-plugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:14.762463 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-12b8fdae-ebeb-418e-894a-74b14e5da6a4 req-5e4a6d21-08b1-4ee2-890a-2b3d3ab16bed service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received unexpected event network-vif-plugged-56c966c2-cf64-4255-aa13-82847ace6c7a for instance with vm_state active and task_state None.
May 28 14:16:14.894001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:14.894196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:14.894388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:14.894574 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:14.894744 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:14.900049 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Terminating instance
May 28 14:16:14.973476 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:16:15.404059 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:16:15.422324 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:15.435856 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:15.449483 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:15.455073 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:15.478590 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.288s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:15.478590 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:16:15.483753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:15.750951 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999739276999662 future=<Future at 0x71a75c4e9010 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:15.753022 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Instance destroyed successfully.
May 28 14:16:15.754106 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lazy-loading 'resources' on Instance uuid a95922fd-8d79-43bc-9052-e05f100abb79 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:15.821209 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received event network-changed-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:15.821318 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Refreshing instance network info cache due to event network-changed-56c966c2-cf64-4255-aa13-82847ace6c7a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:16:15.821524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] Acquiring lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:16:15.821617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] Acquired lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:16:15.821735 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Refreshing network info cache for port 56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:16:15.987806 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:16:15.988670 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:16:15.988976 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:15.989202 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:16.055242 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c98b8f4e148b4557bd70bd6a755850a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c345e5241bd40c693ea2c6ccaf6c8f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:16:16.256052 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:13:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-546163848',display_name='tempest-SnapshotDataIntegrityTests-server-546163848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-snapshotdataintegritytests-server-546163848',id=50,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlp5DEO60MqI+PZ0bgx/1bXcTuGdizucYeHB0il15ubrDHVZ1QACJT+JvV9e2fRInRzn8Tcr6EIbB3IY7LlHbo0KpTK+Qhz9BQ8mDs44gQU1Bav9TIya0CIoDBZtg+VdA==',key_name='tempest-keypair-1540680371',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:14:00Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='816dec0e07ba4bd596fac38e7df5e9db',ramdisk_id='',reservation_id='r-had04d1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-859017370',owner_user_name='tempest-SnapshotDataIntegrityTests-859017370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c111ae1684f4ed3be8ba247f5f49709',uuid=a95922fd-8d79-43bc-9052-e05f100abb79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:16:16.258191 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Converting VIF {"id": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "address": "fa:16:3e:12:ea:68", "network": {"id": "abb6b297-c8c2-45d2-b3b9-215cc6239d92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2068869582-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "816dec0e07ba4bd596fac38e7df5e9db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd448dee9-cd", "ovs_interfaceid": "d448dee9-cd94-4537-b2b1-43d834fc96b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:16.258191 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:ea:68,bridge_name='br-int',has_traffic_filtering=True,id=d448dee9-cd94-4537-b2b1-43d834fc96b8,network=Network(abb6b297-c8c2-45d2-b3b9-215cc6239d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd448dee9-cd') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:16.258191 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ea:68,bridge_name='br-int',has_traffic_filtering=True,id=d448dee9-cd94-4537-b2b1-43d834fc96b8,network=Network(abb6b297-c8c2-45d2-b3b9-215cc6239d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd448dee9-cd') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:16:16.258559 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:16.258833 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd448dee9-cd, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:16.263140 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:16.263650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:16.263817 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75b8dc43-476e-4221-9e1e-471d36d526c4) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:16.265188 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:16.266218 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:16.270526 np0000001643 nova-compute[98269]: INFO os_vif [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ea:68,bridge_name='br-int',has_traffic_filtering=True,id=d448dee9-cd94-4537-b2b1-43d834fc96b8,network=Network(abb6b297-c8c2-45d2-b3b9-215cc6239d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd448dee9-cd')
May 28 14:16:16.270526 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Deleting instance files /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79_del
May 28 14:16:16.270526 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Deletion of /opt/stack/data/nova/instances/a95922fd-8d79-43bc-9052-e05f100abb79_del complete
May 28 14:16:16.324106 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:16.491261 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:16:16.640807 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Successfully created port: c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:16:16.702133 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:16.779985 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 14:16:16.780561 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:16:16.780785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:16:16.781057 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:16:16.781322 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:16.839712 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-vif-unplugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:16.840267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:16.840406 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:16.840573 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:16.840732 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] No waiting events found dispatching network-vif-unplugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:16.840934 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-vif-unplugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:16.841087 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-vif-unplugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:16.841253 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] Acquiring lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:16.841429 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:16.841596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] Lock "a95922fd-8d79-43bc-9052-e05f100abb79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:16.841783 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] No waiting events found dispatching network-vif-unplugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:16.841947 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f31a5c-1f0c-4de9-aab9-a736a49aaa1d req-24f1882c-8359-4091-81b9-723fb6df3c59 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-vif-unplugged-d448dee9-cd94-4537-b2b1-43d834fc96b8 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:16.901155 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Updated VIF entry in instance network info cache for port 56c966c2-cf64-4255-aa13-82847ace6c7a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:16:16.901219 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Updating instance_info_cache with network_info: [{"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:16.904533 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:16.994500 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:16:17.214082 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Successfully updated port: c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:16:17.350951 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1a486bcc-ab83-439d-9135-377dc3686592 req-12d420bd-ad73-45a5-bbd4-e9e88ae79153 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Received event network-vif-deleted-d448dee9-cd94-4537-b2b1-43d834fc96b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:17.353657 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-1a486bcc-ab83-439d-9135-377dc3686592 req-12d420bd-ad73-45a5-bbd4-e9e88ae79153 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Neutron deleted interface d448dee9-cd94-4537-b2b1-43d834fc96b8; detaching it from the instance and deleting it from the info cache
May 28 14:16:17.355831 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1a486bcc-ab83-439d-9135-377dc3686592 req-12d420bd-ad73-45a5-bbd4-e9e88ae79153 service nova] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Detach interface failed, port_id=d448dee9-cd94-4537-b2b1-43d834fc96b8, reason: Instance a95922fd-8d79-43bc-9052-e05f100abb79 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:16:17.403209 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6ea6792a-3f42-400a-a02b-c5e79fc27f6c req-cbc047d0-29f4-49f6-94f2-76b30aabfa57 service nova] Releasing lock "refresh_cache-d004d34f-24bd-44de-ac98-1500665bbe5e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:16:17.715954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:16:17.716366 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquired lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:16:17.716366 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:16:17.808266 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:17.880113 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-changed-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:17.880504 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Refreshing instance network info cache due to event network-changed-c097c9cb-baf6-4071-9b64-1feca70a79af. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:16:17.880653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] Acquiring lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:16:18.002256 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:16:18.003169 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:16:18.003421 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Creating image(s)
May 28 14:16:18.003887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:18.004068 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "/opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:18.004496 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "/opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:18.005559 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:16:18.008077 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:16:18.008959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:18.101543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:18.102260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:18.103000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:18.103462 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:16:18.107207 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:16:18.107706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:18.210026 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:18.211500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:18.281978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk 1073741824" returned: 0 in 0.069s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:18.281978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:18.281978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:18.313945 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Took 1.53 seconds to deallocate network for instance.
May 28 14:16:18.366919 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:16:18.382973 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:18.383531 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:16:18.383862 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:18.506367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:18.506899 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Cannot resize image /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:16:18.507266 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:16:18.507485 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Ensure instance console log exists: /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:16:18.510565 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:18.510565 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:18.510565 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:18.564102 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:18.742044 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updating instance_info_cache with network_info: [{"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:18.831401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:18.831675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:19.043157 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.166508 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:16:19.166822 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:16:19.244121 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Releasing lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:16:19.244121 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Instance network_info: |[{"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:16:19.245784 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Start _get_guest_xml network_info=[{"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:16:19.247519 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] Acquired lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:16:19.247519 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Refreshing network info cache for port c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:16:19.252136 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:16:19.253622 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-48604213', uuid='d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4'), owner=OwnerMeta(userid='c98b8f4e148b4557bd70bd6a755850a2', username='tempest-TestStampPattern-744679963-project-member', projectid='4c345e5241bd40c693ea2c6ccaf6c8f7', projectname='tempest-TestStampPattern-744679963'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977779.2532227) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:16:19.256443 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:16:19.256875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:16:19.260259 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:16:19.260459 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:16:19.261392 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:16:19.261797 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:16:19.261991 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:16:19.262032 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:16:19.262149 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:16:19.262251 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:16:19.262346 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:16:19.262502 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:16:19.262622 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:16:19.262796 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:16:19.262924 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:16:19.263180 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:16:19.277290 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-48604213',display_name='tempest-TestStampPattern-server-48604213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-teststamppattern-server-48604213',id=60,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVGtHnRGjb57xlZUEhRDuiB+xXkZ7jN9FPaNseGT7FSrTZcPTjhLnrQvMrvAtYZ5MnPjOEKth0jcuHVqpUUaORV+U1PWfUzZ8KcOJkHdmxykCwqNz8bU9QFZM3bOMj9fA==',key_name='tempest-TestStampPattern-255717967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c345e5241bd40c693ea2c6ccaf6c8f7',ramdisk_id='',reservation_id='r-bbkoz70d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-744679963',owner_user_name='tempest-TestStampPattern-744679963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:16:17Z,user_data=None,user_id='c98b8f4e148b4557bd70bd6a755850a2',uuid=d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:16:19.278083 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converting VIF {"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:19.278263 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=c097c9cb-baf6-4071-9b64-1feca70a79af,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc097c9cb-ba') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:19.279041 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'pci_devices' on Instance uuid d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:19.670066 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:16:19.751560 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:19.760105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.783226 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] End _get_guest_xml xml=<domain type="qemu">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <uuid>d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4</uuid>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <name>instance-0000003c</name>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestStampPattern-server-48604213</nova:name>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:16:19</nova:creationTime>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:user uuid="c98b8f4e148b4557bd70bd6a755850a2">tempest-TestStampPattern-744679963-project-member</nova:user>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:project uuid="4c345e5241bd40c693ea2c6ccaf6c8f7">tempest-TestStampPattern-744679963</nova:project>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         <nova:port uuid="c097c9cb-baf6-4071-9b64-1feca70a79af">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <system>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <entry name="serial">d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4</entry>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <entry name="uuid">d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4</entry>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </system>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <os>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   </os>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <features>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   </features>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   <devices>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </disk>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk.config"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </disk>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:c0:9e:aa"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <target dev="tapc097c9cb-ba"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </interface>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/console.log" append="off"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </serial>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <video>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </video>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </rng>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:   </devices>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]: </domain>
May 28 14:16:19.783226 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:16:19.783226 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Preparing to wait for external event network-vif-plugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:16:19.783226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:19.783226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-48604213',display_name='tempest-TestStampPattern-server-48604213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-teststamppattern-server-48604213',id=60,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVGtHnRGjb57xlZUEhRDuiB+xXkZ7jN9FPaNseGT7FSrTZcPTjhLnrQvMrvAtYZ5MnPjOEKth0jcuHVqpUUaORV+U1PWfUzZ8KcOJkHdmxykCwqNz8bU9QFZM3bOMj9fA==',key_name='tempest-TestStampPattern-255717967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c345e5241bd40c693ea2c6ccaf6c8f7',ramdisk_id='',reservation_id='r-bbkoz70d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-744679963',owner_user_name='tempest-TestStampPattern-744679963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:16:17Z,user_data=None,user_id='c98b8f4e148b4557bd70bd6a755850a2',uuid=d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converting VIF {"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=c097c9cb-baf6-4071-9b64-1feca70a79af,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc097c9cb-ba') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=c097c9cb-baf6-4071-9b64-1feca70a79af,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc097c9cb-ba') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:19.787339 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:16:19.787910 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.788065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7230d7b-99c0-5ada-9fc7-a755c3da0f2a', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:19.789399 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.790896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:19.790896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.793761 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.793908 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc097c9cb-ba, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:19.794291 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc097c9cb-ba, col_values=(('qos', UUID('05d53299-1fc5-4cad-8674-21d727e67bd1')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:19.794567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc097c9cb-ba, col_values=(('external_ids', {'iface-id': 'c097c9cb-baf6-4071-9b64-1feca70a79af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:9e:aa', 'vm-uuid': 'd9e5ad3a-cd88-4d56-8c9c-8f782ded06e4'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:19.795635 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.797759 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:19.804010 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:19.805778 np0000001643 nova-compute[98269]: INFO os_vif [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=c097c9cb-baf6-4071-9b64-1feca70a79af,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc097c9cb-ba')
May 28 14:16:20.102260 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:20.181065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.349s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:20.264968 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Deleted allocations for instance a95922fd-8d79-43bc-9052-e05f100abb79
May 28 14:16:20.275507 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updated VIF entry in instance network info cache for port c097c9cb-baf6-4071-9b64-1feca70a79af. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:16:20.275507 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updating instance_info_cache with network_info: [{"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:20.778437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b53b0563-f8f8-49e3-a44b-056a50af79e8 req-b97fa07e-f60b-41fd-9d09-ce2292018913 service nova] Releasing lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:16:21.273640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2624fb25-5674-4c30-b5d8-e55ae727de6c tempest-SnapshotDataIntegrityTests-859017370 tempest-SnapshotDataIntegrityTests-859017370-project-member] Lock "a95922fd-8d79-43bc-9052-e05f100abb79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.379s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:21.324893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:21.324893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:21.324893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No VIF found with MAC fa:16:3e:c0:9e:aa, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:16:21.324893 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Using config drive
May 28 14:16:21.831470 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:22.072516 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Creating config drive at /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk.config
May 28 14:16:22.075483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqph2ra32 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:22.125397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqph2ra32" returned: 0 in 0.050s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:22.558780 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:22.585263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:22.684194 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:22.789347 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5822294a-e01c-46aa-865c-c27d263d8b7d req-80aaa6fe-af97-42d4-960d-4ad5be51dc4f service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-vif-plugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:22.792469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5822294a-e01c-46aa-865c-c27d263d8b7d req-80aaa6fe-af97-42d4-960d-4ad5be51dc4f service nova] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:22.792469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5822294a-e01c-46aa-865c-c27d263d8b7d req-80aaa6fe-af97-42d4-960d-4ad5be51dc4f service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:22.792469 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5822294a-e01c-46aa-865c-c27d263d8b7d req-80aaa6fe-af97-42d4-960d-4ad5be51dc4f service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:22.792469 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5822294a-e01c-46aa-865c-c27d263d8b7d req-80aaa6fe-af97-42d4-960d-4ad5be51dc4f service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Processing event network-vif-plugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:16:22.975036 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:22.978205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:22.981970 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:23.005713 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:23.500707 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:16:23.501172 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977783.5007994, d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:23.501494 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] VM Started (Lifecycle Event)
May 28 14:16:23.504850 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:16:23.507144 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Instance spawned successfully.
May 28 14:16:23.509480 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:16:23.860577 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0018575250001049426 future=<Future at 0x71a75c4eaf60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:23.860713 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:23.860833 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.889829427999757 future=<Future at 0x71a75c4e9010 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:23.860949 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.8897148759997435 future=<Future at 0x71a75c4e9010 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:23.861491 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Emitting event <LifecycleEvent: 1779977768.8585963, 5b580f8d-61fa-4994-822f-0500e14eeced => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:23.861647 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] VM Stopped (Lifecycle Event)
May 28 14:16:24.004179 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:24.006377 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:16:24.021241 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:24.021571 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:24.021769 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:24.022065 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:24.022340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:24.022625 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:16:24.267196 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:24.364994 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: 5b580f8d-61fa-4994-822f-0500e14eeced] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:24.508779 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:16:24.509032 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977784.5088418, d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:24.509247 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] VM Paused (Lifecycle Event)
May 28 14:16:24.528167 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Took 6.53 seconds to spawn the instance on the hypervisor.
May 28 14:16:24.528347 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:24.766816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:24.795471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:24.853538 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-170facb9-f114-4273-9779-362fdec2c03b req-0cf5f4d8-9209-4e88-ae82-7559a2186a56 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-vif-plugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:24.855571 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-170facb9-f114-4273-9779-362fdec2c03b req-0cf5f4d8-9209-4e88-ae82-7559a2186a56 service nova] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:24.855721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-170facb9-f114-4273-9779-362fdec2c03b req-0cf5f4d8-9209-4e88-ae82-7559a2186a56 service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:24.855836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-170facb9-f114-4273-9779-362fdec2c03b req-0cf5f4d8-9209-4e88-ae82-7559a2186a56 service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:24.856393 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-170facb9-f114-4273-9779-362fdec2c03b req-0cf5f4d8-9209-4e88-ae82-7559a2186a56 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] No waiting events found dispatching network-vif-plugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:24.856750 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-170facb9-f114-4273-9779-362fdec2c03b req-0cf5f4d8-9209-4e88-ae82-7559a2186a56 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received unexpected event network-vif-plugged-c097c9cb-baf6-4071-9b64-1feca70a79af for instance with vm_state active and task_state None.
May 28 14:16:25.012658 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:25.015310 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977785.0150664, d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:25.015472 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] VM Resumed (Lifecycle Event)
May 28 14:16:25.039174 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Took 13.15 seconds to build instance.
May 28 14:16:25.517948 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:25.521215 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:16:25.542847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.663s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:26.343906 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:27.322144 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-changed-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:27.324381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Refreshing instance network info cache due to event network-changed-c097c9cb-baf6-4071-9b64-1feca70a79af. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:16:27.324626 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] Acquiring lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:16:27.324890 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] Acquired lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:16:27.325022 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Refreshing network info cache for port c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:16:27.828871 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:28.181435 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:28.195001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:28.195147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:28.343049 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updated VIF entry in instance network info cache for port c097c9cb-baf6-4071-9b64-1feca70a79af. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:16:28.343532 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updating instance_info_cache with network_info: [{"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:28.701243 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'flavor' on Instance uuid e17be93d-817c-4da2-8867-bc483843b6a6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:28.845790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b40df1fb-bcc7-4502-8bb1-c93843bd887b req-508ff8fd-9ccc-43dc-a739-c2ec2cc7d3cf service nova] Releasing lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:16:29.203957 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Ignoring supplied device name: /dev/vdb
May 28 14:16:29.706353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:29.763952 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:29.796358 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:30.751177 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00043059000017819926 future=<Future at 0x71a75c4e9010 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:30.751777 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Emitting event <LifecycleEvent: 1779977775.750609, a95922fd-8d79-43bc-9052-e05f100abb79 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:16:30.751925 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:30.752125 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] VM Stopped (Lifecycle Event)
May 28 14:16:30.776082 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:30.776319 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:30.776614 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Attaching volume f53f0451-5dfd-4db4-aef8-4250ec345ecf to /dev/vdb
May 28 14:16:30.826614 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:30.827548 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:30.827754 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:16:30.828173 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:30.838354 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:16:30.861829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:30.914906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:16:30.915183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:16:30.925712 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:16:30.927556 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fea5:6858', 'fe80::9885:a1ff:feb8:60ba', 'fe80::fc16:3eff:fef2:6d3d', 'fe80::f410:c8ff:fe38:9c26', 'fe80::fc16:3eff:fe14:3d3e', 'fe80::8097:21ff:fe89:3b01', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:16:30.927820 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:16:30.927979 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:16:30.928298 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:30.928676 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Updating existing volume attachment record: c4fdab00-ba8b-493e-92d8-5c01ded1360e {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:16:31.255239 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: a95922fd-8d79-43bc-9052-e05f100abb79] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:31.453645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:31.453836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:31.489025 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:16:31.489406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:31.489583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:31.489972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:31.490193 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:16:31.502961 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:31.503729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:31.504186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:31.504391 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:31.504904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:31.505100 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:31.517710 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:31.517710 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:31.529993 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:31.529993 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf] added
May 28 14:16:31.538478 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:31.538478 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:31.538478 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:31.542265 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf] added
May 28 14:16:31.542265 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:31.542265 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:31.542265 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:31.542265 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:31.542265 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:31.542265 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:31.542510 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:31.542763 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:31.542926 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:31.827878 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:31.828477 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:31.828909 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:31.828909 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:31.957573 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lazy-loading 'flavor' on Instance uuid 315479ab-df1d-4a37-8483-12526e101ef7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:32.461516 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Ignoring supplied device name: /dev/vdb
May 28 14:16:32.536889 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:32.543464 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:32.550946 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:32.550946 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:32.562509 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:32.562509 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.569830 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.576321 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.584686 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.584686 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.584686 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:32.585106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.585106 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.585106 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:32.590901 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.590901 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.590901 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:32.591079 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.591079 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.591079 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:32.614935 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.50.100,3260]
May 28 14:16:32.614935 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.50.100,3260] successful.
May 28 14:16:32.614935 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.623092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.40.100,3260]
May 28 14:16:32.623092 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.40.100,3260] successful.
May 28 14:16:32.623092 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.628404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.636034 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:32.644240 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.644240 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.644240 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.644240 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.644240 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:32.644461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.644461 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.644461 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.644461 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.644461 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:32.644752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:32.644873 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:32.645596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] HCTL ('7', '-', '-', 0) found on session 150 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:32.645719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:32.650550 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:32.650937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:32.651254 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:32.651957 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] HCTL ('8', '-', '-', 0) found on session 151 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:32.652125 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:32.662223 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching for a device in session 150 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:32.662223 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:32.667660 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Searching for a device in session 151 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:32.667660 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:32.827035 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:32.964280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:33.331415 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:33.331699 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:33.331879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:33.332058 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:16:33.504702 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:16:34.038124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:34.038579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:34.038579 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Attaching volume 70363d13-de9b-495d-badd-3e183c936077 to /dev/vdb
May 28 14:16:34.088375 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:34.101490 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:16:34.131836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:34.187167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:16:34.187475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:16:34.197729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:16:34.198995 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fea5:6858', 'fe80::9885:a1ff:feb8:60ba', 'fe80::fc16:3eff:fef2:6d3d', 'fe80::f410:c8ff:fe38:9c26', 'fe80::fc16:3eff:fe14:3d3e', 'fe80::8097:21ff:fe89:3b01', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:16:34.199157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:16:34.199273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:16:34.199537 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:34.199874 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Updating existing volume attachment record: 1f1efad0-31df-4f28-8020-421a3abe5b94 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:16:34.359464 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:34.461156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:34.461751 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:34.520819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Found WWN 330000000daf805b7 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:16:34.521365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:34.521636 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000daf805b7', 'path': '/dev/dm-0', 'multipath_id': '330000000daf805b7'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:34.521851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000daf805b7', 'path': '/dev/dm-0', 'multipath_id': '330000000daf805b7'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:16:34.526337 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'flavor' on Instance uuid e17be93d-817c-4da2-8867-bc483843b6a6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:34.566634 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:34.569157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:34.671204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:34.671852 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:34.754623 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:16:34.754968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:34.755188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:34.755629 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:34.755804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:16:34.766419 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:34.768853 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:34.770576 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:34.771194 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:34.771731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:34.773555 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:16:34.773904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:34.774019 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:34.774229 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:34.775889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:34.795884 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:34.795884 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:34.796520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:34.796520 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:34.797752 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:34.808857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077] added
May 28 14:16:34.808857 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:34.808857 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:34.808857 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:34.808857 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:34.808857 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:34.808857 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:34.811467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:34.811467 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:34.811467 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:34.812903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077] added
May 28 14:16:34.812903 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:34.812903 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:34.812903 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:34.812903 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:34.812903 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:34.812903 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:34.813052 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:34.813202 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:34.813319 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:34.880819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:34.881430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:34.975707 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:34.979668 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:16:34.980989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:35.025840 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:35.026438 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12589MB free_disk=72.86611938476562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:16:35.026644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:35.026883 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:35.030378 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Attempting to attach volume f53f0451-5dfd-4db4-aef8-4250ec345ecf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:16:35.032133 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:16:35.032133 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:35.032133 np0000001643 nova-compute[98269]:   <alias name="ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf"/>
May 28 14:16:35.032133 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:16:35.032133 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:35.032133 np0000001643 nova-compute[98269]:   <serial>f53f0451-5dfd-4db4-aef8-4250ec345ecf</serial>
May 28 14:16:35.032133 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:35.032133 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:16:35.810329 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:35.813819 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:35.826291 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:35.826291 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:35.832063 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:35.832063 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.840186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.848409 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.863277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.863277 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.863277 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.863277 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.863277 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:35.863710 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.863710 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.863710 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.863710 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.863710 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:35.864514 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.864514 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.864514 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.864514 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.864514 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:35.864754 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.864754 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.864754 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.864754 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.864754 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:35.901908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.50.100,3260]
May 28 14:16:35.901908 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.50.100,3260] successful.
May 28 14:16:35.901908 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.908764 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.40.100,3260]
May 28 14:16:35.908764 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.40.100,3260] successful.
May 28 14:16:35.908764 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.915655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.922092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:35.932164 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.932164 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.932164 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.932164 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.932164 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.932164 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.932164 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:35.932695 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.932695 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.932695 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.932695 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.932695 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.932695 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.932695 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:35.933067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:35.933067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:35.934035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] HCTL ('11', '-', '-', 0) found on session 152 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:35.934168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:35.938799 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.938799 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.938799 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.938799 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.938799 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.938799 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.938799 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:35.939038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.939038 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:35.939038 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.939038 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:35.939038 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.939038 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:35.939038 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:35.939205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:35.939489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:35.940211 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] HCTL ('12', '-', '-', 0) found on session 153 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:35.940341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:35.951089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Searching for a device in session 152 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:35.951089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:35.957703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Searching for a device in session 153 and hctl ['12', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:36.092187 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance e17be93d-817c-4da2-8867-bc483843b6a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:16:36.092440 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 315479ab-df1d-4a37-8483-12526e101ef7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:16:36.096302 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d004d34f-24bd-44de-ac98-1500665bbe5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:16:36.096608 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:16:36.097272 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:16:36.097428 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:16:35 up 43 min,  2 users,  load average: 4.75, 5.58, 4.59\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_503ff5746ac94b068fca926067617b52': '1', 'io_workload': '0', 'num_proj_294bedb01ef5467881b271a665929681': '1', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1', 'num_proj_4c345e5241bd40c693ea2c6ccaf6c8f7': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:16:36.306119 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:16:36.306347 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:16:36.675439 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:36.675634 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:36.675763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:36.675877 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No VIF found with MAC fa:16:3e:a5:68:58, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:16:36.809050 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:16:36.959295 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Searching for a device in session 153 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:36.959848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:37.316849 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:16:37.316973 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.290s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:37.317291 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:37.791470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Found WWN 330000000beadb3ed for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:16:37.791833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:37.792025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000beadb3ed', 'path': '/dev/dm-4', 'multipath_id': '330000000beadb3ed'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:37.792195 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000beadb3ed', 'path': '/dev/dm-4', 'multipath_id': '330000000beadb3ed'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:16:37.797438 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lazy-loading 'flavor' on Instance uuid 315479ab-df1d-4a37-8483-12526e101ef7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:38.227140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0b1f07ce-e4f3-441c-ab36-e8a44b183bc9 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.451s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:38.301805 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Attempting to attach volume 70363d13-de9b-495d-badd-3e183c936077 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:16:38.302894 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:16:38.302894 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:38.302894 np0000001643 nova-compute[98269]:   <alias name="ua-70363d13-de9b-495d-badd-3e183c936077"/>
May 28 14:16:38.302894 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:16:38.302894 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:38.302894 np0000001643 nova-compute[98269]:   <serial>70363d13-de9b-495d-badd-3e183c936077</serial>
May 28 14:16:38.302894 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:38.302894 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:16:38.317262 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:38.317659 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.51 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:38.823227 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:38.823546 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:38.826726 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:38.827004 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:39.769456 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:39.803343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:39.973204 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:39.973391 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:39.973391 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:16:39.973483 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] No VIF found with MAC fa:16:3e:f2:6d:3d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:16:41.517571 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-11d02190-b418-44c1-aea9-b529beaf218a tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.479s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:41.658168 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event volume-extended-70363d13-de9b-495d-badd-3e183c936077 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:41.822966 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:16:41.823291 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:42.041205 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:16:42.161640 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Handling volume-extended event for volume 70363d13-de9b-495d-badd-3e183c936077 {{(pid=98269) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
May 28 14:16:42.663940 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Cinder extended volume 70363d13-de9b-495d-badd-3e183c936077; extending it to detect new size
May 28 14:16:43.191586 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] calling os-brick to extend iSCSI Volume {{(pid=98269) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 28 14:16:43.191788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}), 'kwargs': {}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:43.191904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:43.192284 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:43.192551 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}
May 28 14:16:43.192652 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Multipath discovery for iSCSI enabled
May 28 14:16:43.192823 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0']
May 28 14:16:43.192965 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0'] {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 28 14:16:43.210381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0'] {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 28 14:16:43.210629 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Running cmd (subprocess): lsscsi {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:43.255647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] CMD "lsscsi" returned: 0 in 0.045s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:43.256086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98269) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 14:16:43.256230 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 14:16:43.264230 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Starting size: 1073741824 {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 14:16:43.283635 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] volume size after scsi device rescan 2147483648 {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 14:16:43.283851 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Running cmd (subprocess): lsscsi {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:43.326843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] CMD "lsscsi" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:16:43.328895 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98269) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 14:16:43.329043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 14:16:43.337347 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Starting size: 1073741824 {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 14:16:43.357108 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] volume size after scsi device rescan 2147483648 {{(pid=98269) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 14:16:43.367808 np0000001643 nova-compute[98269]: INFO os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Find Multipath device file for volume WWN 330000000beadb3ed
May 28 14:16:43.368156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000beadb3ed exists yet. {{(pid=98269) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 28 14:16:43.368329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] /dev/disk/by-id/dm-uuid-mpath-330000000beadb3ed has shown up. {{(pid=98269) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 28 14:16:43.388260 np0000001643 nova-compute[98269]: INFO os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000beadb3ed) current size 1073741824
May 28 14:16:43.438348 np0000001643 nova-compute[98269]: INFO os_brick.initiator.linuxscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000beadb3ed) new size 2147483648
May 28 14:16:43.438839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.246s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:43.438997 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] <== extend_volume: return (247ms) 2147483648 {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:43.439205 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Extend iSCSI Volume: new_size=2147483648 {{(pid=98269) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 28 14:16:43.443146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [req-738b05a0-f4ae-404d-bc8e-63d3de4d2370 req-f5b21bb0-9220-4d22-82b1-6a14064877da service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Resizing target device /dev/dm-4 to 2147483648 {{(pid=98269) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 28 14:16:44.198609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:44.198963 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:44.264267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:44.264518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:44.296822 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:44.701317 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Detaching volume f53f0451-5dfd-4db4-aef8-4250ec345ecf
May 28 14:16:44.750852 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Attempting to driver detach volume f53f0451-5dfd-4db4-aef8-4250ec345ecf from mountpoint /dev/vdb
May 28 14:16:44.754984 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Found disk vdb by alias ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:16:44.756128 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Found disk vdb by alias ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:16:44.756239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Attempting to detach device vdb from instance e17be93d-817c-4da2-8867-bc483843b6a6 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:16:44.756502 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:16:44.756502 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:44.756502 np0000001643 nova-compute[98269]:   <alias name="ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf"/>
May 28 14:16:44.756502 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:16:44.756502 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:44.756502 np0000001643 nova-compute[98269]:   <serial>f53f0451-5dfd-4db4-aef8-4250ec345ecf</serial>
May 28 14:16:44.756502 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:16:44.756502 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:44.756502 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:16:44.762264 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully detached device vdb from instance e17be93d-817c-4da2-8867-bc483843b6a6 from the persistent domain config.
May 28 14:16:44.762383 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] (1/8): Attempting to detach device vdb with device alias ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf from instance e17be93d-817c-4da2-8867-bc483843b6a6 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:16:44.762671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:16:44.762671 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:44.762671 np0000001643 nova-compute[98269]:   <alias name="ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf"/>
May 28 14:16:44.762671 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:16:44.762671 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:44.762671 np0000001643 nova-compute[98269]:   <serial>f53f0451-5dfd-4db4-aef8-4250ec345ecf</serial>
May 28 14:16:44.762671 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:16:44.762671 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:44.762671 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:16:44.766573 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Detaching volume 70363d13-de9b-495d-badd-3e183c936077
May 28 14:16:44.771087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:44.803013 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Attempting to driver detach volume 70363d13-de9b-495d-badd-3e183c936077 from mountpoint /dev/vdb
May 28 14:16:44.804331 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:44.808222 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Found disk vdb by alias ua-70363d13-de9b-495d-badd-3e183c936077 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:16:44.809519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Found disk vdb by alias ua-70363d13-de9b-495d-badd-3e183c936077 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:16:44.809643 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Attempting to detach device vdb from instance 315479ab-df1d-4a37-8483-12526e101ef7 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:16:44.809899 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:16:44.809899 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:44.809899 np0000001643 nova-compute[98269]:   <alias name="ua-70363d13-de9b-495d-badd-3e183c936077"/>
May 28 14:16:44.809899 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:16:44.809899 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:44.809899 np0000001643 nova-compute[98269]:   <serial>70363d13-de9b-495d-badd-3e183c936077</serial>
May 28 14:16:44.809899 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:16:44.809899 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:44.809899 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:16:44.816170 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Successfully detached device vdb from instance 315479ab-df1d-4a37-8483-12526e101ef7 from the persistent domain config.
May 28 14:16:44.816287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] (1/8): Attempting to detach device vdb with device alias ua-70363d13-de9b-495d-badd-3e183c936077 from instance 315479ab-df1d-4a37-8483-12526e101ef7 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:16:44.816533 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:16:44.816533 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:16:44.816533 np0000001643 nova-compute[98269]:   <alias name="ua-70363d13-de9b-495d-badd-3e183c936077"/>
May 28 14:16:44.816533 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:16:44.816533 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:16:44.816533 np0000001643 nova-compute[98269]:   <serial>70363d13-de9b-495d-badd-3e183c936077</serial>
May 28 14:16:44.816533 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:16:44.816533 np0000001643 nova-compute[98269]: </disk>
May 28 14:16:44.816533 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:16:45.250358 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977805.2499523, e17be93d-817c-4da2-8867-bc483843b6a6 => ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:16:45.253881 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f53f0451-5dfd-4db4-aef8-4250ec345ecf for instance e17be93d-817c-4da2-8867-bc483843b6a6 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:16:45.257050 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully detached device vdb from instance e17be93d-817c-4da2-8867-bc483843b6a6 from the live domain config.
May 28 14:16:45.259051 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:16:45.259643 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:45.259873 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:45.260225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:45.260590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:16:45.260785 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:16:45.294123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.294123 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.294123 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:45.294123 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:45.294123 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.294123 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.294123 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:45.294379 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.294379 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.294379 np0000001643 nova-compute[98269]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:45.294379 np0000001643 nova-compute[98269]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf (non-flash)
May 28 14:16:45.294379 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.294379 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.294379 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:45.294379 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', '153')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:16:45.294615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', '151')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:45.295353 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', '150')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:45.296045 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a77811d080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:16:45.296218 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:16:45.296426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Flush multipath device 330000000daf805b7 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:16:45.329438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:16:45.357530 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977805.3571703, 315479ab-df1d-4a37-8483-12526e101ef7 => ua-70363d13-de9b-495d-badd-3e183c936077> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:16:45.358773 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-70363d13-de9b-495d-badd-3e183c936077 for instance 315479ab-df1d-4a37-8483-12526e101ef7 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:16:45.362203 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Successfully detached device vdb from instance 315479ab-df1d-4a37-8483-12526e101ef7 from the live domain config.
May 28 14:16:45.363560 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:16:45.363805 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:45.363924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:45.370924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:16:45.427051 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:16:45.427240 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:16:45.428176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:16:45.440173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:16:45.440421 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:16:45.452964 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.489814 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.40.100,3260]
May 28 14:16:45.489814 np0000001643 nova-compute[98269]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.40.100,3260] successful.
May 28 14:16:45.489814 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.503637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.514051 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.538641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.50.100,3260]
May 28 14:16:45.538641 np0000001643 nova-compute[98269]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, portal: 192.168.50.100,3260] successful.
May 28 14:16:45.538641 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.553915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.554255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:45.554476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== disconnect_volume: return (294ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:45.554837 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:16:45.555281 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.191s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:45.555645 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70363d13-de9b-495d-badd-3e183c936077', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:16:45.555800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:16:45.578974 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.578974 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.578974 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.578974 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.578974 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:45.579175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.579175 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:45.579175 np0000001643 nova-compute[98269]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.579175 np0000001643 nova-compute[98269]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077 (non-flash)
May 28 14:16:45.579175 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:45.579282 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', '153')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:16:45.579348 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', '153')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:45.580141 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077', '152')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:45.580877 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c3c58a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:16:45.581155 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:16:45.581359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Flush multipath device 330000000beadb3ed {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:16:45.613422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:16:45.649788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:16:45.693038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:16:45.693238 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:16:45.694215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:16:45.704307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:16:45.704552 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:16:45.715032 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.744491 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.40.100,3260]
May 28 14:16:45.744491 np0000001643 nova-compute[98269]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.40.100,3260] successful.
May 28 14:16:45.744491 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.756271 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.766474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.800474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.50.100,3260]
May 28 14:16:45.800474 np0000001643 nova-compute[98269]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-70363d13-de9b-495d-badd-3e183c936077, portal: 192.168.50.100,3260] successful.
May 28 14:16:45.800474 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.813878 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:45.814105 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:45.814246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] <== disconnect_volume: return (450ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:45.814357 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:16:46.105641 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'flavor' on Instance uuid e17be93d-817c-4da2-8867-bc483843b6a6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:46.371097 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lazy-loading 'flavor' on Instance uuid 315479ab-df1d-4a37-8483-12526e101ef7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:47.074416 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:47.113140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-09925f2e-0ba8-44e4-9c37-2a5166dea742 tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.912s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:47.113140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.815s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:47.113140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:47.113140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:47.113140 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:47.117522 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Terminating instance
May 28 14:16:47.378617 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e0229d14-69e8-4294-8c2d-c70c3e733a09 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.114s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:47.499221 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:47.499549 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:47.499549 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:47.500069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:47.500069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:47.501437 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Terminating instance
May 28 14:16:47.622776 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:16:47.644895 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:47.668566 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:47.688100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:47.692903 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:47.955367 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1b4a8883-99cf-4577-9962-7a3a54d86789 req-7c945d77-74df-4478-9c8c-24e0a81ce4f2 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-vif-unplugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:47.955915 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1b4a8883-99cf-4577-9962-7a3a54d86789 req-7c945d77-74df-4478-9c8c-24e0a81ce4f2 service nova] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:47.956131 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1b4a8883-99cf-4577-9962-7a3a54d86789 req-7c945d77-74df-4478-9c8c-24e0a81ce4f2 service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:47.956307 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1b4a8883-99cf-4577-9962-7a3a54d86789 req-7c945d77-74df-4478-9c8c-24e0a81ce4f2 service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:47.956501 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1b4a8883-99cf-4577-9962-7a3a54d86789 req-7c945d77-74df-4478-9c8c-24e0a81ce4f2 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] No waiting events found dispatching network-vif-unplugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:47.956585 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1b4a8883-99cf-4577-9962-7a3a54d86789 req-7c945d77-74df-4478-9c8c-24e0a81ce4f2 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-vif-unplugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:47.957318 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99983492399997 future=<Future at 0x71a75c17e720 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:47.958157 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999004126999807 future=<Future at 0x71a75c17e720 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:47.958253 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998888262000037 future=<Future at 0x71a75c17e720 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:47.959291 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Instance destroyed successfully.
May 28 14:16:47.959649 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lazy-loading 'resources' on Instance uuid e17be93d-817c-4da2-8867-bc483843b6a6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:48.004146 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:16:48.029600 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.030597 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.052023 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.054128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.084229 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.085396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.184306 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-60427bc3-4e0e-4ab1-b357-8953a6c203c9 req-9e430cf3-ec83-4a5e-86a3-831faa2d353e service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-vif-unplugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:48.184752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60427bc3-4e0e-4ab1-b357-8953a6c203c9 req-9e430cf3-ec83-4a5e-86a3-831faa2d353e service nova] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:48.184927 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60427bc3-4e0e-4ab1-b357-8953a6c203c9 req-9e430cf3-ec83-4a5e-86a3-831faa2d353e service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:48.185055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-60427bc3-4e0e-4ab1-b357-8953a6c203c9 req-9e430cf3-ec83-4a5e-86a3-831faa2d353e service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:48.185177 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-60427bc3-4e0e-4ab1-b357-8953a6c203c9 req-9e430cf3-ec83-4a5e-86a3-831faa2d353e service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] No waiting events found dispatching network-vif-unplugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:48.185302 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-60427bc3-4e0e-4ab1-b357-8953a6c203c9 req-9e430cf3-ec83-4a5e-86a3-831faa2d353e service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-vif-unplugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:48.342712 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99971837899966 future=<Future at 0x71a7781d89e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:48.347364 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Instance destroyed successfully.
May 28 14:16:48.347784 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lazy-loading 'resources' on Instance uuid 315479ab-df1d-4a37-8483-12526e101ef7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:48.462070 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-806804829',display_name='tempest-VolumesSnapshotTestJSON-instance-806804829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumessnapshottestjson-instance-806804829',id=57,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9FaHWf6eJ47ui0v2Qy7LIwD9lpFD3A1H6JEw/5fcSHclLA0OwHF08USmk5xNvDVxM42mFTDHtgG9L1nmZKOAUoHBk48JJa5IW5d0HwxTbFo4EQlok44huuphS1HUAJgw==',key_name='tempest-keypair-922566510',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:15:50Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='503ff5746ac94b068fca926067617b52',ramdisk_id='',reservation_id='r-45t2uvmu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-33088366',owner_user_name='tempest-VolumesSnapshotTestJSON-33088366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:15:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4fa943716494225849fb8aac46fb662',uuid=e17be93d-817c-4da2-8867-bc483843b6a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:16:48.462576 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converting VIF {"id": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "address": "fa:16:3e:a5:68:58", "network": {"id": "c6bacbc9-7052-49ce-831f-2f76066015a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-21985653-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "503ff5746ac94b068fca926067617b52", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd8cc08-77", "ovs_interfaceid": "5fd8cc08-7766-472e-80e9-764f3b5820f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:48.462888 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:68:58,bridge_name='br-int',has_traffic_filtering=True,id=5fd8cc08-7766-472e-80e9-764f3b5820f3,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd8cc08-77') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:48.463113 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:68:58,bridge_name='br-int',has_traffic_filtering=True,id=5fd8cc08-7766-472e-80e9-764f3b5820f3,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd8cc08-77') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:16:48.464255 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.464517 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fd8cc08-77, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:48.466712 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.466896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:48.472155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.479104 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.479297 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e058c8bf-a2ed-4ed3-a2fc-98fe14a016c5) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:48.480780 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:48.485050 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.487121 np0000001643 nova-compute[98269]: INFO os_vif [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:68:58,bridge_name='br-int',has_traffic_filtering=True,id=5fd8cc08-7766-472e-80e9-764f3b5820f3,network=Network(c6bacbc9-7052-49ce-831f-2f76066015a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd8cc08-77')
May 28 14:16:48.488592 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:16:48.488878 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:48.489038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:48.489341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:48.489656 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f53f0451-5dfd-4db4-aef8-4250ec345ecf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:16:48.489817 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:16:48.512981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:48.512981 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:48.512981 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:48.513171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:48.513171 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:48.513171 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:48.513303 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '149')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:16:48.513381 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:48.513711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:16:48.513711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf, 0): [] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:16:48.513711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f53f0451-5dfd-4db4-aef8-4250ec345ecf') {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 14:16:48.513849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c1713a0>, {}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:16:48.513849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Disconnecting from: [] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:16:48.514121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.025s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:48.514231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] <== disconnect_volume: return (25ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:48.514331 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:16:48.514659 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Deleting instance files /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6_del
May 28 14:16:48.515380 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Deletion of /opt/stack/data/nova/instances/e17be93d-817c-4da2-8867-bc483843b6a6_del complete
May 28 14:16:48.849960 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1516289022',display_name='tempest-VolumesExtendAttachedTest-instance-1516289022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-volumesextendattachedtest-instance-1516289022',id=58,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB05zyOAYWovr9BR5aSdMaJRX3yCowl+xeRWRE4fWtDKmtYjw9WlkRJXEQtNmTs3BAYV0FsnqI/WuBSDxIzLuhX9jpbleuteP3ONO1tYNMzhbRoZGkXbylFrOeXkVAHHHQ==',key_name='tempest-keypair-123890844',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:15:52Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294bedb01ef5467881b271a665929681',ramdisk_id='',reservation_id='r-rsiwjn1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-2074693502',owner_user_name='tempest-VolumesExtendAttachedTest-2074693502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9efc3ab17f435ca354ca8c621f6ac7',uuid=315479ab-df1d-4a37-8483-12526e101ef7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:16:48.850188 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Converting VIF {"id": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "address": "fa:16:3e:f2:6d:3d", "network": {"id": "a6bcb0d8-9f34-4d35-b721-0e231f41e48a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-2061554888-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "294bedb01ef5467881b271a665929681", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b14d29-40", "ovs_interfaceid": "c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:16:48.850641 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:6d:3d,bridge_name='br-int',has_traffic_filtering=True,id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06,network=Network(a6bcb0d8-9f34-4d35-b721-0e231f41e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b14d29-40') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:16:48.850817 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:6d:3d,bridge_name='br-int',has_traffic_filtering=True,id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06,network=Network(a6bcb0d8-9f34-4d35-b721-0e231f41e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b14d29-40') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:16:48.851550 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.851735 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4b14d29-40, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:48.853894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:48.854436 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.854983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.855122 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22e757b0-bac6-4cb6-a64f-09bbf99007fc) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:16:48.856310 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:16:48.857427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:48.859046 np0000001643 nova-compute[98269]: INFO os_vif [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:6d:3d,bridge_name='br-int',has_traffic_filtering=True,id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06,network=Network(a6bcb0d8-9f34-4d35-b721-0e231f41e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b14d29-40')
May 28 14:16:48.859306 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Deleting instance files /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7_del
May 28 14:16:48.860041 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Deletion of /opt/stack/data/nova/instances/315479ab-df1d-4a37-8483-12526e101ef7_del complete
May 28 14:16:49.022238 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 14:16:49.022722 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:16:49.022900 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:16:49.022998 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:16:49.023206 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:49.077766 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:49.365011 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 14:16:49.365511 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:16:49.365858 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:16:49.365954 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:16:49.366150 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:49.439918 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:16:49.772096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:49.921827 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:50.013697 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b3210dc9-e780-4f95-ac76-b1501befe0d0 req-c6d6197c-fee7-41e6-8cd2-66d48bf06e91 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-vif-unplugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:50.014063 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b3210dc9-e780-4f95-ac76-b1501befe0d0 req-c6d6197c-fee7-41e6-8cd2-66d48bf06e91 service nova] Acquiring lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:50.014224 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b3210dc9-e780-4f95-ac76-b1501befe0d0 req-c6d6197c-fee7-41e6-8cd2-66d48bf06e91 service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:50.014353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b3210dc9-e780-4f95-ac76-b1501befe0d0 req-c6d6197c-fee7-41e6-8cd2-66d48bf06e91 service nova] Lock "e17be93d-817c-4da2-8867-bc483843b6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:50.014479 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b3210dc9-e780-4f95-ac76-b1501befe0d0 req-c6d6197c-fee7-41e6-8cd2-66d48bf06e91 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] No waiting events found dispatching network-vif-unplugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:50.014753 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b3210dc9-e780-4f95-ac76-b1501befe0d0 req-c6d6197c-fee7-41e6-8cd2-66d48bf06e91 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-vif-unplugged-5fd8cc08-7766-472e-80e9-764f3b5820f3 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:50.014753 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b3210dc9-e780-4f95-ac76-b1501befe0d0 req-c6d6197c-fee7-41e6-8cd2-66d48bf06e91 service nova] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Received event network-vif-deleted-5fd8cc08-7766-472e-80e9-764f3b5820f3 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:50.241427 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-vif-unplugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:50.241788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] Acquiring lock "315479ab-df1d-4a37-8483-12526e101ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:50.242005 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:50.242184 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] Lock "315479ab-df1d-4a37-8483-12526e101ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:50.242360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] No waiting events found dispatching network-vif-unplugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:50.242566 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-vif-unplugged-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:16:50.242788 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Received event network-vif-deleted-c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:50.242912 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Neutron deleted interface c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06; detaching it from the instance and deleting it from the info cache
May 28 14:16:50.244503 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8e972b65-3bec-4e6c-ba3f-7553d2838f06 req-e6acabc0-4388-42ce-8054-a92cffdf93cf service nova] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Detach interface failed, port_id=c4b14d29-4015-42d0-b1a9-aa6dfb4b8e06, reason: Instance 315479ab-df1d-4a37-8483-12526e101ef7 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:16:50.408362 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:16:50.423632 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Took 1.40 seconds to deallocate network for instance.
May 28 14:16:50.438987 np0000001643 nova-compute[98269]: WARNING nova.volume.cinder [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Attachment c4fdab00-ba8b-493e-92d8-5c01ded1360e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c4fdab00-ba8b-493e-92d8-5c01ded1360e. (HTTP 404) (Request-ID: req-c88e64e9-7b2e-4993-8562-1b81dbab6aac)
May 28 14:16:50.439307 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Took 0.02 seconds to detach 1 volumes for instance.
May 28 14:16:50.910359 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Took 1.54 seconds to deallocate network for instance.
May 28 14:16:50.945284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:50.945424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:51.150102 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:16:51.150309 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:16:51.416433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:51.652821 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:16:52.159095 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.213s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:52.160583 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.744s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:52.209934 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Deleted allocations for instance e17be93d-817c-4da2-8867-bc483843b6a6
May 28 14:16:52.342076 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:16:52.342267 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:16:52.844675 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:16:53.217894 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-267a5683-e47a-4214-a329-1d9d6f20681f tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Lock "e17be93d-817c-4da2-8867-bc483843b6a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.107s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:53.352899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.192s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:53.404867 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Deleted allocations for instance 315479ab-df1d-4a37-8483-12526e101ef7
May 28 14:16:53.741192 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:53.741330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:53.856062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:54.246169 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'flavor' on Instance uuid d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:54.415552 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-48d4a494-23ac-4b1a-b879-189fb78228a2 tempest-VolumesExtendAttachedTest-2074693502 tempest-VolumesExtendAttachedTest-2074693502-project-member] Lock "315479ab-df1d-4a37-8483-12526e101ef7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.916s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:54.772656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:55.251200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:55.897186 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:55.897367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:55.897517 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:55.902299 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98269) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 14:16:55.902687 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'flavor' on Instance uuid d004d34f-24bd-44de-ac98-1500665bbe5e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:56.312406 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:56.312821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:56.312821 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Attaching volume 8e23b3e0-0c0c-4bb0-89f1-81822f101874 to /dev/vdb
May 28 14:16:56.349792 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:56.359744 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:16:56.379635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:16:56.424382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:16:56.424629 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:16:56.434389 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:16:56.435543 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fe14:3d3e', 'fe80::8097:21ff:fe89:3b01', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:16:56.435669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:16:56.435793 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:16:56.436067 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:16:56.436338 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updating existing volume attachment record: ae257cae-bc18-4c94-b2b6-9435e068530d {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:16:56.991208 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:16:56.993428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:16:56.993428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:56.993428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:56.993428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:16:57.007671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:57.008482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:16:57.009534 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:57.009534 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:57.009782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:16:57.009940 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:57.010510 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:57.012649 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:57.015365 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:57.025031 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:57.025031 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:57.031424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:16:57.031424 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:57.036911 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:57.043620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874] added
May 28 14:16:57.043620 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:57.043620 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:57.043620 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:57.043620 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:57.043620 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:57.043620 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:57.043803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:57.044082 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:57.044413 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:57.045401 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874] added
May 28 14:16:57.045401 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:16:57.045401 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:57.045401 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:57.045401 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:16:57.045401 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:16:57.045401 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:57.046132 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:16:57.046132 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:16:57.046132 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:16:57.061683 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:57.175412 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-68e8a6a1-8fa9-418e-862f-543ba99f0a10 req-88e84e18-b2f5-4299-835c-baf176130881 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received event network-vif-unplugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:57.175412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68e8a6a1-8fa9-418e-862f-543ba99f0a10 req-88e84e18-b2f5-4299-835c-baf176130881 service nova] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:57.175412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68e8a6a1-8fa9-418e-862f-543ba99f0a10 req-88e84e18-b2f5-4299-835c-baf176130881 service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:57.175412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-68e8a6a1-8fa9-418e-862f-543ba99f0a10 req-88e84e18-b2f5-4299-835c-baf176130881 service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:57.175412 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-68e8a6a1-8fa9-418e-862f-543ba99f0a10 req-88e84e18-b2f5-4299-835c-baf176130881 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] No waiting events found dispatching network-vif-unplugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:57.175412 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-68e8a6a1-8fa9-418e-862f-543ba99f0a10 req-88e84e18-b2f5-4299-835c-baf176130881 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received unexpected event network-vif-unplugged-56c966c2-cf64-4255-aa13-82847ace6c7a for instance with vm_state active and task_state powering-off.
May 28 14:16:57.251490 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99960700299971 future=<Future at 0x71a75c1d4230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:16:57.254859 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Instance destroyed successfully.
May 28 14:16:57.256028 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'numa_topology' on Instance uuid d004d34f-24bd-44de-ac98-1500665bbe5e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:16:57.759185 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Object Instance<d004d34f-24bd-44de-ac98-1500665bbe5e> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:16:57.759751 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:16:58.045608 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:16:58.046526 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:58.059611 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:58.059611 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:16:58.068750 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:16:58.068750 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.077483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.086403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.093294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.093294 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.093294 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.093294 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:58.093563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.093563 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.093563 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.093563 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:58.101236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.101236 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.101236 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.101236 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:58.101236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.101236 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.101236 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.101236 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:58.127966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.40.100,3260]
May 28 14:16:58.127966 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.40.100,3260] successful.
May 28 14:16:58.127966 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.141300 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.147097 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.50.100,3260]
May 28 14:16:58.147097 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.50.100,3260] successful.
May 28 14:16:58.147097 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.155552 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.155552 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.155552 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.155552 np0000001643 nova-compute[98269]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.155552 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.155552 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:58.155837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.155837 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.155837 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.155837 np0000001643 nova-compute[98269]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.155837 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.155837 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:58.156025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:58.156141 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:58.156913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] HCTL ('8', '-', '-', 0) found on session 155 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:58.157042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:58.158806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:16:58.171850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching for a device in session 155 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:58.171850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:58.175816 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.175816 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.175816 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.175816 np0000001643 nova-compute[98269]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.175816 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.175816 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:16:58.176036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.176036 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:16:58.176036 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:16:58.176036 np0000001643 nova-compute[98269]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.176036 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:16:58.176036 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:16:58.176385 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:16:58.176632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:16:58.177296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] HCTL ('11', '-', '-', 0) found on session 156 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:16:58.177440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:16:58.191763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching for a device in session 156 and hctl ['11', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:58.268539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-94dd498f-6113-49c0-9841-8749531162ff tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.371s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:58.858587 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:16:59.192964 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching for a device in session 156 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:16:59.193211 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:16:59.241954 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a106ace9-36da-4226-8ed3-9398a91c3eb6 req-873f7909-8d4a-495a-b5e2-80a41b12c3e1 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received event network-vif-unplugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:16:59.242277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a106ace9-36da-4226-8ed3-9398a91c3eb6 req-873f7909-8d4a-495a-b5e2-80a41b12c3e1 service nova] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:16:59.242277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a106ace9-36da-4226-8ed3-9398a91c3eb6 req-873f7909-8d4a-495a-b5e2-80a41b12c3e1 service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:16:59.242392 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a106ace9-36da-4226-8ed3-9398a91c3eb6 req-873f7909-8d4a-495a-b5e2-80a41b12c3e1 service nova] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:16:59.243312 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a106ace9-36da-4226-8ed3-9398a91c3eb6 req-873f7909-8d4a-495a-b5e2-80a41b12c3e1 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] No waiting events found dispatching network-vif-unplugged-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:16:59.243312 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a106ace9-36da-4226-8ed3-9398a91c3eb6 req-873f7909-8d4a-495a-b5e2-80a41b12c3e1 service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received unexpected event network-vif-unplugged-56c966c2-cf64-4255-aa13-82847ace6c7a for instance with vm_state stopped and task_state None.
May 28 14:16:59.251596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:00.026790 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Found WWN 3300000002b96a61a for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:17:00.027091 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:00.027273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000002b96a61a', 'path': '/dev/dm-0', 'multipath_id': '3300000002b96a61a'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:17:00.027438 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002b96a61a', 'path': '/dev/dm-0', 'multipath_id': '3300000002b96a61a'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:17:00.030116 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'flavor' on Instance uuid d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:00.533214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Attempting to attach volume 8e23b3e0-0c0c-4bb0-89f1-81822f101874 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:17:00.534704 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:17:00.534704 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:17:00.534704 np0000001643 nova-compute[98269]:   <alias name="ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874"/>
May 28 14:17:00.534704 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:17:00.534704 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:17:00.534704 np0000001643 nova-compute[98269]:   <serial>8e23b3e0-0c0c-4bb0-89f1-81822f101874</serial>
May 28 14:17:00.534704 np0000001643 nova-compute[98269]: </disk>
May 28 14:17:00.534704 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:17:01.967024 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:01.967607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:01.967607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:01.967607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:01.967850 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:01.971252 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Terminating instance
May 28 14:17:02.193217 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:02.193417 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:02.193478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:02.193641 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No VIF found with MAC fa:16:3e:c0:9e:aa, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:17:02.475253 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:17:02.479496 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Instance destroyed successfully.
May 28 14:17:02.479897 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid d004d34f-24bd-44de-ac98-1500665bbe5e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:02.957895 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0006412699999600591 future=<Future at 0x71a75c17e720 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:02.958392 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] Emitting event <LifecycleEvent: 1779977807.9570854, e17be93d-817c-4da2-8867-bc483843b6a6 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:02.958564 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:02.958742 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] VM Stopped (Lifecycle Event)
May 28 14:17:02.959817 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.38259079899989956 future=<Future at 0x71a7781d89e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:02.959995 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.3823873719998119 future=<Future at 0x71a7781d89e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:02.982582 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1361233749',display_name='tempest-TestVolumeBootPattern-server-1361233749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1361233749',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBFCdao0wVABAopvi9ez4NFFUXw1yrlBU4tNdd5z1ZMnrTqXTeoUjykzTeSu5Jz0KVuBF3ULJsp7TFau2Q/G+Dg5OnwuiGtlYuuIi+G3nr55XMUEDEbN5hB7JcYP7b4yw==',key_name='tempest-keypair-1997457095',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:16:13Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-oqe8e9l5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=d004d34f-24bd-44de-ac98-1500665bbe5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:17:02.983133 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "56c966c2-cf64-4255-aa13-82847ace6c7a", "address": "fa:16:3e:14:3d:3e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c966c2-cf", "ovs_interfaceid": "56c966c2-cf64-4255-aa13-82847ace6c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:02.983643 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:3d:3e,bridge_name='br-int',has_traffic_filtering=True,id=56c966c2-cf64-4255-aa13-82847ace6c7a,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c966c2-cf') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:02.984141 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:3d:3e,bridge_name='br-int',has_traffic_filtering=True,id=56c966c2-cf64-4255-aa13-82847ace6c7a,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c966c2-cf') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:17:02.986111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:02.986349 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56c966c2-cf, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:02.987278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:02.988323 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:02.991299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:02.991299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:02.991299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcf56a6b-9971-4bde-ac5d-9cb6d7874a3e) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:02.992591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:02.993217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:02.996373 np0000001643 nova-compute[98269]: INFO os_vif [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:3d:3e,bridge_name='br-int',has_traffic_filtering=True,id=56c966c2-cf64-4255-aa13-82847ace6c7a,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c966c2-cf')
May 28 14:17:02.997976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:17:02.998370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:17:02.998576 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:02.998967 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:02.999382 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '582dc770-0f28-43bd-acc4-712f6c4cfc50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:17:02.999588 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:17:03.028960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:17:03.028960 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:17:03.028960 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:17:03.028960 np0000001643 nova-compute[98269]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:03.028960 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:03.028960 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:03.029147 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:17:03.029147 np0000001643 nova-compute[98269]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50 (non-flash)
May 28 14:17:03.029147 np0000001643 nova-compute[98269]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4 (non-flash)
May 28 14:17:03.029147 np0000001643 nova-compute[98269]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:03.029147 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:03.029147 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:03.029380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1619a48-2cd0-42be-8b06-c65a545606e4', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', '156')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:17:03.029572 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '148')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:17:03.030659 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50', '149')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:17:03.034746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a77811f740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:17:03.034978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:17:03.035277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 3300000007e0aa9ef {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:17:03.095306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:17:03.134962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:17:03.186747 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:17:03.186950 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:17:03.187952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:17:03.204535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:17:03.204909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:17:03.224077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:03.256536 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:03.269006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.40.100,3260]
May 28 14:17:03.269006 np0000001643 nova-compute[98269]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.40.100,3260] successful.
May 28 14:17:03.269006 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:03.289914 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:03.301928 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:03.336496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.50.100,3260]
May 28 14:17:03.336496 np0000001643 nova-compute[98269]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-582dc770-0f28-43bd-acc4-712f6c4cfc50, portal: 192.168.50.100,3260] successful.
May 28 14:17:03.336496 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:03.344066 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.001411579000432539 future=<Future at 0x71a7781d89e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:03.344066 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:03.344066 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.906548542999644 future=<Future at 0x71a75c1d4230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:03.344285 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.90642293999963 future=<Future at 0x71a75c1d4230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:03.345581 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] Emitting event <LifecycleEvent: 1779977808.3423166, 315479ab-df1d-4a37-8483-12526e101ef7 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:03.345581 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] VM Stopped (Lifecycle Event)
May 28 14:17:03.351505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:03.351505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:03.351505 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (352ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:17:03.351505 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:17:03.351505 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Deleting instance files /opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e_del
May 28 14:17:03.352628 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Deletion of /opt/stack/data/nova/instances/d004d34f-24bd-44de-ac98-1500665bbe5e_del complete
May 28 14:17:03.461313 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4be1522a-e4b0-4c31-b96d-cd64bea23b06 tempest-TestInstancesWithCinderVolumes-1781797632 tempest-TestInstancesWithCinderVolumes-1781797632-project-member] [instance: e17be93d-817c-4da2-8867-bc483843b6a6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:03.768712 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3355479e-6569-4c36-8216-b829f38b408b tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.456s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:03.850039 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c0f28aa8-b1cd-4255-9913-35536a889baf tempest-VolumesSnapshotTestJSON-33088366 tempest-VolumesSnapshotTestJSON-33088366-project-member] [instance: 315479ab-df1d-4a37-8483-12526e101ef7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:03.858231 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 14:17:03.858643 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:17:03.858989 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:17:03.859111 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:17:03.859354 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:03.954522 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:04.452765 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-908ad1ea-32f1-4ace-afa7-c01f5769f87f req-dcf07059-ae5e-4943-92c5-6d7643e020ef service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Received event network-vif-deleted-56c966c2-cf64-4255-aa13-82847ace6c7a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:04.453140 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-908ad1ea-32f1-4ace-afa7-c01f5769f87f req-dcf07059-ae5e-4943-92c5-6d7643e020ef service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Neutron deleted interface 56c966c2-cf64-4255-aa13-82847ace6c7a; detaching it from the instance and deleting it from the info cache
May 28 14:17:04.454540 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-908ad1ea-32f1-4ace-afa7-c01f5769f87f req-dcf07059-ae5e-4943-92c5-6d7643e020ef service nova] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Detach interface failed, port_id=56c966c2-cf64-4255-aa13-82847ace6c7a, reason: Instance d004d34f-24bd-44de-ac98-1500665bbe5e could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:17:04.781360 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:04.903614 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:05.405871 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Took 1.55 seconds to deallocate network for instance.
May 28 14:17:05.570333 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:05.955167 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:17:06.460710 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:06.460936 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:06.612137 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:17:06.612500 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:17:07.114938 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:17:07.621290 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.160s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:07.669732 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance d004d34f-24bd-44de-ac98-1500665bbe5e
May 28 14:17:07.768518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:07.768696 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:07.961370 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:07.991734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:08.270737 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Detaching volume 8e23b3e0-0c0c-4bb0-89f1-81822f101874
May 28 14:17:08.307618 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Attempting to driver detach volume 8e23b3e0-0c0c-4bb0-89f1-81822f101874 from mountpoint /dev/vdb
May 28 14:17:08.313290 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Found disk vdb by alias ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:17:08.314786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Found disk vdb by alias ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:17:08.314786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Attempting to detach device vdb from instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:17:08.314786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:17:08.314786 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:17:08.314786 np0000001643 nova-compute[98269]:   <alias name="ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874"/>
May 28 14:17:08.314786 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:17:08.314786 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:17:08.314786 np0000001643 nova-compute[98269]:   <serial>8e23b3e0-0c0c-4bb0-89f1-81822f101874</serial>
May 28 14:17:08.314786 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:17:08.314786 np0000001643 nova-compute[98269]: </disk>
May 28 14:17:08.314786 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:17:08.323067 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully detached device vdb from instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 from the persistent domain config.
May 28 14:17:08.323537 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] (1/8): Attempting to detach device vdb with device alias ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874 from instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:17:08.323537 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:17:08.323537 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:17:08.323537 np0000001643 nova-compute[98269]:   <alias name="ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874"/>
May 28 14:17:08.323537 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:17:08.323537 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:17:08.323537 np0000001643 nova-compute[98269]:   <serial>8e23b3e0-0c0c-4bb0-89f1-81822f101874</serial>
May 28 14:17:08.323537 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:17:08.323537 np0000001643 nova-compute[98269]: </disk>
May 28 14:17:08.323537 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:17:08.677776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-2397e442-803e-4cf5-831f-2457866c50be tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d004d34f-24bd-44de-ac98-1500665bbe5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.711s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:08.887955 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977828.8876383, d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 => ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:17:08.889123 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8e23b3e0-0c0c-4bb0-89f1-81822f101874 for instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:17:08.891681 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully detached device vdb from instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 from the live domain config.
May 28 14:17:08.892822 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:17:08.893530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:17:08.893530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:08.893530 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:08.893759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e23b3e0-0c0c-4bb0-89f1-81822f101874', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:17:08.893869 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:17:08.919096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:08.919096 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:08.919096 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:08.919287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:08.919287 np0000001643 nova-compute[98269]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874 (non-flash)
May 28 14:17:08.919287 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:08.919502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', '156')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:17:08.919699 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', '155')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:17:08.920699 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874', '156')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:17:08.921513 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801cc860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:17:08.921707 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Removing multipathed devices sdf, sdc {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:17:08.921908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Flush multipath device 3300000002b96a61a {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:17:08.947799 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:17:08.993983 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:17:09.052123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:17:09.052309 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:17:09.052980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:17:09.065239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:17:09.065514 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:17:09.076089 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:09.105122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.40.100,3260]
May 28 14:17:09.105122 np0000001643 nova-compute[98269]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.40.100,3260] successful.
May 28 14:17:09.105122 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:09.116525 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:09.129047 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:09.152982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.50.100,3260]
May 28 14:17:09.152982 np0000001643 nova-compute[98269]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-8e23b3e0-0c0c-4bb0-89f1-81822f101874, portal: 192.168.50.100,3260] successful.
May 28 14:17:09.152982 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:09.163122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:09.163357 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:09.163531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] <== disconnect_volume: return (269ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:17:09.163655 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:17:09.472627 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:09.707370 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'flavor' on Instance uuid d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:09.783351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:10.058747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:10.713311 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d90a8a0-7a58-4f95-a75a-836ce3a93426 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.944s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:12.251547 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0009238900001946604 future=<Future at 0x71a75c1d4230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:12.251897 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:17:12.254959 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Emitting event <LifecycleEvent: 1779977817.2505078, d004d34f-24bd-44de-ac98-1500665bbe5e => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:12.255127 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] VM Stopped (Lifecycle Event)
May 28 14:17:12.657482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:12.657914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:12.757411 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d004d34f-24bd-44de-ac98-1500665bbe5e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:12.993392 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:13.159884 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:17:13.210987 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:13.638711 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:13.704471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:13.704661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:13.707458 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:17:13.707609 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Claim successful on node np0000001643
May 28 14:17:13.717953 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] instance snapshotting
May 28 14:17:13.815365 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Beginning live snapshot process
May 28 14:17:14.136787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:14.136787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:14.638159 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:17:14.783087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:14.914600 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:17:14.914801 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:17:15.188790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:15.329006 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:15.418841 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:17:15.429568 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json -f qcow2" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:15.429790 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:15.431330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json -f qcow2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:15.541943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json -f qcow2" returned: 0 in 0.111s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:15.542891 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:15.547655 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:15.548246 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:15.646808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:15.647329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp55ox_1vq/663471f8126149a6aaeb7bd59165d93f.delta 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:15.708466 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp55ox_1vq/663471f8126149a6aaeb7bd59165d93f.delta 1073741824" returned: 0 in 0.061s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:15.709043 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 14:17:15.927119 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.222s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:15.927806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.739s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:15.928011 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:17:15.935696 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:17:15.935696 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Claim successful on node np0000001643
May 28 14:17:15.939523 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 14:17:16.434626 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:17:16.434846 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:17:16.435254 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:16.435573 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:16.445926 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 14:17:16.448063 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 14:17:16.494281 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:17:16.494746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp55ox_1vq/663471f8126149a6aaeb7bd59165d93f.delta /opt/stack/data/nova/instances/snapshots/tmp55ox_1vq/663471f8126149a6aaeb7bd59165d93f {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:16.525052 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8481a6da3424bd79d4706a19f2de577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19477b13dbf4580a9341cfc05b6b7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:17:16.765157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp55ox_1vq/663471f8126149a6aaeb7bd59165d93f.delta /opt/stack/data/nova/instances/snapshots/tmp55ox_1vq/663471f8126149a6aaeb7bd59165d93f" returned: 0 in 0.270s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:16.770633 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Snapshot extracted, beginning image upload
May 28 14:17:16.938554 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:17:16.959296 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Successfully created port: 95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:17:17.153700 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:17:17.153989 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:17:17.446330 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:17:17.659180 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:17:17.666535 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Successfully updated port: 95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:17:17.725941 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:17.727909 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing instance network info cache due to event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:17.728103 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] Acquiring lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:17.728192 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] Acquired lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:17.728275 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:17.995879 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:18.125376 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:18.173244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.246s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:18.173598 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:17:18.176647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:18.231397 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:18.297168 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:18.456191 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:17:18.457047 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:17:18.457288 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Creating image(s)
May 28 14:17:18.457720 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:18.457864 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:18.458338 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:18.459796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "00f78cdb42496de144d1d7cd89500a3b262f5d5e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:18.461310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "00f78cdb42496de144d1d7cd89500a3b262f5d5e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:18.478620 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:18.681109 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:17:18.681296 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:17:18.681565 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:18.681782 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:18.756647 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:17:18.986261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8ff701da-50f6-421d-92aa-9852b38ae672 req-ae587066-495a-4db9-9e0d-692cd67d01d3 service nova] Releasing lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:18.990464 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquired lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:18.990464 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:17:19.074031 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:19.077520 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:19.077904 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.182410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.part --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.182930 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] 9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610 was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:17:19.184731 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:17:19.189298 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:17:19.190591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.part /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.382737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.part /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.converted" returned: 0 in 0.192s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.390064 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.494368 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e.converted --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.496482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "00f78cdb42496de144d1d7cd89500a3b262f5d5e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.034s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:19.496482 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:19.502813 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Snapshot image upload complete
May 28 14:17:19.505459 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6f702ee1-ecd0-4f6f-88ac-f40c094ccd87 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Took 5.79 seconds to snapshot the instance on the hypervisor.
May 28 14:17:19.509063 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:19.511056 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.608172 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:19.613262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.613262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "00f78cdb42496de144d1d7cd89500a3b262f5d5e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:19.613262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "00f78cdb42496de144d1d7cd89500a3b262f5d5e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:19.613519 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:19.616640 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:19.616640 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.666530 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Successfully created port: a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:17:19.708470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:17:19.719919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.720432 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e,backing_fmt=raw /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.781889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e,backing_fmt=raw /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk 1073741824" returned: 0 in 0.061s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.782383 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "00f78cdb42496de144d1d7cd89500a3b262f5d5e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:19.783021 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.809118 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:19.871540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.872055 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:17:19.872989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:19.894789 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:19.977234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:19.978299 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Cannot resize image /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:17:19.978643 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:17:19.978831 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Ensure instance console log exists: /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:17:19.979144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:19.979345 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:19.979583 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:20.073989 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:20.212330 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Successfully updated port: a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:17:20.216928 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Booting with volume 15353554-31b4-4331-80bb-ec6b3261863d at /dev/vda
May 28 14:17:20.289293 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:17:20.304440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:17:20.338459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:20.367762 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:20.402347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:17:20.402772 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:17:20.413916 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:17:20.417040 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:17:20.417198 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:17:20.417333 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:17:20.417610 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:17:20.417843 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Updating existing volume attachment record: 12b9042e-b183-481c-a1b1-01cd3f6a20c2 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:17:20.433148 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-changed-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:20.434967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Refreshing instance network info cache due to event network-changed-a6538970-472a-467f-81d8-972e8c784834. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:20.435178 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] Acquiring lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:20.435276 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] Acquired lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:20.435428 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Refreshing network info cache for port a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:20.577259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Releasing lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:20.577758 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance network_info: |[{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:17:20.580588 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Start _get_guest_xml network_info=[{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T14:17:10Z,direct_url=<?>,disk_format='qcow2',id=9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610,min_disk=0,min_ram=0,name='tempest-scenario-img--1205353880',owner='d19477b13dbf4580a9341cfc05b6b7e1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T14:17:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': '9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:17:20.585618 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:17:20.587965 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-859358347', uuid='db49aa69-cf97-4002-a027-262f598da41b'), owner=OwnerMeta(userid='c8481a6da3424bd79d4706a19f2de577', username='tempest-TestMinimumBasicScenario-1492567984-project-member', projectid='d19477b13dbf4580a9341cfc05b6b7e1', projectname='tempest-TestMinimumBasicScenario-1492567984'), image=ImageMeta(id='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977840.5865495) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:17:20.589716 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:17:20.589859 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:17:20.591174 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:17:20.591287 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:17:20.592238 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:17:20.592701 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T14:17:10Z,direct_url=<?>,disk_format='qcow2',id=9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610,min_disk=0,min_ram=0,name='tempest-scenario-img--1205353880',owner='d19477b13dbf4580a9341cfc05b6b7e1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T14:17:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:17:20.593213 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:17:20.593213 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:17:20.593213 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:17:20.593371 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:17:20.593464 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:17:20.593659 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:17:20.593780 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:17:20.593945 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:17:20.594130 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:17:20.594433 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:17:20.609469 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-859358347',display_name='tempest-TestMinimumBasicScenario-server-859358347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-859358347',id=61,image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQYP+V8aFByge7xp6cgO0POP+ecYlEeU6kAzd/PQCST0aF5OYTjbftUVxGTVTseCuc472pkiq4aQdIP5tmMv/GKtKfmNByGUfz8XuImX+jBpT4GF4lH1DDR7J470N+wA==',key_name='tempest-TestMinimumBasicScenario-1748400774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-yfonxw7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:17Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=db49aa69-cf97-4002-a027-262f598da41b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:17:20.609469 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:20.611053 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:20.611758 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'pci_devices' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:20.714562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:20.939036 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:21.002091 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:21.115696 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] End _get_guest_xml xml=<domain type="qemu">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <uuid>db49aa69-cf97-4002-a027-262f598da41b</uuid>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <name>instance-0000003d</name>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestMinimumBasicScenario-server-859358347</nova:name>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:17:20</nova:creationTime>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:image uuid="9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:properties/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:user uuid="c8481a6da3424bd79d4706a19f2de577">tempest-TestMinimumBasicScenario-1492567984-project-member</nova:user>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:project uuid="d19477b13dbf4580a9341cfc05b6b7e1">tempest-TestMinimumBasicScenario-1492567984</nova:project>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         <nova:port uuid="95672d9b-6717-4879-bdbe-58e4d4af4a41">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <system>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <entry name="serial">db49aa69-cf97-4002-a027-262f598da41b</entry>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <entry name="uuid">db49aa69-cf97-4002-a027-262f598da41b</entry>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </system>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <os>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   </os>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <features>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   </features>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   <devices>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.config"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:37:2c:ff"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <target dev="tap95672d9b-67"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </interface>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/console.log" append="off"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </serial>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <video>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </video>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </rng>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:   </devices>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]: </domain>
May 28 14:17:21.115696 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:17:21.118348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Preparing to wait for external event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:17:21.118348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:21.118348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:21.118348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:21.118348 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-859358347',display_name='tempest-TestMinimumBasicScenario-server-859358347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-859358347',id=61,image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQYP+V8aFByge7xp6cgO0POP+ecYlEeU6kAzd/PQCST0aF5OYTjbftUVxGTVTseCuc472pkiq4aQdIP5tmMv/GKtKfmNByGUfz8XuImX+jBpT4GF4lH1DDR7J470N+wA==',key_name='tempest-TestMinimumBasicScenario-1748400774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-yfonxw7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:17Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=db49aa69-cf97-4002-a027-262f598da41b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:17:21.118833 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:21.119435 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:21.119794 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:17:21.120927 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:21.121210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:21.121435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:17:21.122044 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:21.122237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '708646a2-9917-53ca-93c4-a1611686e030', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:21.124015 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:21.124015 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:21.127773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:21.128019 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95672d9b-67, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:21.128411 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95672d9b-67, col_values=(('qos', UUID('ed5cf0ed-81d9-4756-92fb-f673262c3d4b')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:21.128899 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95672d9b-67, col_values=(('external_ids', {'iface-id': '95672d9b-6717-4879-bdbe-58e4d4af4a41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:2c:ff', 'vm-uuid': 'db49aa69-cf97-4002-a027-262f598da41b'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:21.130734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:21.132125 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:21.137543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:21.138919 np0000001643 nova-compute[98269]: INFO os_vif [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67')
May 28 14:17:21.151153 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:21.175126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:21.175275 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:21.654261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a249b6ab-eb33-4c1d-8c66-4959f9c606b5 req-63a4dc45-7521-4e86-9829-77c0270d9b63 service nova] Releasing lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:21.654925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:21.655275 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:17:21.677414 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:17:22.227210 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:22.234463 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:22.234723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:22.238275 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:17:22.238429 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Claim successful on node np0000001643
May 28 14:17:22.381322 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:22.522309 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Updating instance_info_cache with network_info: [{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:22.524747 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:17:22.525818 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:17:22.526057 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Creating image(s)
May 28 14:17:22.526319 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:17:22.526427 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Ensure instance console log exists: /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:17:22.526656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:22.526821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:22.526973 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:22.658832 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:22.659163 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:22.659163 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No VIF found with MAC fa:16:3e:37:2c:ff, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:17:22.659537 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Using config drive
May 28 14:17:23.024241 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:23.024680 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance network_info: |[{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:17:23.025399 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Start _get_guest_xml network_info=[{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '12b9042e-b183-481c-a1b1-01cd3f6a20c2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3a509dcf-af9c-4813-90a7-724d0adde626', 'attached_at': '', 'detached_at': '', 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'serial': '15353554-31b4-4331-80bb-ec6b3261863d'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:17:23.027585 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:17:23.028491 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2117625348', uuid='3a509dcf-af9c-4813-90a7-724d0adde626'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977843.0282283) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:17:23.029573 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:17:23.029885 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:17:23.030774 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:17:23.030925 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:17:23.031557 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:17:23.031784 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:17:23.031910 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:17:23.031997 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:17:23.032130 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:17:23.032240 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:17:23.032324 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:17:23.032468 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:17:23.032578 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:17:23.032672 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:17:23.032762 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:17:23.032876 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:17:23.042953 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:17:23.043214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:17:23.043322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:23.043648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:23.043807 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:17:23.055314 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:23.055992 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:23.056420 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:23.056687 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:17:23.057188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:23.057420 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:17:23.067901 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:17:23.067901 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:23.072678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:17:23.072678 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:23.079481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d] added
May 28 14:17:23.079481 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:17:23.079481 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:23.079481 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:23.079481 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:23.079481 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:23.079481 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:23.079745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:17:23.079827 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:17:23.079966 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:17:23.085244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d] added
May 28 14:17:23.085244 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:17:23.085244 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:23.085244 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:23.085244 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:23.085244 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:23.085244 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:23.085519 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:17:23.085519 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:17:23.085651 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:17:23.164346 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:23.222366 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:23.222558 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:23.266112 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Creating config drive at /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.config
May 28 14:17:23.269065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpig9g12d2 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:23.318773 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpig9g12d2" returned: 0 in 0.049s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:23.485801 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:17:23.486019 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:17:23.684641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:23.705740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:23.706395 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:23.724408 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:17:23.788342 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:23.989227 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:17:24.001475 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:24.003170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:24.005725 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:24.006594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:24.025644 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:24.080569 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:17:24.086225 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:17:24.093907 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:17:24.093907 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:17:24.100531 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:17:24.100531 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:24.106395 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:24.113636 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:24.121837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:17:24.121837 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:24.121837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:17:24.121837 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:24.121837 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:17:24.121837 np0000001643 nova-compute[98269]: 
May 28 14:17:24.126712 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:17:24.126712 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:24.126875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:17:24.126875 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:24.126993 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:17:24.126993 np0000001643 nova-compute[98269]: 
May 28 14:17:24.143468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260]
May 28 14:17:24.143468 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260] successful.
May 28 14:17:24.143468 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:24.155614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:24.166124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:24.166124 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:24.166363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:24.166363 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:24.166791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:24.167094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:17:24.167731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('7', '-', '-', 0) found on session 158 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:17:24.167731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:17:24.181225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 158 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:17:24.181225 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:17:24.277419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:24.384883 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977844.3844013, db49aa69-cf97-4002-a027-262f598da41b => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:24.385384 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] VM Started (Lifecycle Event)
May 28 14:17:24.496471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.262s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:24.497525 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.220s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:24.497919 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:17:24.502722 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:17:24.502921 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Claim successful on node np0000001643
May 28 14:17:24.786773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:24.887728 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:24.889520 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977844.8893244, db49aa69-cf97-4002-a027-262f598da41b => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:24.889640 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] VM Paused (Lifecycle Event)
May 28 14:17:25.004208 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:17:25.004387 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:17:25.004643 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:25.004881 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:25.066613 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c98b8f4e148b4557bd70bd6a755850a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c345e5241bd40c693ea2c6ccaf6c8f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:17:25.158793 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260]
May 28 14:17:25.158793 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260] successful.
May 28 14:17:25.158793 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:25.170310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:25.182078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:25.182078 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:25.182078 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:25.182209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:25.182209 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:25.182209 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:25.182467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.125s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:25.182602 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:17:25.183038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('8', '-', '-', 0) found on session 159 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:17:25.183167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:17:25.196835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 159 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:17:25.196835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:17:25.391741 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:25.393251 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:25.496304 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Successfully created port: 2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:17:25.506977 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:17:25.796881 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:17:25.797279 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:17:25.895813 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:17:25.981191 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Successfully updated port: 2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:17:26.010394 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:17:26.031605 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-changed-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:26.031605 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Refreshing instance network info cache due to event network-changed-2d3a9b73-2098-4eb5-b25e-16dea720a0a0. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:26.031771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] Acquiring lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:26.031876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] Acquired lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:26.031983 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Refreshing network info cache for port 2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:26.083661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:17:26.132247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:26.299653 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:17:26.370292 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f8659a85-f311-4281-8f55-63fda74d1634 req-d5f5de1d-280b-472b-94c6-770d9d5ab04f service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:26.370661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f8659a85-f311-4281-8f55-63fda74d1634 req-d5f5de1d-280b-472b-94c6-770d9d5ab04f service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:26.370863 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f8659a85-f311-4281-8f55-63fda74d1634 req-d5f5de1d-280b-472b-94c6-770d9d5ab04f service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:26.370989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f8659a85-f311-4281-8f55-63fda74d1634 req-d5f5de1d-280b-472b-94c6-770d9d5ab04f service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:26.371170 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f8659a85-f311-4281-8f55-63fda74d1634 req-d5f5de1d-280b-472b-94c6-770d9d5ab04f service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Processing event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:17:26.371521 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:17:26.374229 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977846.3739262, db49aa69-cf97-4002-a027-262f598da41b => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:26.374385 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] VM Resumed (Lifecycle Event)
May 28 14:17:26.375441 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:17:26.379125 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance spawned successfully.
May 28 14:17:26.380077 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:17:26.482919 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:26.536304 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:26.598618 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:26.725532 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:26.807641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.311s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:26.808157 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:17:26.876815 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:26.878962 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:26.888613 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:26.888743 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:26.889080 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:26.889315 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:26.889596 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:26.889851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:27.018059 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:17:27.019062 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:17:27.019317 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Creating image(s)
May 28 14:17:27.019823 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:27.019971 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "/opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:27.020428 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "/opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:27.020776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "4fe9ab5b777fa77daa200d14e0ad30a3b2716573" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:27.021106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "4fe9ab5b777fa77daa200d14e0ad30a3b2716573" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:27.110413 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799170 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:17:27.110804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.067s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:27.111002 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (4067ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799170', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799170'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:17:27.111129 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799170', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799170'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:17:27.228802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38298177-9fe9-4d1c-9a81-9d084036bd94 req-fa7ae976-5355-4189-83bd-a6a102fe6d97 service nova] Releasing lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:27.228802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquired lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:27.228802 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:17:27.315576 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:17:27.316855 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:17:27.316855 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:27.316855 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:27.381293 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:17:27.394190 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Took 8.94 seconds to spawn the instance on the hypervisor.
May 28 14:17:27.395876 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:27.426142 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '039853f7e499423384aa13ada9b39d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ea6d8cf0d14c40ad9163f647b3d065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:17:27.622738 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2117625348',display_name='tempest-TestVolumeBootPattern-server-2117625348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2117625348',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOjnzKUnyd/+Jimau6uho+Mhj5qnJcDVSZD+VdO17tyeQeGBW/tRrN8+iVw62lQBPCn1EhDrRVmWtT/3rEwZLFowJ2xsZl5CyMTUDuGxK8yMSDMGQINvjUhK81UdqgZkA==',key_name='tempest-keypair-1558069538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-dpbf0jq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=3a509dcf-af9c-4813-90a7-724d0adde626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:17:27.623057 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:27.623545 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:27.624155 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:27.766719 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:27.770056 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:27.770632 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:27.800862 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:27.819109 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:17:27.862279 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.part --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:27.862656 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] 8b63918a-712c-412b-a148-1d958d5bc11b was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:17:27.863224 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:17:27.863503 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.part /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:27.893082 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Successfully created port: 558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:17:27.911384 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Took 14.25 seconds to build instance.
May 28 14:17:28.011320 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:28.018555 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.part /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.converted" returned: 0 in 0.155s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:28.037954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:28.130095 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] End _get_guest_xml xml=<domain type="qemu">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <uuid>3a509dcf-af9c-4813-90a7-724d0adde626</uuid>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <name>instance-0000003e</name>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-2117625348</nova:name>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:17:23</nova:creationTime>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         <nova:port uuid="a6538970-472a-467f-81d8-972e8c784834">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <system>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <entry name="serial">3a509dcf-af9c-4813-90a7-724d0adde626</entry>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <entry name="uuid">3a509dcf-af9c-4813-90a7-724d0adde626</entry>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </system>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <os>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   </os>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <features>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   </features>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   <devices>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.config"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <alias name="ua-15353554-31b4-4331-80bb-ec6b3261863d"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <serial>15353554-31b4-4331-80bb-ec6b3261863d</serial>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:99:10:1d"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <target dev="tapa6538970-47"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </interface>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/console.log" append="off"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </serial>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <video>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </video>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </rng>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:   </devices>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]: </domain>
May 28 14:17:28.130095 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:17:28.133171 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Preparing to wait for external event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:17:28.134647 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:28.134913 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:28.135110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:28.136517 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2117625348',display_name='tempest-TestVolumeBootPattern-server-2117625348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2117625348',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOjnzKUnyd/+Jimau6uho+Mhj5qnJcDVSZD+VdO17tyeQeGBW/tRrN8+iVw62lQBPCn1EhDrRVmWtT/3rEwZLFowJ2xsZl5CyMTUDuGxK8yMSDMGQINvjUhK81UdqgZkA==',key_name='tempest-keypair-1558069538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-dpbf0jq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=3a509dcf-af9c-4813-90a7-724d0adde626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:17:28.136724 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:28.137660 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:28.137989 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:17:28.138640 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:28.139136 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573.converted --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:28.139248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:28.139664 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:17:28.140870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "4fe9ab5b777fa77daa200d14e0ad30a3b2716573" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.120s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:28.141086 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:28.141300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd75b1ac8-11b2-5349-a160-0035f44efe69', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:28.142129 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:28.145337 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:28.159730 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:28.160617 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:28.161959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:28.173117 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:28.177470 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:28.177804 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6538970-47, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:28.178747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6538970-47, col_values=(('qos', UUID('b9ba540b-2df7-4330-ae9b-fe82510cc9e9')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:28.178963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6538970-47, col_values=(('external_ids', {'iface-id': 'a6538970-472a-467f-81d8-972e8c784834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:10:1d', 'vm-uuid': '3a509dcf-af9c-4813-90a7-724d0adde626'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:28.182111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:28.182111 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:28.187159 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:28.192930 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updating instance_info_cache with network_info: [{"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:28.196138 np0000001643 nova-compute[98269]: INFO os_vif [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47')
May 28 14:17:28.268688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573 --force-share --output=json" returned: 0 in 0.107s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:28.269185 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "4fe9ab5b777fa77daa200d14e0ad30a3b2716573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:28.269698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "4fe9ab5b777fa77daa200d14e0ad30a3b2716573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:28.270154 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:28.272950 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:28.273297 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:28.324150 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:17:28.382716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573 --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:28.383091 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573,backing_fmt=raw /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:28.410814 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Successfully updated port: 558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:17:28.414542 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fd276fd4-c38b-47b6-8005-c5fb12b5487c tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.756s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:28.440194 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573,backing_fmt=raw /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk 1073741824" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:28.440634 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "4fe9ab5b777fa77daa200d14e0ad30a3b2716573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:28.441003 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:28.458909 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6e54ee84-99e2-45dd-86ba-6af2d87b8324 req-535b2557-0f80-4116-b240-049c85de8b80 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:28.459301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6e54ee84-99e2-45dd-86ba-6af2d87b8324 req-535b2557-0f80-4116-b240-049c85de8b80 service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:28.459656 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6e54ee84-99e2-45dd-86ba-6af2d87b8324 req-535b2557-0f80-4116-b240-049c85de8b80 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:28.459847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6e54ee84-99e2-45dd-86ba-6af2d87b8324 req-535b2557-0f80-4116-b240-049c85de8b80 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:28.460038 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6e54ee84-99e2-45dd-86ba-6af2d87b8324 req-535b2557-0f80-4116-b240-049c85de8b80 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] No waiting events found dispatching network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:17:28.460200 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6e54ee84-99e2-45dd-86ba-6af2d87b8324 req-535b2557-0f80-4116-b240-049c85de8b80 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received unexpected event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 for instance with vm_state active and task_state None.
May 28 14:17:28.463425 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-changed-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:28.463627 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Refreshing instance network info cache due to event network-changed-558f378c-72ec-480e-bdfe-4ba38327d19b. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:28.463822 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] Acquiring lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:28.463953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] Acquired lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:28.464171 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Refreshing network info cache for port 558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:28.532159 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573 --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:28.532668 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:17:28.532823 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Ensure instance console log exists: /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:17:28.533069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:28.533225 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:28.533341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:28.699835 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Releasing lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:28.700202 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Instance network_info: |[{"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:17:28.701998 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Start _get_guest_xml network_info=[{"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='827d52ed801c70365f80b782244ec02d',container_format='bare',created_at=2026-05-28T14:17:12Z,direct_url=<?>,disk_format='qcow2',id=8b63918a-712c-412b-a148-1d958d5bc11b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-354635856',owner='4c345e5241bd40c693ea2c6ccaf6c8f7',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T14:17:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': '8b63918a-712c-412b-a148-1d958d5bc11b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:17:28.707279 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:17:28.707279 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-671631707', uuid='a2484ea1-95db-4db2-b76f-1c7a785663d6'), owner=OwnerMeta(userid='c98b8f4e148b4557bd70bd6a755850a2', username='tempest-TestStampPattern-744679963-project-member', projectid='4c345e5241bd40c693ea2c6ccaf6c8f7', projectname='tempest-TestStampPattern-744679963'), image=ImageMeta(id='8b63918a-712c-412b-a148-1d958d5bc11b', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '4c345e5241bd40c693ea2c6ccaf6c8f7'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977848.7069051) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:17:28.708299 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:17:28.708662 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:17:28.709494 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:17:28.709628 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:17:28.710707 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:17:28.710902 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='827d52ed801c70365f80b782244ec02d',container_format='bare',created_at=2026-05-28T14:17:12Z,direct_url=<?>,disk_format='qcow2',id=8b63918a-712c-412b-a148-1d958d5bc11b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-354635856',owner='4c345e5241bd40c693ea2c6ccaf6c8f7',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T14:17:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:17:28.711026 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:17:28.711123 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:17:28.711226 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:17:28.711313 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:17:28.711398 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:17:28.711580 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:17:28.711672 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:17:28.711775 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:17:28.711891 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:17:28.711998 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:17:28.730237 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-671631707',display_name='tempest-TestStampPattern-server-671631707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-teststamppattern-server-671631707',id=63,image_ref='8b63918a-712c-412b-a148-1d958d5bc11b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVGtHnRGjb57xlZUEhRDuiB+xXkZ7jN9FPaNseGT7FSrTZcPTjhLnrQvMrvAtYZ5MnPjOEKth0jcuHVqpUUaORV+U1PWfUzZ8KcOJkHdmxykCwqNz8bU9QFZM3bOMj9fA==',key_name='tempest-TestStampPattern-255717967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c345e5241bd40c693ea2c6ccaf6c8f7',ramdisk_id='',reservation_id='r-6afs2n90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4',image_min_disk='1',image_min_ram='0',image_owner_id='4c345e5241bd40c693ea2c6ccaf6c8f7',image_owner_project_name='tempest-TestStampPattern-744679963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-744679963-project-member',image_user_id='c98b8f4e148b4557bd70bd6a755850a2',network_allocated='True',owner_project_name='tempest-TestStampPattern-744679963',owner_user_name='tempest-TestStampPattern-744679963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:26Z,user_data=None,user_id='c98b8f4e148b4557bd70bd6a755850a2',uuid=a2484ea1-95db-4db2-b76f-1c7a785663d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:17:28.730434 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converting VIF {"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:28.731876 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:c8,bridge_name='br-int',has_traffic_filtering=True,id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3a9b73-20') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:28.734127 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'pci_devices' on Instance uuid a2484ea1-95db-4db2-b76f-1c7a785663d6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:28.914081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:28.967129 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:29.044225 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:29.194026 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:29.237229 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] End _get_guest_xml xml=<domain type="qemu">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <uuid>a2484ea1-95db-4db2-b76f-1c7a785663d6</uuid>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <name>instance-0000003f</name>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestStampPattern-server-671631707</nova:name>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:17:28</nova:creationTime>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:property name="img_owner_id">4c345e5241bd40c693ea2c6ccaf6c8f7</nova:property>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:user uuid="c98b8f4e148b4557bd70bd6a755850a2">tempest-TestStampPattern-744679963-project-member</nova:user>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:project uuid="4c345e5241bd40c693ea2c6ccaf6c8f7">tempest-TestStampPattern-744679963</nova:project>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         <nova:port uuid="2d3a9b73-2098-4eb5-b25e-16dea720a0a0">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <system>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <entry name="serial">a2484ea1-95db-4db2-b76f-1c7a785663d6</entry>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <entry name="uuid">a2484ea1-95db-4db2-b76f-1c7a785663d6</entry>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </system>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <os>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   </os>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <features>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   </features>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   <devices>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk.config"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:3b:10:c8"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <target dev="tap2d3a9b73-20"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </interface>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/console.log" append="off"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </serial>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <video>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </video>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </rng>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:   </devices>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]: </domain>
May 28 14:17:29.237229 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Preparing to wait for external event network-vif-plugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-671631707',display_name='tempest-TestStampPattern-server-671631707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-teststamppattern-server-671631707',id=63,image_ref='8b63918a-712c-412b-a148-1d958d5bc11b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVGtHnRGjb57xlZUEhRDuiB+xXkZ7jN9FPaNseGT7FSrTZcPTjhLnrQvMrvAtYZ5MnPjOEKth0jcuHVqpUUaORV+U1PWfUzZ8KcOJkHdmxykCwqNz8bU9QFZM3bOMj9fA==',key_name='tempest-TestStampPattern-255717967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c345e5241bd40c693ea2c6ccaf6c8f7',ramdisk_id='',reservation_id='r-6afs2n90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4',image_min_disk='1',image_min_ram='0',image_owner_id='4c345e5241bd40c693ea2c6ccaf6c8f7',image_owner_project_name='tempest-TestStampPattern-744679963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-744679963-project-member',image_user_id='c98b8f4e148b4557bd70bd6a755850a2',network_allocated='True',owner_project_name='tempest-TestStampPattern-744679963',owner_user_name='tempest-TestStampPattern-744679963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:26Z,user_data=None,user_id='c98b8f4e148b4557bd70bd6a755850a2',uuid=a2484ea1-95db-4db2-b76f-1c7a785663d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converting VIF {"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:c8,bridge_name='br-int',has_traffic_filtering=True,id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3a9b73-20') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:29.239891 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:c8,bridge_name='br-int',has_traffic_filtering=True,id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3a9b73-20') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:17:29.240317 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.240655 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:29.240929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:17:29.241538 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.241682 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '222a24bf-2b02-5719-80c6-550b082367f1', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:29.262540 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.263324 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:29.268414 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.271139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.271298 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d3a9b73-20, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:29.272100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d3a9b73-20, col_values=(('qos', UUID('ed14817d-8788-4653-b260-eddcff41ab0a')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:29.272100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d3a9b73-20, col_values=(('external_ids', {'iface-id': '2d3a9b73-2098-4eb5-b25e-16dea720a0a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:10:c8', 'vm-uuid': 'a2484ea1-95db-4db2-b76f-1c7a785663d6'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:29.272594 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.275364 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:29.282892 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.286280 np0000001643 nova-compute[98269]: INFO os_vif [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:c8,bridge_name='br-int',has_traffic_filtering=True,id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3a9b73-20')
May 28 14:17:29.334919 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:17:29.335853 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:17:29.336102 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Creating image(s)
May 28 14:17:29.336577 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "/opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:29.336727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:29.337150 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:29.338908 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:29.341416 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:29.342325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:29.444683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:29.445138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:29.445644 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:29.446107 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:29.448900 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:17:29.449231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:29.551308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:29.551779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:29.605329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk 1073741824" returned: 0 in 0.053s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:29.605732 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:29.606042 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:29.696653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c47d1b3d-7472-4856-89c3-304015e60fd3 req-7c83bd5b-7f2d-46c5-921f-b570b88d3ea0 service nova] Releasing lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:29.697415 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:29.697710 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:17:29.699162 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:29.699578 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:17:29.699828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:29.736731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:29.740439 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:29.740439 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:99:10:1d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:17:29.740439 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Using config drive
May 28 14:17:29.787600 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:29.790772 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:29.791775 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Cannot resize image /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:17:29.791775 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:17:29.791775 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Ensure instance console log exists: /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:17:29.792054 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:29.792111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:29.792296 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:30.244772 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:30.256251 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:17:30.394225 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Creating config drive at /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.config
May 28 14:17:30.401641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0cdfi_1j {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:30.457347 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:30.459801 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0cdfi_1j" returned: 0 in 0.058s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:30.599301 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Updating instance_info_cache with network_info: [{"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:30.772459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:30.773487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:30.803970 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:30.804125 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:30.804282 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No VIF found with MAC fa:16:3e:3b:10:c8, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:17:30.805075 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Using config drive
May 28 14:17:30.827359 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:30.827359 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:17:30.827940 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:17:30.924503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:30.958065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.064782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.101775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:31.102060 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Instance network_info: |[{"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:17:31.104985 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Start _get_guest_xml network_info=[{"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:17:31.116216 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:17:31.116216 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1714326180', uuid='33304aba-a509-4200-9824-e2aeb30f76d8'), owner=OwnerMeta(userid='039853f7e499423384aa13ada9b39d22', username='tempest-TestEncryptedCinderVolumes-1171403786-project-member', projectid='50ea6d8cf0d14c40ad9163f647b3d065', projectname='tempest-TestEncryptedCinderVolumes-1171403786'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977851.1145728) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:17:31.124843 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:17:31.124843 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:17:31.129211 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:17:31.130575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:17:31.132813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:17:31.132813 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:17:31.133005 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:17:31.133100 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:17:31.133274 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:17:31.135883 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:17:31.136067 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:17:31.136292 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:17:31.136492 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:17:31.138327 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2bdb8913-407e-4939-b588-22d7fb897d2e req-80daa3f5-6370-4bd8-ba95-17603833778a service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:31.138553 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:17:31.138766 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2bdb8913-407e-4939-b588-22d7fb897d2e req-80daa3f5-6370-4bd8-ba95-17603833778a service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:31.138906 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:17:31.139092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2bdb8913-407e-4939-b588-22d7fb897d2e req-80daa3f5-6370-4bd8-ba95-17603833778a service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:31.139286 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:17:31.146719 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2bdb8913-407e-4939-b588-22d7fb897d2e req-80daa3f5-6370-4bd8-ba95-17603833778a service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:31.146928 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2bdb8913-407e-4939-b588-22d7fb897d2e req-80daa3f5-6370-4bd8-ba95-17603833778a service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Processing event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:17:31.151730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1714326180',display_name='tempest-TestEncryptedCinderVolumes-server-1714326180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1714326180',id=64,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGym+EZspxmn3ddiGygTcqrshkX+w7+nMxBplLB86PUlegQ4fHMf307Zbmu55jYpjMhqr0GcE8qD5Guw0x4Q08nlwEXSTg0mkplw0YWLg/HebS01kiCupYJruGGA7Zrz+w==',key_name='tempest-keypair-804152696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-lqbqlas5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=33304aba-a509-4200-9824-e2aeb30f76d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:17:31.151730 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:31.151730 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:54,bridge_name='br-int',has_traffic_filtering=True,id=558f378c-72ec-480e-bdfe-4ba38327d19b,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558f378c-72') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:31.152778 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'pci_devices' on Instance uuid 33304aba-a509-4200-9824-e2aeb30f76d8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:31.277398 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'flavor' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:31.307429 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.317469 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:31.317469 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.318749 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.345748 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.435189 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Creating config drive at /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk.config
May 28 14:17:31.438385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwzx1sxo1 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:31.489788 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwzx1sxo1" returned: 0 in 0.051s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:31.656660 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] End _get_guest_xml xml=<domain type="qemu">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <uuid>33304aba-a509-4200-9824-e2aeb30f76d8</uuid>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <name>instance-00000040</name>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1714326180</nova:name>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:17:31</nova:creationTime>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:user uuid="039853f7e499423384aa13ada9b39d22">tempest-TestEncryptedCinderVolumes-1171403786-project-member</nova:user>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:project uuid="50ea6d8cf0d14c40ad9163f647b3d065">tempest-TestEncryptedCinderVolumes-1171403786</nova:project>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         <nova:port uuid="558f378c-72ec-480e-bdfe-4ba38327d19b">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <system>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <entry name="serial">33304aba-a509-4200-9824-e2aeb30f76d8</entry>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <entry name="uuid">33304aba-a509-4200-9824-e2aeb30f76d8</entry>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </system>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <os>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   </os>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <features>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   </features>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   <devices>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk.config"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </disk>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:55:de:54"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <target dev="tap558f378c-72"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </interface>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/console.log" append="off"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </serial>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <video>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </video>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </rng>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:   </devices>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]: </domain>
May 28 14:17:31.656660 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Preparing to wait for external event network-vif-plugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1714326180',display_name='tempest-TestEncryptedCinderVolumes-server-1714326180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1714326180',id=64,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGym+EZspxmn3ddiGygTcqrshkX+w7+nMxBplLB86PUlegQ4fHMf307Zbmu55jYpjMhqr0GcE8qD5Guw0x4Q08nlwEXSTg0mkplw0YWLg/HebS01kiCupYJruGGA7Zrz+w==',key_name='tempest-keypair-804152696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-lqbqlas5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=33304aba-a509-4200-9824-e2aeb30f76d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:54,bridge_name='br-int',has_traffic_filtering=True,id=558f378c-72ec-480e-bdfe-4ba38327d19b,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558f378c-72') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:17:31.659648 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:54,bridge_name='br-int',has_traffic_filtering=True,id=558f378c-72ec-480e-bdfe-4ba38327d19b,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558f378c-72') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:17:31.660205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.660205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:31.660435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:17:31.661179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.661365 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd6cb4cb-9b8f-5935-b6c3-9b6c4e644e59', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:31.664986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.664986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:31.672758 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.676348 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.676568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap558f378c-72, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:31.677003 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap558f378c-72, col_values=(('qos', UUID('4342bc6f-7abc-4840-92cf-62ef1a8d1b7f')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:31.677203 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap558f378c-72, col_values=(('external_ids', {'iface-id': '558f378c-72ec-480e-bdfe-4ba38327d19b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:de:54', 'vm-uuid': '33304aba-a509-4200-9824-e2aeb30f76d8'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:17:31.678493 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.679793 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:17:31.691739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.692862 np0000001643 nova-compute[98269]: INFO os_vif [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:de:54,bridge_name='br-int',has_traffic_filtering=True,id=558f378c-72ec-480e-bdfe-4ba38327d19b,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558f378c-72')
May 28 14:17:31.792323 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977851.7919118, 3a509dcf-af9c-4813-90a7-724d0adde626 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:31.792881 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:17:31.793261 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] VM Started (Lifecycle Event)
May 28 14:17:31.795692 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:17:31.799746 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance spawned successfully.
May 28 14:17:31.802950 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:17:31.931674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.965557 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:31.967325 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:32.070469 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:32.128837 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f7eaf50-6a36-4afe-b149-7e0fed75b906 req-e1c94ea0-a32f-4889-9f45-afe73ec9540e service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-vif-plugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:32.130023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f7eaf50-6a36-4afe-b149-7e0fed75b906 req-e1c94ea0-a32f-4889-9f45-afe73ec9540e service nova] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:32.130263 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f7eaf50-6a36-4afe-b149-7e0fed75b906 req-e1c94ea0-a32f-4889-9f45-afe73ec9540e service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:32.130471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5f7eaf50-6a36-4afe-b149-7e0fed75b906 req-e1c94ea0-a32f-4889-9f45-afe73ec9540e service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:32.130652 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5f7eaf50-6a36-4afe-b149-7e0fed75b906 req-e1c94ea0-a32f-4889-9f45-afe73ec9540e service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Processing event network-vif-plugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:17:32.173270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:32.179552 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:32.282824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:32.295874 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:32.302255 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:32.311889 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:32.312095 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:32.312412 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:32.312688 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:32.313104 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:32.313354 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:32.804721 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:17:32.804957 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977852.8047886, 3a509dcf-af9c-4813-90a7-724d0adde626 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:32.805040 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] VM Paused (Lifecycle Event)
May 28 14:17:32.822553 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Took 10.30 seconds to spawn the instance on the hypervisor.
May 28 14:17:32.822818 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:32.827182 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:32.827638 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:32.883604 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:17:32.887564 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:17:32.890821 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Instance spawned successfully.
May 28 14:17:32.891411 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:17:32.894891 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:32.895242 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:33.215587 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:33.215764 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:33.215935 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:55:de:54, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:17:33.216398 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Using config drive
May 28 14:17:33.228093 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a4fb36f5-5870-4408-bb8e-c395017f2f36 req-9d2a8bc6-8d41-41f5-a350-63753e229efe service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:33.228343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a4fb36f5-5870-4408-bb8e-c395017f2f36 req-9d2a8bc6-8d41-41f5-a350-63753e229efe service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:33.228559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a4fb36f5-5870-4408-bb8e-c395017f2f36 req-9d2a8bc6-8d41-41f5-a350-63753e229efe service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:33.228699 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a4fb36f5-5870-4408-bb8e-c395017f2f36 req-9d2a8bc6-8d41-41f5-a350-63753e229efe service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:33.230091 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a4fb36f5-5870-4408-bb8e-c395017f2f36 req-9d2a8bc6-8d41-41f5-a350-63753e229efe service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] No waiting events found dispatching network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:17:33.230295 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a4fb36f5-5870-4408-bb8e-c395017f2f36 req-9d2a8bc6-8d41-41f5-a350-63753e229efe service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received unexpected event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 for instance with vm_state active and task_state None.
May 28 14:17:33.307958 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:33.310359 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977853.3100638, 3a509dcf-af9c-4813-90a7-724d0adde626 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:33.310648 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] VM Resumed (Lifecycle Event)
May 28 14:17:33.340129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:33.342325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:33.342325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:33.342325 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:17:33.345146 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Took 18.20 seconds to build instance.
May 28 14:17:33.376066 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:33.376281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:33.376413 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Attaching volume 96923d8a-30e8-4bce-bb16-0979fda4b6db to /dev/vdb
May 28 14:17:33.403038 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Took 6.38 seconds to spawn the instance on the hypervisor.
May 28 14:17:33.403038 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:33.427579 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:17:33.444492 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:17:33.468910 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:33.529736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:17:33.531228 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:17:33.541139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:17:33.542767 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fe37:2cff', 'fe80::f830:cfff:fea4:1adf', 'fe80::fc16:3eff:fe99:101d', 'fe80::8097:21ff:fe89:3b01', 'fe80::fc16:3eff:fe3b:10c8', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:17:33.543109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:17:33.543286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:17:33.543615 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:17:33.544044 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating existing volume attachment record: 45fe5617-b27f-4d75-a7b8-7459f1e4f3d6 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:17:33.726080 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:33.816536 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:33.822018 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:33.855115 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6990e214-efa0-4a62-ba58-b8ceabf7c7af tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.715s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:33.912468 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Took 11.73 seconds to build instance.
May 28 14:17:33.934036 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Creating config drive at /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk.config
May 28 14:17:33.941508 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxj81khgj {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:34.005696 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxj81khgj" returned: 0 in 0.066s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:34.103622 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:17:34.104118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:17:34.104586 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:34.105202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:34.105426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:17:34.122473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:34.122473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:17:34.122819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:34.123059 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:17:34.127016 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:17:34.127016 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:17:34.140852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:17:34.140852 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:34.148682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:17:34.148682 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:34.158727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db] added
May 28 14:17:34.158727 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:17:34.158727 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:34.158727 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:34.158727 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:34.158727 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:34.158727 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:34.159317 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:17:34.159317 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:17:34.159462 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:17:34.162573 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db] added
May 28 14:17:34.162573 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:17:34.162573 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:34.162573 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:34.162573 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:17:34.162573 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:17:34.162573 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:34.162573 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:17:34.163411 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:17:34.163411 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:17:34.200248 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33ad4927-1b63-4a1a-804e-54c82cd4f4e9 req-2df01bde-0936-4bcc-8923-fa66a5d0eeea service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-vif-plugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:34.200421 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33ad4927-1b63-4a1a-804e-54c82cd4f4e9 req-2df01bde-0936-4bcc-8923-fa66a5d0eeea service nova] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:34.203773 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33ad4927-1b63-4a1a-804e-54c82cd4f4e9 req-2df01bde-0936-4bcc-8923-fa66a5d0eeea service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:34.203948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33ad4927-1b63-4a1a-804e-54c82cd4f4e9 req-2df01bde-0936-4bcc-8923-fa66a5d0eeea service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:34.204085 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33ad4927-1b63-4a1a-804e-54c82cd4f4e9 req-2df01bde-0936-4bcc-8923-fa66a5d0eeea service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] No waiting events found dispatching network-vif-plugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:17:34.204231 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-33ad4927-1b63-4a1a-804e-54c82cd4f4e9 req-2df01bde-0936-4bcc-8923-fa66a5d0eeea service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received unexpected event network-vif-plugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 for instance with vm_state active and task_state None.
May 28 14:17:34.328868 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977854.3284166, a2484ea1-95db-4db2-b76f-1c7a785663d6 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:34.329407 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] VM Started (Lifecycle Event)
May 28 14:17:34.387152 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:17:34.390089 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:34.417046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0de-07a4-4bb3-a9b3-f22cf75194d3 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.241s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:34.511558 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:34.512602 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:34.550955 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:34.581862 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:34.647031 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:34.654779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:34.711016 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:34.788561 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:34.793847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:34.794410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:34.836307 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:34.845237 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:34.918708 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:34.922380 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:35.023318 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:35.030193 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:35.041966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:35.044492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:35.055341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:35.140085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:35.144808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:35.162225 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:17:35.164127 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:17:35.177764 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:17:35.177764 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:17:35.183299 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:17:35.183299 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.195248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.203249 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.215042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.215042 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.215042 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.215042 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:35.215207 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.215207 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.215207 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.215207 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:35.221603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.221603 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.221603 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.221603 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:35.221762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.221762 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.221762 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.221762 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:35.249053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260]
May 28 14:17:35.249053 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260] successful.
May 28 14:17:35.249053 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.254918 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:35.255133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:35.270674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.272101 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260]
May 28 14:17:35.272101 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260] successful.
May 28 14:17:35.272101 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.299157 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:35.299654 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:35.299793 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:17:35.303078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:17:35.303078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] HCTL ('10', '-', '-', 0) found on session 161 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:17:35.303078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:17:35.312407 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-changed-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:35.312407 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Refreshing instance network info cache due to event network-changed-a6538970-472a-467f-81d8-972e8c784834. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:35.312407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Acquiring lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:35.312722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Acquired lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:35.315099 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Refreshing network info cache for port a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3409f1ca-3f01-4d41-9320-09063f5a5582 (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:17:35.320495 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] HCTL ('11', '-', '-', 0) found on session 162 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:17:35.320495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:17:35.330892 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching for a device in session 161 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:17:35.331334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:17:35.351147 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977855.3507638, a2484ea1-95db-4db2-b76f-1c7a785663d6 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:35.354304 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] VM Paused (Lifecycle Event)
May 28 14:17:35.354304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:35.354963 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching for a device in session 162 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:17:35.355160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:17:35.361404 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:17:35.362493 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:17:35.424923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:17:35.426405 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=13029MB free_disk=72.72994232177734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:17:35.426405 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:35.426405 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:35.500373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-changed-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:35.500735 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Refreshing instance network info cache due to event network-changed-2d3a9b73-2098-4eb5-b25e-16dea720a0a0. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:35.500933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] Acquiring lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:35.501055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] Acquired lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:35.501214 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Refreshing network info cache for port 2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:35.822709 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:35.855344 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:35.860308 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977855.859984, a2484ea1-95db-4db2-b76f-1c7a785663d6 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:35.860568 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] VM Resumed (Lifecycle Event)
May 28 14:17:36.004674 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:36.127044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:17:36.212108 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:36.364851 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:36.366638 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:36.371473 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Updated VIF entry in instance network info cache for port a6538970-472a-467f-81d8-972e8c784834. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:17:36.371473 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Updating instance_info_cache with network_info: [{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:36.407878 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:36.504153 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:17:36.504153 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance db49aa69-cf97-4002-a027-262f598da41b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:17:36.504950 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 3a509dcf-af9c-4813-90a7-724d0adde626 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:17:36.504950 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance a2484ea1-95db-4db2-b76f-1c7a785663d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:17:36.504950 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 33304aba-a509-4200-9824-e2aeb30f76d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:17:36.504950 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:17:36.504950 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:17:35 up 44 min,  2 users,  load average: 4.03, 5.23, 4.53\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_4c345e5241bd40c693ea2c6ccaf6c8f7': '2', 'io_workload': '1', 'num_proj_d19477b13dbf4580a9341cfc05b6b7e1': '1', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_50ea6d8cf0d14c40ad9163f647b3d065': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:17:36.641166 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updated VIF entry in instance network info cache for port 2d3a9b73-2098-4eb5-b25e-16dea720a0a0. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:17:36.641407 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updating instance_info_cache with network_info: [{"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:36.678467 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:36.812473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:17:36.812682 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:17:36.869990 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977856.869635, 33304aba-a509-4200-9824-e2aeb30f76d8 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:36.870179 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] VM Started (Lifecycle Event)
May 28 14:17:36.874371 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Releasing lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:36.874574 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-vif-plugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:36.874745 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:36.874900 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:36.875034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:36.875128 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Processing event network-vif-plugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:17:36.875238 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-vif-plugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:36.875346 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:17:36.875501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:17:36.875600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:36.875706 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] No waiting events found dispatching network-vif-plugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:17:36.875825 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9008a5e9-6186-495a-b2f2-c909105d1f41 req-425d62ad-d015-48ad-96ce-93af40874897 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received unexpected event network-vif-plugged-558f378c-72ec-480e-bdfe-4ba38327d19b for instance with vm_state building and task_state spawning.
May 28 14:17:36.876394 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:17:36.882829 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:17:36.888491 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Instance spawned successfully.
May 28 14:17:36.888753 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:17:37.143434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1a977754-8f01-4ff0-b1dd-6bb9e6f91361 req-4da71d31-4e14-4a50-9c24-c5775dc331d0 service nova] Releasing lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:37.144162 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Found WWN 3300000000387f473 for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:17:37.144694 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:17:37.144953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000000387f473', 'path': '/dev/dm-3', 'multipath_id': '3300000000387f473'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:17:37.145098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000387f473', 'path': '/dev/dm-3', 'multipath_id': '3300000000387f473'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:17:37.151154 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'flavor' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:17:37.315217 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:17:37.376009 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:37.379093 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:37.396199 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:37.396347 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:37.396731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:37.397222 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:37.397551 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:37.397851 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:17:37.654823 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Attempting to attach volume 96923d8a-30e8-4bce-bb16-0979fda4b6db with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:17:37.656324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:17:37.656324 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:17:37.656324 np0000001643 nova-compute[98269]:   <alias name="ua-96923d8a-30e8-4bce-bb16-0979fda4b6db"/>
May 28 14:17:37.656324 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:17:37.656324 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:17:37.656324 np0000001643 nova-compute[98269]:   <serial>96923d8a-30e8-4bce-bb16-0979fda4b6db</serial>
May 28 14:17:37.656324 np0000001643 nova-compute[98269]: </disk>
May 28 14:17:37.656324 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:17:37.827995 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:17:37.827995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.402s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:37.829318 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:17:37.881743 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:17:37.881934 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977857.8817973, 33304aba-a509-4200-9824-e2aeb30f76d8 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:37.882043 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] VM Paused (Lifecycle Event)
May 28 14:17:37.903544 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Took 8.57 seconds to spawn the instance on the hypervisor.
May 28 14:17:37.903834 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:38.384683 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:38.388792 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977858.3884299, 33304aba-a509-4200-9824-e2aeb30f76d8 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:17:38.389018 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] VM Resumed (Lifecycle Event)
May 28 14:17:38.416477 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Took 14.19 seconds to build instance.
May 28 14:17:38.829093 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:38.829322 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:38.829564 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:38.829788 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:17:38.891095 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:17:38.894259 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:17:38.918520 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.696s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:38.979071 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-changed-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:38.979230 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Refreshing instance network info cache due to event network-changed-558f378c-72ec-480e-bdfe-4ba38327d19b. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:38.979395 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] Acquiring lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:38.979526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] Acquired lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:38.979652 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Refreshing network info cache for port 558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:39.322458 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:39.322628 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:39.322771 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:17:39.322946 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No VIF found with MAC fa:16:3e:37:2c:ff, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:17:39.483514 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:39.805667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:39.810043 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:39.960135 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Updated VIF entry in instance network info cache for port 558f378c-72ec-480e-bdfe-4ba38327d19b. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:17:39.960354 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Updating instance_info_cache with network_info: [{"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:40.462201 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-42e5f15c-87ce-4b98-989c-d7c9c3614b50 req-423254fc-9f7e-45d4-966e-b0f85355cca9 service nova] Releasing lock "refresh_cache-33304aba-a509-4200-9824-e2aeb30f76d8" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:40.827084 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:40.828844 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:17:40.885704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a3f6b4d4-24eb-4fe7-a7a8-e9946477c3aa tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.509s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:17:41.679794 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:43.551895 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:43.551895 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing instance network info cache due to event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:43.552400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] Acquiring lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:43.552400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] Acquired lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:43.552400 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:43.825478 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:17:43.825478 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:17:44.055361 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:44.406380 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:44.571856 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updated VIF entry in instance network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:17:44.572336 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:44.807226 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:45.073873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-821c66f2-5ebe-4cfc-a584-afa00d617f47 req-a4972fa3-3f92-40a4-bc97-b7e4974aad12 service nova] Releasing lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:45.626477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:17:45.626477 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing instance network info cache due to event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:17:45.626477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] Acquiring lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:17:45.626477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] Acquired lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:17:45.626477 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:17:46.130198 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:46.492207 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:17:46.641432 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updated VIF entry in instance network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:17:46.641951 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:17:46.680910 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:47.144367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e5f3ad3d-8d4a-45d9-bdc1-9ac832677751 req-88b2dd13-f880-4ea3-8067-a49146d2b74c service nova] Releasing lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:17:48.123465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:49.808489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:51.519624 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:51.682382 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:53.734498 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:54.810336 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:56.287438 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:56.682896 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:58.345294 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:17:59.813688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:01.683471 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:04.814395 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:05.798258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:05.799878 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:05.801745 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Rebooting instance
May 28 14:18:06.409679 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:06.410041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquired lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:06.410041 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:18:06.684944 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:06.913129 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:07.191960 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:07.309656 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:07.811642 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Releasing lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:08.315682 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:09.345628 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:09.346769 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:09.364569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:09.386781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:09.492051 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-62c6275d-a4fa-4cbf-8eb8-2e4c99e804bf req-5b7ad07c-2ac2-4adc-a6e2-7c57687bea37 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:09.492202 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-62c6275d-a4fa-4cbf-8eb8-2e4c99e804bf req-5b7ad07c-2ac2-4adc-a6e2-7c57687bea37 service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:09.492413 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-62c6275d-a4fa-4cbf-8eb8-2e4c99e804bf req-5b7ad07c-2ac2-4adc-a6e2-7c57687bea37 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:09.492577 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-62c6275d-a4fa-4cbf-8eb8-2e4c99e804bf req-5b7ad07c-2ac2-4adc-a6e2-7c57687bea37 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:09.492730 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-62c6275d-a4fa-4cbf-8eb8-2e4c99e804bf req-5b7ad07c-2ac2-4adc-a6e2-7c57687bea37 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] No waiting events found dispatching network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:09.492899 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-62c6275d-a4fa-4cbf-8eb8-2e4c99e804bf req-5b7ad07c-2ac2-4adc-a6e2-7c57687bea37 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received unexpected event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 for instance with vm_state active and task_state reboot_started_hard.
May 28 14:18:09.644805 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999647287000244 future=<Future at 0x71a75c4f4980 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:09.645611 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99897111700011 future=<Future at 0x71a75c4f4980 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:09.645611 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99876175899999 future=<Future at 0x71a75c4f4980 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:09.647143 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance destroyed successfully.
May 28 14:18:09.647737 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'resources' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:09.817949 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:10.150226 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-859358347',display_name='tempest-TestMinimumBasicScenario-server-859358347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-859358347',id=61,image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQYP+V8aFByge7xp6cgO0POP+ecYlEeU6kAzd/PQCST0aF5OYTjbftUVxGTVTseCuc472pkiq4aQdIP5tmMv/GKtKfmNByGUfz8XuImX+jBpT4GF4lH1DDR7J470N+wA==',key_name='tempest-TestMinimumBasicScenario-1748400774',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:27Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-yfonxw7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:08Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=db49aa69-cf97-4002-a027-262f598da41b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:18:10.150501 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:10.151163 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:10.151426 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:18:10.153489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:10.153489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95672d9b-67, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:10.154137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:10.154859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:10.155375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:10.156139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:10.156266 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed5cf0ed-81d9-4756-92fb-f673262c3d4b) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:10.156713 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:10.157108 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:10.157492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:10.159203 np0000001643 nova-compute[98269]: INFO os_vif [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67')
May 28 14:18:10.160695 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:18:10.161025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:10.161182 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:10.161595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:10.161962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:18:10.162131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:18:10.184713 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:10.184713 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:10.184713 np0000001643 nova-compute[98269]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:10.184713 np0000001643 nova-compute[98269]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:10.184713 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:10.184713 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:10.185003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:10.185003 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:10.185003 np0000001643 nova-compute[98269]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:10.185003 np0000001643 nova-compute[98269]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:10.185003 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:10.185003 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:10.185003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe', '163')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:18:10.185183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '162')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:10.185812 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '161')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:10.186403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a77811d080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:18:10.186603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Removing multipathed devices sdf, sde {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:18:10.186810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flush multipath device 3300000000387f473 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:18:10.221009 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:10.262945 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:10.326770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:18:10.326966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:18:10.328240 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:18:10.340640 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:18:10.340810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:18:10.350932 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:10.387553 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260]
May 28 14:18:10.387553 np0000001643 nova-compute[98269]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260] successful.
May 28 14:18:10.387553 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:10.403622 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:10.415229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:10.447361 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260]
May 28 14:18:10.447361 np0000001643 nova-compute[98269]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260] successful.
May 28 14:18:10.447361 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:10.462562 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:10.462722 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:10.462824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== disconnect_volume: return (301ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:10.462933 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:18:10.467384 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Start _get_guest_xml network_info=[{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': '9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '45fe5617-b27f-4d75-a7b8-7459f1e4f3d6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': 'db49aa69-cf97-4002-a027-262f598da41b', 'attached_at': '', 'detached_at': '', 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'serial': '96923d8a-30e8-4bce-bb16-0979fda4b6db'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:18:10.469200 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:18:10.470121 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-859358347', uuid='db49aa69-cf97-4002-a027-262f598da41b'), owner=OwnerMeta(userid='c8481a6da3424bd79d4706a19f2de577', username='tempest-TestMinimumBasicScenario-1492567984-project-member', projectid='d19477b13dbf4580a9341cfc05b6b7e1', projectname='tempest-TestMinimumBasicScenario-1492567984'), image=ImageMeta(id='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977890.4698505) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:18:10.471098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:18:10.471536 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:18:10.472399 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:18:10.472600 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:18:10.473324 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:18:10.473631 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:18:10.473768 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:18:10.473855 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:18:10.473967 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:18:10.474045 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:18:10.474129 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:18:10.474258 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:18:10.474353 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:18:10.474456 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:18:10.474568 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:18:10.474677 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:18:10.474798 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'vcpu_model' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:10.976465 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Object Instance<db49aa69-cf97-4002-a027-262f598da41b> lazy-loaded attributes: resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:10.985281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:11.075757 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.config --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:11.077009 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:11.077009 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:11.077541 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:11.077980 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:18:11.078423 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:11.078845 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:11.079049 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:11.079488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:18:11.093953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:11.094399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:11.094733 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:11.098535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:11.099175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:11.099465 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:11.113465 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:11.113465 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:11.121107 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:11.121107 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:11.125948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db] added
May 28 14:18:11.125948 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:11.125948 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:11.125948 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:11.125948 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:11.125948 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:11.125948 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:11.126149 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:11.126343 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:11.126551 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:11.130786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db] added
May 28 14:18:11.130786 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:11.130786 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:11.130786 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:11.130786 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:11.130786 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:11.130786 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:11.130996 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:11.131124 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:11.131220 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:11.558685 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30e6ff8f-051a-4dbc-9114-235000e69a93 req-00c6c5ad-a6ad-445a-a285-3a4ab5f331d5 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:11.559127 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30e6ff8f-051a-4dbc-9114-235000e69a93 req-00c6c5ad-a6ad-445a-a285-3a4ab5f331d5 service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:11.559316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30e6ff8f-051a-4dbc-9114-235000e69a93 req-00c6c5ad-a6ad-445a-a285-3a4ab5f331d5 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:11.559486 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30e6ff8f-051a-4dbc-9114-235000e69a93 req-00c6c5ad-a6ad-445a-a285-3a4ab5f331d5 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:11.559684 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30e6ff8f-051a-4dbc-9114-235000e69a93 req-00c6c5ad-a6ad-445a-a285-3a4ab5f331d5 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] No waiting events found dispatching network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:11.559844 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-30e6ff8f-051a-4dbc-9114-235000e69a93 req-00c6c5ad-a6ad-445a-a285-3a4ab5f331d5 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received unexpected event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 for instance with vm_state active and task_state reboot_started_hard.
May 28 14:18:11.818511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:11.818718 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:11.818943 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:11.822422 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98269) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 14:18:11.823167 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'flavor' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:11.939713 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:11.939939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:12.126968 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:12.131634 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:12.148035 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:12.148035 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:12.150918 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:12.150918 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.160899 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.165006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.172247 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.172247 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.172247 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.172247 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:12.172437 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.172437 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.172437 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.172437 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:12.178360 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.178360 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.178360 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.178360 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:12.178561 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.178561 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.178561 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.178561 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:12.215364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260]
May 28 14:18:12.215364 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260] successful.
May 28 14:18:12.215364 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.215744 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260]
May 28 14:18:12.215744 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260] successful.
May 28 14:18:12.215744 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.225412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.229315 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:12.238286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.238286 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.238286 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.238286 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.238286 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.238286 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:12.238571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.238571 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.238571 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.238571 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.238571 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.238571 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:12.238806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:12.239060 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:12.239776 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] HCTL ('10', '-', '-', 0) found on session 164 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:12.239879 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:12.244888 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.244888 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.244888 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.244888 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.244888 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.244888 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:12.245072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.245072 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:12.245072 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:12.245072 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.245072 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:12.245072 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:12.245326 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:12.245401 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:12.246069 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] HCTL ('11', '-', '-', 0) found on session 165 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:12.246173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:12.255230 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching for a device in session 164 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:12.255230 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:12.261789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching for a device in session 165 and hctl ['11', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:12.443906 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'flavor' on Instance uuid a2484ea1-95db-4db2-b76f-1c7a785663d6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:12.845283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:12.865363 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:12.886071 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:13.115284 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:13.120971 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:13.137872 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999621149000177 future=<Future at 0x71a75c1dd6a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:13.140847 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance destroyed successfully.
May 28 14:18:13.141488 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:13.261371 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching for a device in session 165 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:13.261582 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:13.448796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:13.613662 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:13.613887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:13.614080 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:13.614814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:13.614814 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] No waiting events found dispatching network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:13.614814 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received unexpected event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 for instance with vm_state active and task_state powering-off.
May 28 14:18:13.614814 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:13.614814 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:13.615068 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:13.615068 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:13.615143 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] No waiting events found dispatching network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:13.615325 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-7bfec91a-593a-4fb6-ba58-58d6184166b8 req-777c8ba2-361c-41b1-a51b-a4d198eb6000 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received unexpected event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 for instance with vm_state active and task_state powering-off.
May 28 14:18:13.645122 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Object Instance<3a509dcf-af9c-4813-90a7-724d0adde626> lazy-loaded attributes: flavor,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:13.645381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:14.116345 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Found WWN 3300000000387f473 for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:18:14.116986 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:14.117142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000000387f473', 'path': '/dev/dm-3', 'multipath_id': '3300000000387f473'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:14.117279 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000387f473', 'path': '/dev/dm-3', 'multipath_id': '3300000000387f473'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:18:14.151616 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-70c7ae53-07b9-41f0-aa31-a6cd6374c148 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.333s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:14.602343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:14.602554 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:14.602766 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Attaching volume 34b8f077-0d36-4f4e-9225-e83978816ed8 to /dev/vdb
May 28 14:18:14.622069 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-859358347',display_name='tempest-TestMinimumBasicScenario-server-859358347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-859358347',id=61,image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQYP+V8aFByge7xp6cgO0POP+ecYlEeU6kAzd/PQCST0aF5OYTjbftUVxGTVTseCuc472pkiq4aQdIP5tmMv/GKtKfmNByGUfz8XuImX+jBpT4GF4lH1DDR7J470N+wA==',key_name='tempest-TestMinimumBasicScenario-1748400774',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:27Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-yfonxw7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:08Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=db49aa69-cf97-4002-a027-262f598da41b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:18:14.622264 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:14.622925 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:14.624149 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'pci_devices' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:14.640972 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:14.651669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:18:14.672477 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:14.709887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:18:14.710497 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:18:14.718528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:18:14.719692 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fe3b:10c8', 'fe80::fc16:3eff:fe55:de54', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:18:14.719798 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:18:14.719906 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:18:14.720122 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:14.720403 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updating existing volume attachment record: f7777180-07f1-411c-891c-0db8cf3882d1 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:18:14.818427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:15.125814 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Object Instance<db49aa69-cf97-4002-a027-262f598da41b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:15.127902 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] End _get_guest_xml xml=<domain type="qemu">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <uuid>db49aa69-cf97-4002-a027-262f598da41b</uuid>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <name>instance-0000003d</name>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestMinimumBasicScenario-server-859358347</nova:name>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:18:10</nova:creationTime>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:image uuid="9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:user uuid="c8481a6da3424bd79d4706a19f2de577">tempest-TestMinimumBasicScenario-1492567984-project-member</nova:user>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:project uuid="d19477b13dbf4580a9341cfc05b6b7e1">tempest-TestMinimumBasicScenario-1492567984</nova:project>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         <nova:port uuid="95672d9b-6717-4879-bdbe-58e4d4af4a41">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <system>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <entry name="serial">db49aa69-cf97-4002-a027-262f598da41b</entry>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <entry name="uuid">db49aa69-cf97-4002-a027-262f598da41b</entry>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </system>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <os>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   </os>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <features>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   </features>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   <devices>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk.config"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <alias name="ua-96923d8a-30e8-4bce-bb16-0979fda4b6db"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-3"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <serial>96923d8a-30e8-4bce-bb16-0979fda4b6db</serial>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:37:2c:ff"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <target dev="tap95672d9b-67"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </interface>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/console.log" append="off"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </serial>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <video>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </video>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </rng>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:   </devices>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]: </domain>
May 28 14:18:15.127902 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:18:15.129902 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:15.159017 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:15.228765 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:15.229283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:15.275616 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:18:15.276044 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34b8f077-0d36-4f4e-9225-e83978816ed8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:15.276214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:15.278753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:15.278962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34b8f077-0d36-4f4e-9225-e83978816ed8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:18:15.292335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:15.293194 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:15.293905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:15.294537 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:15.295819 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:15.296173 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:15.310165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:15.310165 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:15.313819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:15.313819 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:15.320376 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:15.321294 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:18:15.321759 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'trusted_certs' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:15.322810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8] added
May 28 14:18:15.322810 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:15.322810 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:15.322810 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:15.322810 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:15.322810 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:15.322810 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:15.323114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:15.323114 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:15.323244 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:15.325700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8] added
May 28 14:18:15.325700 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:15.325700 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:15.325700 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:15.325700 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:15.325700 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:15.325700 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:15.325920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:15.326090 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:15.326266 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:15.496939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:15.497106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:15.658518 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'flavor' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:15.824704 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Object Instance<db49aa69-cf97-4002-a027-262f598da41b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:15.825143 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:15.910855 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:15.911229 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:18:15.911535 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:15.993437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:15.993904 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Cannot resize image /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:18:15.994177 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'migration_context' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:16.000649 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 33304aba-a509-4200-9824-e2aeb30f76d8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:16.162877 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:16.163407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:16.163407 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:18:16.163407 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'info_cache' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:16.323981 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:16.326756 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:16.336306 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:16.336306 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:16.341564 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:16.341564 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.347847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.353982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.362696 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.362696 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.362696 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.362696 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.362696 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.362696 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:16.362952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.362952 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.362952 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.362952 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.362952 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.362952 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:16.368277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.368277 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.368277 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.368277 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.368277 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.368277 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:16.368462 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.368462 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.368462 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.368462 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.368462 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.368462 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:16.396971 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.40.100,3260]
May 28 14:18:16.396971 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.40.100,3260] successful.
May 28 14:18:16.396971 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.402620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.50.100,3260]
May 28 14:18:16.402620 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.50.100,3260] successful.
May 28 14:18:16.402620 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.411165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.416179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:16.426065 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.426065 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.426065 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.426065 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.426065 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.426065 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.426065 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.426065 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:16.426296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.426296 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.426296 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.426296 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.426296 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.426296 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.426296 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.426296 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:16.426602 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:16.426721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:16.427649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] HCTL ('12', '-', '-', 0) found on session 166 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:16.427756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:16.435263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.435263 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.435263 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.435263 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.435263 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.435263 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.435263 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.435263 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:16.435529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.435529 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:16.435529 np0000001643 nova-compute[98269]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c49e919-3ec6-410f-a4e3-f24af474ddfe (non-flash)
May 28 14:18:16.435529 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.435529 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:16.435529 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.435529 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:16.435529 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:16.435807 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:16.435954 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:16.436996 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] HCTL ('13', '-', '-', 0) found on session 167 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:16.437156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:16.444571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching for a device in session 166 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:16.444735 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34b8f077-0d36-4f4e-9225-e83978816ed8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:16.453152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Searching for a device in session 167 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:16.453152 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '34b8f077-0d36-4f4e-9225-e83978816ed8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:16.496588 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Object Instance<db49aa69-cf97-4002-a027-262f598da41b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:16.497659 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-859358347',display_name='tempest-TestMinimumBasicScenario-server-859358347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-859358347',id=61,image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQYP+V8aFByge7xp6cgO0POP+ecYlEeU6kAzd/PQCST0aF5OYTjbftUVxGTVTseCuc472pkiq4aQdIP5tmMv/GKtKfmNByGUfz8XuImX+jBpT4GF4lH1DDR7J470N+wA==',key_name='tempest-TestMinimumBasicScenario-1748400774',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:27Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-yfonxw7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:18:08Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=db49aa69-cf97-4002-a027-262f598da41b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:18:16.497892 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:16.498674 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:16.498828 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:18:16.499533 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:16.500000 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:16.500338 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:18:16.501947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:16.502138 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '708646a2-9917-53ca-93c4-a1611686e030', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:16.505145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:16.510654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:16.512991 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:16.514092 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95672d9b-67, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:16.514092 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95672d9b-67, col_values=(('qos', UUID('50a11c8c-3ac4-4762-9c95-df6f063c36bc')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:16.514092 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95672d9b-67, col_values=(('external_ids', {'iface-id': '95672d9b-6717-4879-bdbe-58e4d4af4a41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:2c:ff', 'vm-uuid': 'db49aa69-cf97-4002-a027-262f598da41b'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:16.514975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:16.516423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:16.525648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:16.526734 np0000001643 nova-compute[98269]: INFO os_vif [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67')
May 28 14:18:16.665765 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Object Instance<3a509dcf-af9c-4813-90a7-724d0adde626> lazy-loaded attributes: flavor,info_cache {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:16.921320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:16.949790 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:17.007112 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:17.027560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:17.082200 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-543502b6-208d-4ca3-ac39-0e2ce09c7ed5 req-7bfa8bd5-04c0-4b71-b7a8-9d56420375d7 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:17.082374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-543502b6-208d-4ca3-ac39-0e2ce09c7ed5 req-7bfa8bd5-04c0-4b71-b7a8-9d56420375d7 service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:17.082588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-543502b6-208d-4ca3-ac39-0e2ce09c7ed5 req-7bfa8bd5-04c0-4b71-b7a8-9d56420375d7 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:17.082730 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-543502b6-208d-4ca3-ac39-0e2ce09c7ed5 req-7bfa8bd5-04c0-4b71-b7a8-9d56420375d7 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:17.082866 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-543502b6-208d-4ca3-ac39-0e2ce09c7ed5 req-7bfa8bd5-04c0-4b71-b7a8-9d56420375d7 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] No waiting events found dispatching network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:17.083001 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-543502b6-208d-4ca3-ac39-0e2ce09c7ed5 req-7bfa8bd5-04c0-4b71-b7a8-9d56420375d7 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received unexpected event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 for instance with vm_state active and task_state reboot_started_hard.
May 28 14:18:17.168244 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:17.295365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:18:17.356225 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:17.364543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:17.365933 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:17.387992 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:17.389362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:17.457230 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:17.588477 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Updating instance_info_cache with network_info: [{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:17.633932 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for db49aa69-cf97-4002-a027-262f598da41b due to new event <LifecycleEvent: 1779977897.6333191, db49aa69-cf97-4002-a027-262f598da41b => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:18:17.634028 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977897.6333191, db49aa69-cf97-4002-a027-262f598da41b => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:17.634206 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] VM Resumed (Lifecycle Event)
May 28 14:18:17.635550 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:18:17.638463 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance rebooted successfully.
May 28 14:18:18.090531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-3a509dcf-af9c-4813-90a7-724d0adde626" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:18.099902 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:18.102470 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:18.102470 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Attaching volume 5233de9e-419e-46af-bd23-39b7d91edb5b to /dev/vdb
May 28 14:18:18.136988 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:18.139618 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:18.141974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:18.150791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:18:18.173471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:18.214576 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:18:18.215374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:18:18.223624 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:18:18.226462 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fe3b:10c8', 'fe80::fc16:3eff:fe55:de54', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fe37:2cff', 'fe80::f830:cfff:fea4:1adf', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:18:18.226462 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:18:18.226462 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:18:18.226462 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:18.226462 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Updating existing volume attachment record: 097a5f10-5671-4ab4-ab2c-e7efe12149cc {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:18:18.394053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Found WWN 330000000517d2e10 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:18:18.394331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.116s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:18.394563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] <== connect_volume: return (3117ms) {'type': 'block', 'scsi_wwn': '330000000517d2e10', 'path': '/dev/dm-4', 'multipath_id': '330000000517d2e10'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:18.394687 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000517d2e10', 'path': '/dev/dm-4', 'multipath_id': '330000000517d2e10'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:18:18.399718 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'flavor' on Instance uuid a2484ea1-95db-4db2-b76f-1c7a785663d6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:18.644910 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 14:18:18.646534 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977898.646306, db49aa69-cf97-4002-a027-262f598da41b => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:18.646648 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] VM Started (Lifecycle Event)
May 28 14:18:18.902461 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Attempting to attach volume 34b8f077-0d36-4f4e-9225-e83978816ed8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:18:18.903719 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:18:18.903719 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:18.903719 np0000001643 nova-compute[98269]:   <alias name="ua-34b8f077-0d36-4f4e-9225-e83978816ed8"/>
May 28 14:18:18.903719 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:18:18.903719 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:18.903719 np0000001643 nova-compute[98269]:   <serial>34b8f077-0d36-4f4e-9225-e83978816ed8</serial>
May 28 14:18:18.903719 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:18.903719 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:18:18.963134 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '33304aba-a509-4200-9824-e2aeb30f76d8', 'attached_at': '', 'detached_at': '', 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'serial': '5233de9e-419e-46af-bd23-39b7d91edb5b'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:18:18.965251 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:18:18.965635 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:18.965808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:18.966300 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:18.966613 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:18:18.978424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:18.979006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:18.979486 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:18.979691 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:18.980101 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:18.980346 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:18.991519 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:18.991519 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:18.995359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:18.995359 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b] added
May 28 14:18:19.006298 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:19.006298 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:19.006298 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:19.007808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b] added
May 28 14:18:19.007808 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:19.007808 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:19.007808 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:19.007808 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:19.007808 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:19.007808 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:19.007937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:19.008073 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:19.008198 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:19.105460 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance destroyed successfully.
May 28 14:18:19.105837 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:19.135733 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d2a6d4f6-5f66-4899-98e2-8ef1b37f127d req-a0100353-2c9c-4b96-8cb4-81df2b2d358c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:19.135937 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d2a6d4f6-5f66-4899-98e2-8ef1b37f127d req-a0100353-2c9c-4b96-8cb4-81df2b2d358c service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:19.136076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d2a6d4f6-5f66-4899-98e2-8ef1b37f127d req-a0100353-2c9c-4b96-8cb4-81df2b2d358c service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:19.136202 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d2a6d4f6-5f66-4899-98e2-8ef1b37f127d req-a0100353-2c9c-4b96-8cb4-81df2b2d358c service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:19.136321 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d2a6d4f6-5f66-4899-98e2-8ef1b37f127d req-a0100353-2c9c-4b96-8cb4-81df2b2d358c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] No waiting events found dispatching network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:19.136455 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-d2a6d4f6-5f66-4899-98e2-8ef1b37f127d req-a0100353-2c9c-4b96-8cb4-81df2b2d358c service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received unexpected event network-vif-plugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 for instance with vm_state active and task_state reboot_started_hard.
May 28 14:18:19.149433 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:19.155098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:19.155278 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:19.155379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:19.157084 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:19.158794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No VIF found with MAC fa:16:3e:37:2c:ff, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:18:19.159154 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:19.608521 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Object Instance<3a509dcf-af9c-4813-90a7-724d0adde626> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:19.609065 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:19.661552 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 14:18:19.670161 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d1d14d3-51ba-4457-a571-2495bbfc7852 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 13.872s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:19.829826 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:20.006853 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:20.008663 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:20.019905 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:20.019905 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:20.027440 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:20.027440 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.034346 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.041817 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.051273 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:20.057543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.057543 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.057543 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.057543 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.057543 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.057543 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.057543 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:20.057713 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.057713 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.057713 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.057713 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.057713 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.057713 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.057713 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:20.097269 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.40.100,3260]
May 28 14:18:20.097269 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.40.100,3260] successful.
May 28 14:18:20.097269 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.103549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.50.100,3260]
May 28 14:18:20.103549 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.50.100,3260] successful.
May 28 14:18:20.103549 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.109315 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.110611 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Object Instance<3a509dcf-af9c-4813-90a7-724d0adde626> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:20.111329 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2117625348',display_name='tempest-TestVolumeBootPattern-server-2117625348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2117625348',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOjnzKUnyd/+Jimau6uho+Mhj5qnJcDVSZD+VdO17tyeQeGBW/tRrN8+iVw62lQBPCn1EhDrRVmWtT/3rEwZLFowJ2xsZl5CyMTUDuGxK8yMSDMGQINvjUhK81UdqgZkA==',key_name='tempest-keypair-1558069538',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:32Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-dpbf0jq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=3a509dcf-af9c-4813-90a7-724d0adde626,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:18:20.111578 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:20.112196 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:20.112508 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:18:20.115011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:20.115247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6538970-47, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:20.116374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:20.116676 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:20.117814 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:20.122314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:20.122462 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9ba540b-2df7-4330-ae9b-fe82510cc9e9) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:20.122923 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:20.123320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:20.123707 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:20.125321 np0000001643 nova-compute[98269]: INFO os_vif [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47')
May 28 14:18:20.126665 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:18:20.127016 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:20.127141 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.128829 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('9', '-', '-', 0) found on session 168 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:20.128829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.134834 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:20.135041 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:20.135178 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:20.135249 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:20.136041 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('14', '-', '-', 0) found on session 169 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:20.136167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:20.142655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 168 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:20.142655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:20.150543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 169 and hctl ['14', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:20.545937 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:20.546094 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:20.546212 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:20.546305 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] No VIF found with MAC fa:16:3e:3b:10:c8, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:18:21.149848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 169 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:21.150245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:21.993933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found WWN 3300000000bf1afad for multipath device dm-5 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:18:21.994189 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:21.994871 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.868s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:21.995242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:18:21.995822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000000bf1afad', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000000bf1afad'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:21.995999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:18:21.996240 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000bf1afad', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000000bf1afad'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:18:21.998800 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:18:21.998975 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:18:21.999128 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:18:21.999978 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x71a75c72e120>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '33304aba-a509-4200-9824-e2aeb30f76d8', 'attached_at': '', 'detached_at': '', 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'serial': '5233de9e-419e-46af-bd23-39b7d91edb5b'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:18:22.000210 np0000001643 nova-compute[98269]: WARNING os_brick.encryptors.cryptsetup [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 28 14:18:22.000388 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98269) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 14:18:22.000537 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.cryptsetup [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] opening encrypted volume /dev/dm-5 {{(pid=98269) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:22.029999 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:22.030440 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '169')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:18:22.030440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '158')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:22.031436 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '159')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:22.032216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a77811d440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:18:22.032460 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:18:22.032740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 33000000063e6c7eb {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:18:22.078503 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 33304aba-a509-4200-9824-e2aeb30f76d8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:22.094733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5b376fcf-91fa-4e96-ab3c-3b0e6f26de28 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.492s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:22.096124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:22.147898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:22.191933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:18:22.192286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:18:22.192985 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:18:22.203336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:18:22.203533 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:18:22.214167 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:22.246109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260]
May 28 14:18:22.246109 np0000001643 nova-compute[98269]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260] successful.
May 28 14:18:22.246109 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:22.261527 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:22.272012 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:22.300590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260]
May 28 14:18:22.300590 np0000001643 nova-compute[98269]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260] successful.
May 28 14:18:22.300590 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:22.319356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:22.319541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:22.319655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (2192ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:22.319837 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:18:22.324176 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Start _get_guest_xml network_info=[{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '12b9042e-b183-481c-a1b1-01cd3f6a20c2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '3a509dcf-af9c-4813-90a7-724d0adde626', 'attached_at': '', 'detached_at': '', 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'serial': '15353554-31b4-4331-80bb-ec6b3261863d'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:18:22.326044 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:18:22.326965 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2117625348', uuid='3a509dcf-af9c-4813-90a7-724d0adde626'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977902.326709) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:18:22.328096 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:18:22.328549 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:18:22.330892 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:18:22.331056 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:18:22.332022 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:18:22.332257 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:18:22.332392 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:18:22.332541 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:18:22.332697 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:18:22.332773 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:18:22.332854 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:18:22.332980 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:18:22.333070 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:18:22.333167 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:18:22.333258 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:18:22.333359 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:18:22.333506 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:22.581790 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Attempting to attach volume 5233de9e-419e-46af-bd23-39b7d91edb5b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:18:22.583086 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:18:22.583086 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:22.583086 np0000001643 nova-compute[98269]:   <alias name="ua-5233de9e-419e-46af-bd23-39b7d91edb5b"/>
May 28 14:18:22.583086 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 28 14:18:22.583086 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:22.583086 np0000001643 nova-compute[98269]:   <serial>5233de9e-419e-46af-bd23-39b7d91edb5b</serial>
May 28 14:18:22.583086 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:22.583086 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:18:22.835299 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Object Instance<3a509dcf-af9c-4813-90a7-724d0adde626> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:22.848321 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:22.944954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.config --force-share --output=json" returned: 0 in 0.096s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:22.945312 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:22.945572 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "/opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:22.946061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "/opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:22.946478 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:18:22.946833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:22.947119 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:24.234270 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:24.234684 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:24.235731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:24.235854 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:55:de:54, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:18:24.644944 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005738119998568436 future=<Future at 0x71a75c4f4980 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:24.645115 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:24.645199 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.4922434720001547 future=<Future at 0x71a75c1dd6a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:24.645275 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.4921634540000923 future=<Future at 0x71a75c1dd6a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:24.763442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:24.763442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:24.830582 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:25.103294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.156s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:25.103486 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:18:25.116474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:25.116994 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:25.117427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:25.117656 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:25.118032 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:25.118221 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:25.125237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:25.129671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:25.129671 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:25.135039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:25.135039 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:25.143464 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d] added
May 28 14:18:25.143464 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:25.143464 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:25.143464 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:25.143464 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:25.143464 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:25.143464 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:25.143464 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:25.143464 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:25.143711 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:25.146286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d] added
May 28 14:18:25.146286 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:25.146286 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:25.146286 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:25.146286 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:25.146286 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:25.146286 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:25.146490 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:25.146700 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:25.146883 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:25.265217 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Detaching volume 34b8f077-0d36-4f4e-9225-e83978816ed8
May 28 14:18:25.309430 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Attempting to driver detach volume 34b8f077-0d36-4f4e-9225-e83978816ed8 from mountpoint /dev/vdb
May 28 14:18:25.313797 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Found disk vdb by alias ua-34b8f077-0d36-4f4e-9225-e83978816ed8 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:18:25.315170 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Found disk vdb by alias ua-34b8f077-0d36-4f4e-9225-e83978816ed8 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:18:25.315314 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Attempting to detach device vdb from instance a2484ea1-95db-4db2-b76f-1c7a785663d6 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:18:25.315657 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:18:25.315657 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:25.315657 np0000001643 nova-compute[98269]:   <alias name="ua-34b8f077-0d36-4f4e-9225-e83978816ed8"/>
May 28 14:18:25.315657 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:18:25.315657 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:25.315657 np0000001643 nova-compute[98269]:   <serial>34b8f077-0d36-4f4e-9225-e83978816ed8</serial>
May 28 14:18:25.315657 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:18:25.315657 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:25.315657 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:18:25.321641 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully detached device vdb from instance a2484ea1-95db-4db2-b76f-1c7a785663d6 from the persistent domain config.
May 28 14:18:25.321891 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] (1/8): Attempting to detach device vdb with device alias ua-34b8f077-0d36-4f4e-9225-e83978816ed8 from instance a2484ea1-95db-4db2-b76f-1c7a785663d6 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:18:25.322175 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:18:25.322175 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:25.322175 np0000001643 nova-compute[98269]:   <alias name="ua-34b8f077-0d36-4f4e-9225-e83978816ed8"/>
May 28 14:18:25.322175 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-4"/>
May 28 14:18:25.322175 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:25.322175 np0000001643 nova-compute[98269]:   <serial>34b8f077-0d36-4f4e-9225-e83978816ed8</serial>
May 28 14:18:25.322175 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:18:25.322175 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:25.322175 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:18:25.797747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-95ea5f41-ee30-4ad4-bf4f-f9b5d9dc03df tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.697s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:25.856968 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977905.856622, a2484ea1-95db-4db2-b76f-1c7a785663d6 => ua-34b8f077-0d36-4f4e-9225-e83978816ed8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:18:25.858181 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-34b8f077-0d36-4f4e-9225-e83978816ed8 for instance a2484ea1-95db-4db2-b76f-1c7a785663d6 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:18:25.861542 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully detached device vdb from instance a2484ea1-95db-4db2-b76f-1c7a785663d6 from the live domain config.
May 28 14:18:25.862628 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:18:25.862890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34b8f077-0d36-4f4e-9225-e83978816ed8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:25.863007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:26.144118 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:26.149134 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:26.159403 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:26.159403 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:26.164599 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:26.164599 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.174135 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.179092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.193595 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.193595 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.193595 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.193595 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.193595 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.193595 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.193595 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.193595 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:26.194077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.194077 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.194077 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.194077 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.194077 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.194077 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.194077 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.194077 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:26.194302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.194302 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.194302 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.194302 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.194302 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.194302 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.194302 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.194302 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:26.194633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.194633 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.194633 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.194633 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.194633 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.194633 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.194633 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.194633 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:26.236005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260]
May 28 14:18:26.236005 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260] successful.
May 28 14:18:26.236005 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.248186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.248808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260]
May 28 14:18:26.248808 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260] successful.
May 28 14:18:26.248808 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.270967 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.271575 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:26.271575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:26.272359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('8', '-', '-', 0) found on session 171 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:26.272469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:26.280121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:26.288470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 171 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:26.288645 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.306138 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:26.306383 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:26.306652 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:26.306751 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:26.307628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('15', '-', '-', 0) found on session 172 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:26.307729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:26.322899 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 172 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:26.322899 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:27.017914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:27.018065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:27.119512 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:18:27.520064 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Detaching volume 5233de9e-419e-46af-bd23-39b7d91edb5b
May 28 14:18:27.554030 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Attempting to driver detach volume 5233de9e-419e-46af-bd23-39b7d91edb5b from mountpoint /dev/vdb
May 28 14:18:27.584630 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '33304aba-a509-4200-9824-e2aeb30f76d8', 'attached_at': '', 'detached_at': '', 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'serial': '5233de9e-419e-46af-bd23-39b7d91edb5b'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:18:27.587880 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-5233de9e-419e-46af-bd23-39b7d91edb5b {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:18:27.588855 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-5233de9e-419e-46af-bd23-39b7d91edb5b {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:18:27.588947 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Attempting to detach device vdb from instance 33304aba-a509-4200-9824-e2aeb30f76d8 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:18:27.589405 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:18:27.589405 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:27.589405 np0000001643 nova-compute[98269]:   <alias name="ua-5233de9e-419e-46af-bd23-39b7d91edb5b"/>
May 28 14:18:27.589405 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 28 14:18:27.589405 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:27.589405 np0000001643 nova-compute[98269]:   <serial>5233de9e-419e-46af-bd23-39b7d91edb5b</serial>
May 28 14:18:27.589405 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:18:27.589405 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:27.589405 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:18:27.594895 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 33304aba-a509-4200-9824-e2aeb30f76d8 from the persistent domain config.
May 28 14:18:27.595115 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] (1/8): Attempting to detach device vdb with device alias ua-5233de9e-419e-46af-bd23-39b7d91edb5b from instance 33304aba-a509-4200-9824-e2aeb30f76d8 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:18:27.595347 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:18:27.595347 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:27.595347 np0000001643 nova-compute[98269]:   <alias name="ua-5233de9e-419e-46af-bd23-39b7d91edb5b"/>
May 28 14:18:27.595347 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 28 14:18:27.595347 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:27.595347 np0000001643 nova-compute[98269]:   <serial>5233de9e-419e-46af-bd23-39b7d91edb5b</serial>
May 28 14:18:27.595347 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:18:27.595347 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:27.595347 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:18:28.034861 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977908.034505, 33304aba-a509-4200-9824-e2aeb30f76d8 => ua-5233de9e-419e-46af-bd23-39b7d91edb5b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:18:28.036077 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5233de9e-419e-46af-bd23-39b7d91edb5b for instance 33304aba-a509-4200-9824-e2aeb30f76d8 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:18:28.038284 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 33304aba-a509-4200-9824-e2aeb30f76d8 from the live domain config.
May 28 14:18:28.039610 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:18:28.039846 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:18:28.040000 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:18:28.040559 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x71a7845a4800>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '33304aba-a509-4200-9824-e2aeb30f76d8', 'attached_at': '', 'detached_at': '', 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'serial': '5233de9e-419e-46af-bd23-39b7d91edb5b'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:18:28.040683 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.cryptsetup [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] closing encrypted volume /dev/dm-6 {{(pid=98269) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 28 14:18:28.069667 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:18:28.069929 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:28.070106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:28.134482 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 33000000063e6c7eb for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:18:28.134717 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:28.134868 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (5188ms) {'type': 'block', 'scsi_wwn': '33000000063e6c7eb', 'path': '/dev/dm-0', 'multipath_id': '33000000063e6c7eb'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:28.134971 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000063e6c7eb', 'path': '/dev/dm-0', 'multipath_id': '33000000063e6c7eb'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:18:28.135857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.272s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:28.135857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34b8f077-0d36-4f4e-9225-e83978816ed8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:18:28.135857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:18:28.138161 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0006940649996067805 future=<Future at 0x71a75c1dd6a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:28.138230 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:28.138878 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779977893.1373816, 3a509dcf-af9c-4813-90a7-724d0adde626 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:28.140273 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] VM Stopped (Lifecycle Event)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.163222 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8 (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.166114 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '172')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', '166')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8', '167')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a77811e020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8'): ({'sdh'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Removing multipathed devices sdg, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:18:28.166114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Flush multipath device 330000000517d2e10 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:18:28.201042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:28.249027 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:28.300673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:18:28.300673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:18:28.300673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:18:28.314242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:18:28.314813 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:18:28.325612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.365501 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.40.100,3260]
May 28 14:18:28.365501 np0000001643 nova-compute[98269]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.40.100,3260] successful.
May 28 14:18:28.365501 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.381387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.391512 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.420753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.50.100,3260]
May 28 14:18:28.420753 np0000001643 nova-compute[98269]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-34b8f077-0d36-4f4e-9225-e83978816ed8, portal: 192.168.50.100,3260] successful.
May 28 14:18:28.420753 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.441473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.441473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:28.441473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] <== disconnect_volume: return (2576ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:28.441473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:18:28.441473 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.371s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:28.441766 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5233de9e-419e-46af-bd23-39b7d91edb5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:18:28.441766 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:18:28.472026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.472026 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.472026 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.472026 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.472026 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:28.472026 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.472026 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.472026 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:28.472331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.472331 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:28.472331 np0000001643 nova-compute[98269]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.472331 np0000001643 nova-compute[98269]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b (non-flash)
May 28 14:18:28.472331 np0000001643 nova-compute[98269]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:28.472331 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.472331 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:28.472331 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:28.472577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '172')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:18:28.472577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '168')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:28.473571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b', '169')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:28.474424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801947c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:18:28.474670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Removing multipathed devices sdi, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:18:28.474909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flush multipath device 3300000000bf1afad {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:18:28.509865 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:28.559941 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:28.594848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if SCSI volumes sdi, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:18:28.595002 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] SCSI volumes sdi, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:18:28.596160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if device paths {'sdi', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:18:28.606590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Device paths {'sdi', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:18:28.606731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:18:28.619878 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.641559 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2117625348',display_name='tempest-TestVolumeBootPattern-server-2117625348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2117625348',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOjnzKUnyd/+Jimau6uho+Mhj5qnJcDVSZD+VdO17tyeQeGBW/tRrN8+iVw62lQBPCn1EhDrRVmWtT/3rEwZLFowJ2xsZl5CyMTUDuGxK8yMSDMGQINvjUhK81UdqgZkA==',key_name='tempest-keypair-1558069538',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:32Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-dpbf0jq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=3a509dcf-af9c-4813-90a7-724d0adde626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:18:28.641766 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:28.642408 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:28.643695 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:28.644167 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:28.653313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.40.100,3260]
May 28 14:18:28.653313 np0000001643 nova-compute[98269]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.40.100,3260] successful.
May 28 14:18:28.653313 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.671056 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.681922 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.716209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.50.100,3260]
May 28 14:18:28.716209 np0000001643 nova-compute[98269]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-5233de9e-419e-46af-bd23-39b7d91edb5b, portal: 192.168.50.100,3260] successful.
May 28 14:18:28.716209 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.733833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:28.734898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:28.735030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== disconnect_volume: return (665ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:28.735153 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:18:28.984610 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'flavor' on Instance uuid a2484ea1-95db-4db2-b76f-1c7a785663d6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:29.146342 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Object Instance<3a509dcf-af9c-4813-90a7-724d0adde626> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:18:29.147488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] End _get_guest_xml xml=<domain type="qemu">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <uuid>3a509dcf-af9c-4813-90a7-724d0adde626</uuid>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <name>instance-0000003e</name>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-2117625348</nova:name>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:18:22</nova:creationTime>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         <nova:port uuid="a6538970-472a-467f-81d8-972e8c784834">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <system>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <entry name="serial">3a509dcf-af9c-4813-90a7-724d0adde626</entry>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <entry name="uuid">3a509dcf-af9c-4813-90a7-724d0adde626</entry>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </system>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <os>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   </os>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <features>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   </features>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   <devices>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/disk.config"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <alias name="ua-15353554-31b4-4331-80bb-ec6b3261863d"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <serial>15353554-31b4-4331-80bb-ec6b3261863d</serial>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:99:10:1d"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <target dev="tapa6538970-47"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </interface>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626/console.log" append="off"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </serial>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <video>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </video>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </rng>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:   </devices>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]: </domain>
May 28 14:18:29.147488 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:18:29.149427 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:18:29.149427 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2117625348',display_name='tempest-TestVolumeBootPattern-server-2117625348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2117625348',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOjnzKUnyd/+Jimau6uho+Mhj5qnJcDVSZD+VdO17tyeQeGBW/tRrN8+iVw62lQBPCn1EhDrRVmWtT/3rEwZLFowJ2xsZl5CyMTUDuGxK8yMSDMGQINvjUhK81UdqgZkA==',key_name='tempest-keypair-1558069538',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:32Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-dpbf0jq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=3a509dcf-af9c-4813-90a7-724d0adde626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:18:29.149427 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:29.149427 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:29.149427 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:18:29.151736 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.151736 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:29.151736 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:18:29.154781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.154781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd75b1ac8-11b2-5349-a160-0035f44efe69', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:29.154781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.154781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:29.155876 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.157908 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.159032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6538970-47, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:29.159032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6538970-47, col_values=(('qos', UUID('95fa1f81-ebae-403e-9900-719652cb3fb6')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:29.159032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6538970-47, col_values=(('external_ids', {'iface-id': 'a6538970-472a-467f-81d8-972e8c784834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:10:1d', 'vm-uuid': '3a509dcf-af9c-4813-90a7-724d0adde626'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:29.160574 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.160574 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:29.165178 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.166011 np0000001643 nova-compute[98269]: INFO os_vif [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47')
May 28 14:18:29.292102 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 33304aba-a509-4200-9824-e2aeb30f76d8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:29.554661 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.584718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.681844 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.721960 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-34699951-7cd1-48bc-ad79-bbf44cdc9b20 req-137f572e-4c11-41cd-9a33-0c330f2375f1 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:29.722156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34699951-7cd1-48bc-ad79-bbf44cdc9b20 req-137f572e-4c11-41cd-9a33-0c330f2375f1 service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:29.722331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34699951-7cd1-48bc-ad79-bbf44cdc9b20 req-137f572e-4c11-41cd-9a33-0c330f2375f1 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:29.722482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-34699951-7cd1-48bc-ad79-bbf44cdc9b20 req-137f572e-4c11-41cd-9a33-0c330f2375f1 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:29.724752 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-34699951-7cd1-48bc-ad79-bbf44cdc9b20 req-137f572e-4c11-41cd-9a33-0c330f2375f1 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] No waiting events found dispatching network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:29.724933 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-34699951-7cd1-48bc-ad79-bbf44cdc9b20 req-137f572e-4c11-41cd-9a33-0c330f2375f1 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received unexpected event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 for instance with vm_state stopped and task_state powering-on.
May 28 14:18:29.831509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.903005 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.904484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.906828 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.927904 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:29.989065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ed82726-dae3-477d-8d2d-fe0ef78d2c7e tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.226s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:30.279778 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977910.2794101, 3a509dcf-af9c-4813-90a7-724d0adde626 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:30.279910 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] VM Resumed (Lifecycle Event)
May 28 14:18:30.281381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:18:30.285194 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance rebooted successfully.
May 28 14:18:30.304856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0ccf7b6d-e58e-47a1-a4a6-68141050ed05 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.287s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:30.782574 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:30.788855 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:30.827439 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:30.827606 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:18:31.291763 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 14:18:31.293070 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977911.2928898, 3a509dcf-af9c-4813-90a7-724d0adde626 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:31.293181 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] VM Started (Lifecycle Event)
May 28 14:18:31.332893 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:18:31.333274 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:18:31.378739 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:31.378901 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:31.379232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:31.379442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:31.379641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:31.382422 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Terminating instance
May 28 14:18:31.792226 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:31.792746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:31.792746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:31.792746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:31.792746 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] No waiting events found dispatching network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:31.792935 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received unexpected event network-vif-plugged-a6538970-472a-467f-81d8-972e8c784834 for instance with vm_state stopped and task_state powering-on.
May 28 14:18:31.792935 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-changed-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:31.793043 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Refreshing instance network info cache due to event network-changed-2d3a9b73-2098-4eb5-b25e-16dea720a0a0. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:31.793157 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] Acquiring lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:31.793229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] Acquired lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:31.793358 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Refreshing network info cache for port 2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:31.798830 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:31.800674 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:31.800844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:31.800947 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:99:10:1d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:18:31.801248 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d772affa-99a7-4a8a-a38f-2788a86448e3 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:31.802654 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:31.888270 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:18:31.891682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:31.891682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:31.891821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:31.895511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:31.895511 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:31.895511 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Terminating instance
May 28 14:18:31.908911 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:31.912978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:31.934707 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:31.940576 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:31.966703 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:31.967739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.220314 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Instance destroyed successfully.
May 28 14:18:32.220822 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'resources' on Instance uuid 33304aba-a509-4200-9824-e2aeb30f76d8 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:32.301476 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:32.309038 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 14:18:32.311759 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999712918000114 future=<Future at 0x71a75c2645f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:32.312143 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999037299000065 future=<Future at 0x71a75c2645f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:32.312341 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998820136000177 future=<Future at 0x71a75c2645f0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:32.398122 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:18:32.431503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.433673 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.457109 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.606149 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.611295 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2806e3f2-8e3d-4d85-9700-c1e89fc5be66 req-53d49172-f0d5-44d2-847a-86d4da222f34 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-vif-unplugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:32.611295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2806e3f2-8e3d-4d85-9700-c1e89fc5be66 req-53d49172-f0d5-44d2-847a-86d4da222f34 service nova] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:32.611295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2806e3f2-8e3d-4d85-9700-c1e89fc5be66 req-53d49172-f0d5-44d2-847a-86d4da222f34 service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:32.611295 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2806e3f2-8e3d-4d85-9700-c1e89fc5be66 req-53d49172-f0d5-44d2-847a-86d4da222f34 service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:32.611565 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2806e3f2-8e3d-4d85-9700-c1e89fc5be66 req-53d49172-f0d5-44d2-847a-86d4da222f34 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] No waiting events found dispatching network-vif-unplugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:32.611757 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2806e3f2-8e3d-4d85-9700-c1e89fc5be66 req-53d49172-f0d5-44d2-847a-86d4da222f34 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-vif-unplugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:32.616603 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.660966 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:32.723333 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1714326180',display_name='tempest-TestEncryptedCinderVolumes-server-1714326180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1714326180',id=64,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGym+EZspxmn3ddiGygTcqrshkX+w7+nMxBplLB86PUlegQ4fHMf307Zbmu55jYpjMhqr0GcE8qD5Guw0x4Q08nlwEXSTg0mkplw0YWLg/HebS01kiCupYJruGGA7Zrz+w==',key_name='tempest-keypair-804152696',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:37Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-lqbqlas5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=33304aba-a509-4200-9824-e2aeb30f76d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:18:32.723617 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "558f378c-72ec-480e-bdfe-4ba38327d19b", "address": "fa:16:3e:55:de:54", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap558f378c-72", "ovs_interfaceid": "558f378c-72ec-480e-bdfe-4ba38327d19b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:32.724481 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:de:54,bridge_name='br-int',has_traffic_filtering=True,id=558f378c-72ec-480e-bdfe-4ba38327d19b,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558f378c-72') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:32.725080 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:de:54,bridge_name='br-int',has_traffic_filtering=True,id=558f378c-72ec-480e-bdfe-4ba38327d19b,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558f378c-72') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:18:32.726639 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.727542 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap558f378c-72, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:32.728538 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.730259 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:32.735328 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.735899 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.736099 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4342bc6f-7abc-4840-92cf-62ef1a8d1b7f) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:32.736934 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.737569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:32.741925 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999707488999775 future=<Future at 0x71a75c3d79b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:32.743575 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:32.744821 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Instance destroyed successfully.
May 28 14:18:32.744821 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'resources' on Instance uuid a2484ea1-95db-4db2-b76f-1c7a785663d6 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:32.747116 np0000001643 nova-compute[98269]: INFO os_vif [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:de:54,bridge_name='br-int',has_traffic_filtering=True,id=558f378c-72ec-480e-bdfe-4ba38327d19b,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558f378c-72')
May 28 14:18:32.747116 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Deleting instance files /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8_del
May 28 14:18:32.751342 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Deletion of /opt/stack/data/nova/instances/33304aba-a509-4200-9824-e2aeb30f76d8_del complete
May 28 14:18:32.843902 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updated VIF entry in instance network info cache for port 2d3a9b73-2098-4eb5-b25e-16dea720a0a0. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:18:32.844226 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updating instance_info_cache with network_info: [{"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:33.243408 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2def2b7b-8fe8-4953-8141-1d089c1d6234 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Get console output
May 28 14:18:33.246874 np0000001643 nova-compute[98269]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 14:18:33.250244 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-671631707',display_name='tempest-TestStampPattern-server-671631707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-teststamppattern-server-671631707',id=63,image_ref='8b63918a-712c-412b-a148-1d958d5bc11b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVGtHnRGjb57xlZUEhRDuiB+xXkZ7jN9FPaNseGT7FSrTZcPTjhLnrQvMrvAtYZ5MnPjOEKth0jcuHVqpUUaORV+U1PWfUzZ8KcOJkHdmxykCwqNz8bU9QFZM3bOMj9fA==',key_name='tempest-TestStampPattern-255717967',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:33Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c345e5241bd40c693ea2c6ccaf6c8f7',ramdisk_id='',reservation_id='r-6afs2n90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4',image_min_disk='1',image_min_ram='0',image_owner_id='4c345e5241bd40c693ea2c6ccaf6c8f7',image_owner_project_name='tempest-TestStampPattern-744679963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-744679963-project-member',image_user_id='c98b8f4e148b4557bd70bd6a755850a2',owner_project_name='tempest-TestStampPattern-744679963',owner_user_name='tempest-TestStampPattern-744679963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:17:33Z,user_data=None,user_id='c98b8f4e148b4557bd70bd6a755850a2',uuid=a2484ea1-95db-4db2-b76f-1c7a785663d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:18:33.250518 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converting VIF {"id": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "address": "fa:16:3e:3b:10:c8", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3a9b73-20", "ovs_interfaceid": "2d3a9b73-2098-4eb5-b25e-16dea720a0a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:33.250981 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:10:c8,bridge_name='br-int',has_traffic_filtering=True,id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3a9b73-20') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:33.251174 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:10:c8,bridge_name='br-int',has_traffic_filtering=True,id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3a9b73-20') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:18:33.252926 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:33.252926 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d3a9b73-20, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:33.254914 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:33.255921 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:33.256155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed14817d-8788-4653-b260-eddcff41ab0a) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:33.257703 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:33.258086 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 14:18:33.259274 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:18:33.259437 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:18:33.259836 np0000001643 nova-compute[98269]: INFO os_vif [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:10:c8,bridge_name='br-int',has_traffic_filtering=True,id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3a9b73-20')
May 28 14:18:33.259940 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:18:33.260123 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:33.261681 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Deleting instance files /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6_del
May 28 14:18:33.262457 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Deletion of /opt/stack/data/nova/instances/a2484ea1-95db-4db2-b76f-1c7a785663d6_del complete
May 28 14:18:33.317104 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:33.333081 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:33.333507 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:18:33.333760 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:33.346178 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-30dd855e-4453-4db1-b63e-da7021002367 req-1be472e4-3dcc-48c7-8c2d-28d64860ab37 service nova] Releasing lock "refresh_cache-a2484ea1-95db-4db2-b76f-1c7a785663d6" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:33.767434 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 14:18:33.767930 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:18:33.768079 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:18:33.768161 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:18:33.768651 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:33.830681 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:33.839836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:33.840115 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:33.840168 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:33.840338 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:18:33.870525 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-vif-unplugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:33.870818 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:33.870949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:33.871079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:33.871198 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] No waiting events found dispatching network-vif-unplugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:33.871314 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-vif-unplugged-558f378c-72ec-480e-bdfe-4ba38327d19b for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:33.871414 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-vif-unplugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:33.871554 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] Acquiring lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:33.871755 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:33.871800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] Lock "33304aba-a509-4200-9824-e2aeb30f76d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:33.871883 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] No waiting events found dispatching network-vif-unplugged-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:33.871980 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-vif-unplugged-558f378c-72ec-480e-bdfe-4ba38327d19b for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:33.872083 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Received event network-vif-deleted-558f378c-72ec-480e-bdfe-4ba38327d19b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:33.872199 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Neutron deleted interface 558f378c-72ec-480e-bdfe-4ba38327d19b; detaching it from the instance and deleting it from the info cache
May 28 14:18:33.873622 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd7db1ab-c512-4b1a-8df6-639c360a66b7 req-c8c43a79-77f7-4678-a708-dc062551fc5c service nova] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Detach interface failed, port_id=558f378c-72ec-480e-bdfe-4ba38327d19b, reason: Instance 33304aba-a509-4200-9824-e2aeb30f76d8 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:18:34.113375 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cb167262-73ae-43aa-840e-15d7ac5738b2 req-7f0805cb-267c-4e7b-972d-d7fc337ddff7 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-vif-deleted-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:34.113524 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-cb167262-73ae-43aa-840e-15d7ac5738b2 req-7f0805cb-267c-4e7b-972d-d7fc337ddff7 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Neutron deleted interface 2d3a9b73-2098-4eb5-b25e-16dea720a0a0; detaching it from the instance and deleting it from the info cache
May 28 14:18:34.115066 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-cb167262-73ae-43aa-840e-15d7ac5738b2 req-7f0805cb-267c-4e7b-972d-d7fc337ddff7 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Detach interface failed, port_id=2d3a9b73-2098-4eb5-b25e-16dea720a0a0, reason: Instance a2484ea1-95db-4db2-b76f-1c7a785663d6 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:18:34.242175 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:34.570658 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:34.658177 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-463d38a2-3f4a-436f-b667-9c560b982daf req-e991dcb1-013d-49e0-828d-1754367380f9 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-vif-unplugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:34.658870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-463d38a2-3f4a-436f-b667-9c560b982daf req-e991dcb1-013d-49e0-828d-1754367380f9 service nova] Acquiring lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:34.659020 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-463d38a2-3f4a-436f-b667-9c560b982daf req-e991dcb1-013d-49e0-828d-1754367380f9 service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:34.659124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-463d38a2-3f4a-436f-b667-9c560b982daf req-e991dcb1-013d-49e0-828d-1754367380f9 service nova] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:34.659243 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-463d38a2-3f4a-436f-b667-9c560b982daf req-e991dcb1-013d-49e0-828d-1754367380f9 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] No waiting events found dispatching network-vif-unplugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:34.659344 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-463d38a2-3f4a-436f-b667-9c560b982daf req-e991dcb1-013d-49e0-828d-1754367380f9 service nova] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Received event network-vif-unplugged-2d3a9b73-2098-4eb5-b25e-16dea720a0a0 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:34.743894 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Took 1.48 seconds to deallocate network for instance.
May 28 14:18:34.833194 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:34.892600 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:18:34.893998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:34.985373 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:34.985745 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:35.073302 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Took 1.30 seconds to deallocate network for instance.
May 28 14:18:35.075974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:35.088014 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:35.198641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:35.200034 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:35.251113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:35.251359 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:35.301131 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:35.301496 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:18:35.303659 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:18:35.304513 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:35.357802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:35.358322 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12578MB free_disk=72.68322372436523GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:18:35.358485 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:35.377946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:35.378178 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:35.378416 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:35.378561 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:35.378677 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:35.381277 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Terminating instance
May 28 14:18:35.543420 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:18:35.543665 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:18:35.582495 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:35.885276 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:18:35.913641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:35.915792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:35.930457 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:35.933261 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:35.950087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:35.954793 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:36.031641 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-76a5214f-da65-42ed-8df8-5b77c355be8d req-19a3a2e4-e83c-49db-8d68-fc32b6ae49f9 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:36.031830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-76a5214f-da65-42ed-8df8-5b77c355be8d req-19a3a2e4-e83c-49db-8d68-fc32b6ae49f9 service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:36.032030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-76a5214f-da65-42ed-8df8-5b77c355be8d req-19a3a2e4-e83c-49db-8d68-fc32b6ae49f9 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:36.032145 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-76a5214f-da65-42ed-8df8-5b77c355be8d req-19a3a2e4-e83c-49db-8d68-fc32b6ae49f9 service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:36.032285 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-76a5214f-da65-42ed-8df8-5b77c355be8d req-19a3a2e4-e83c-49db-8d68-fc32b6ae49f9 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] No waiting events found dispatching network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:36.032390 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-76a5214f-da65-42ed-8df8-5b77c355be8d req-19a3a2e4-e83c-49db-8d68-fc32b6ae49f9 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:36.046228 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:18:36.204574 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999549405999915 future=<Future at 0x71a78014d7c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:36.205600 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Instance destroyed successfully.
May 28 14:18:36.206085 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid 3a509dcf-af9c-4813-90a7-724d0adde626 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:36.554413 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.303s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:36.555987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.196s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:36.603247 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deleted allocations for instance 33304aba-a509-4200-9824-e2aeb30f76d8
May 28 14:18:36.708557 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2117625348',display_name='tempest-TestVolumeBootPattern-server-2117625348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2117625348',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOjnzKUnyd/+Jimau6uho+Mhj5qnJcDVSZD+VdO17tyeQeGBW/tRrN8+iVw62lQBPCn1EhDrRVmWtT/3rEwZLFowJ2xsZl5CyMTUDuGxK8yMSDMGQINvjUhK81UdqgZkA==',key_name='tempest-keypair-1558069538',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:32Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-dpbf0jq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=3a509dcf-af9c-4813-90a7-724d0adde626,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:18:36.708793 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "a6538970-472a-467f-81d8-972e8c784834", "address": "fa:16:3e:99:10:1d", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6538970-47", "ovs_interfaceid": "a6538970-472a-467f-81d8-972e8c784834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:36.709421 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:36.709662 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:18:36.710933 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:36.711182 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6538970-47, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:36.712150 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:36.712909 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:36.712973 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:36.713599 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:36.713721 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95fa1f81-ebae-403e-9900-719652cb3fb6) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:36.714134 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:36.714560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:36.714774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:36.716402 np0000001643 nova-compute[98269]: INFO os_vif [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:10:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6538970-472a-467f-81d8-972e8c784834,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6538970-47')
May 28 14:18:36.717832 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:18:36.718176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:36.718323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:36.718662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:36.719005 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15353554-31b4-4331-80bb-ec6b3261863d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:18:36.719148 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:18:36.742171 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:36.742171 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:36.742171 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:36.742171 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:36.742171 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:36.742360 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:36.742360 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:36.742360 np0000001643 nova-compute[98269]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:36.742360 np0000001643 nova-compute[98269]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d (non-flash)
May 28 14:18:36.742360 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:36.742520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '172')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:18:36.742520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '171')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:36.743305 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d', '172')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:18:36.743920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801eb240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'): ({'sdj'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:18:36.744095 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sdj, sdc {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:18:36.744323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 33000000063e6c7eb {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:18:36.801768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:36.857106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:18:36.893723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sdj, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:18:36.893867 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sdj, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:18:36.894740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sdj', 'sdc'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:18:36.905302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sdj', 'sdc'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:18:36.905522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:18:36.915109 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:36.944488 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260]
May 28 14:18:36.944488 np0000001643 nova-compute[98269]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.40.100,3260] successful.
May 28 14:18:36.944488 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:36.957008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:36.967239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:36.996322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260]
May 28 14:18:36.996322 np0000001643 nova-compute[98269]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-15353554-31b4-4331-80bb-ec6b3261863d, portal: 192.168.50.100,3260] successful.
May 28 14:18:36.996322 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:37.008753 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:37.008939 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:37.009085 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (290ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:37.009244 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:18:37.009549 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Deleting instance files /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626_del
May 28 14:18:37.010068 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Deletion of /opt/stack/data/nova/instances/3a509dcf-af9c-4813-90a7-724d0adde626_del complete
May 28 14:18:37.515858 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Took 1.63 seconds to destroy the instance on the hypervisor.
May 28 14:18:37.516492 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:18:37.516793 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:18:37.516915 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:18:37.517300 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:37.573038 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:37.611042 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-34972538-66bb-4b2d-8957-46f999d8fe74 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "33304aba-a509-4200-9824-e2aeb30f76d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.232s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:37.615532 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:18:37.615667 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance db49aa69-cf97-4002-a027-262f598da41b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:18:37.615778 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 3a509dcf-af9c-4813-90a7-724d0adde626 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:18:37.615919 np0000001643 nova-compute[98269]: WARNING nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance a2484ea1-95db-4db2-b76f-1c7a785663d6 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 28 14:18:37.769125 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:37.769335 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:37.982519 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f989f822-1af0-4522-873e-a3f0c4339398 req-93b2caa1-4c9e-4b2a-a3d2-ba99ca9a6b03 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-deleted-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:37.983674 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-f989f822-1af0-4522-873e-a3f0c4339398 req-93b2caa1-4c9e-4b2a-a3d2-ba99ca9a6b03 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Neutron deleted interface a6538970-472a-467f-81d8-972e8c784834; detaching it from the instance and deleting it from the info cache
May 28 14:18:37.985062 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f989f822-1af0-4522-873e-a3f0c4339398 req-93b2caa1-4c9e-4b2a-a3d2-ba99ca9a6b03 service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Detach interface failed, port_id=a6538970-472a-467f-81d8-972e8c784834, reason: Instance 3a509dcf-af9c-4813-90a7-724d0adde626 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:18:38.095927 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9e77ce0d-83d8-4e69-9951-1f34c4d6c132 req-3f994688-726f-498e-a0e7-0b98b8de9f1c service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:38.096085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e77ce0d-83d8-4e69-9951-1f34c4d6c132 req-3f994688-726f-498e-a0e7-0b98b8de9f1c service nova] Acquiring lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:38.096324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e77ce0d-83d8-4e69-9951-1f34c4d6c132 req-3f994688-726f-498e-a0e7-0b98b8de9f1c service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:38.096776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9e77ce0d-83d8-4e69-9951-1f34c4d6c132 req-3f994688-726f-498e-a0e7-0b98b8de9f1c service nova] Lock "3a509dcf-af9c-4813-90a7-724d0adde626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:38.096937 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9e77ce0d-83d8-4e69-9951-1f34c4d6c132 req-3f994688-726f-498e-a0e7-0b98b8de9f1c service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] No waiting events found dispatching network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:38.097051 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9e77ce0d-83d8-4e69-9951-1f34c4d6c132 req-3f994688-726f-498e-a0e7-0b98b8de9f1c service nova] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Received event network-vif-unplugged-a6538970-472a-467f-81d8-972e8c784834 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:38.117401 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance ae9a9cdf-e389-4842-95d5-042b5854e493 has allocations against this compute host but is not found in the database.
May 28 14:18:38.117610 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:18:38.117760 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:18:35 up 45 min,  2 users,  load average: 4.38, 5.11, 4.53\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_4c345e5241bd40c693ea2c6ccaf6c8f7': '1', 'io_workload': '0', 'num_proj_d19477b13dbf4580a9341cfc05b6b7e1': '1', 'num_task_deleting': '1', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:18:38.272723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:18:38.357234 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:18:38.357407 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:18:38.438940 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:38.815417 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:38.860262 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:18:38.940630 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Took 1.42 seconds to deallocate network for instance.
May 28 14:18:39.366483 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:18:39.366931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.812s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:39.366987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.785s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:39.367271 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:39.367381 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:18:39.368850 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:39.370310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.555s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:39.374357 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:18:39.374552 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Claim successful on node np0000001643
May 28 14:18:39.413380 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Deleted allocations for instance a2484ea1-95db-4db2-b76f-1c7a785663d6
May 28 14:18:39.482708 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Took 0.54 seconds to detach 1 volumes for instance.
May 28 14:18:39.844123 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:39.868996 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:39.988141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:40.370722 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:18:40.423854 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-876dc54f-0e74-4905-8312-84e57d606f6c tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "a2484ea1-95db-4db2-b76f-1c7a785663d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.530s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:40.613925 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:18:40.614209 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:18:40.864719 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:40.864889 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:40.865205 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:40.865440 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:40.865681 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:40.865928 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:40.866257 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.96 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:18:41.119359 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:18:41.627244 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.257s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:41.627797 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:18:41.630053 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.642s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:41.690579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:41.691129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:41.714238 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:41.920364 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:18:41.920567 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:18:42.043224 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:18:42.133642 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:18:42.134207 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:18:42.134465 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:42.134718 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:42.193480 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:18:42.198695 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad588d01280449c5a4b0284b2a806e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fd441b3ce4a35a114d090156bf49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:18:42.422880 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:18:42.635610 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:18:42.655754 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Successfully created port: a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:18:42.742039 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:42.930690 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.301s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:42.933627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.189s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:42.936623 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:18:42.936802 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Claim successful on node np0000001643
May 28 14:18:42.994198 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance 3a509dcf-af9c-4813-90a7-724d0adde626
May 28 14:18:43.108012 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Successfully updated port: a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:18:43.138954 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:18:43.160641 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:43.161228 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing instance network info cache due to event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:43.161285 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] Acquiring lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:43.161412 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] Acquired lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:43.161594 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:43.494796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-changed-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:43.494946 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Refreshing instance network info cache due to event network-changed-c097c9cb-baf6-4071-9b64-1feca70a79af. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:43.495092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] Acquiring lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:43.495508 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] Acquired lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:43.495658 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Refreshing network info cache for port c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:43.609771 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:43.642839 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Booting with volume 0e965032-e40d-46e6-b2d0-19d9d83f3142 at /dev/vda
May 28 14:18:43.663439 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:43.679242 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:43.690087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:18:43.709120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:43.725778 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:18:43.754634 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:18:43.754881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:18:43.762684 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:18:43.764522 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::5099:73ff:fe56:12d0', 'fe80::fc16:3eff:fe37:2cff', 'fe80::f830:cfff:fea4:1adf', 'fe80::fc16:3eff:fec0:9eaa'] 
May 28 14:18:43.764664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:18:43.764789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:18:43.765027 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:43.765240 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating existing volume attachment record: 2e0b1be3-6fb1-47f5-b0e7-a00f768ca007 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:18:43.852853 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:43.997515 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:44.003000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-880dcdb3-d5ca-4821-89ab-17ef673b204f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "3a509dcf-af9c-4813-90a7-724d0adde626" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.625s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:44.008576 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:44.008723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:44.008868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:44.009011 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:44.009129 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:44.011249 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Terminating instance
May 28 14:18:44.180667 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:18:44.180888 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:18:44.283139 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:44.355993 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7db3bd88-728f-4016-be17-b7719ac1632c req-d1b1a2b2-0f8b-4696-b19a-84f058ffcb22 service nova] Releasing lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:44.356573 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquired lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:44.356784 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:18:44.404883 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updated VIF entry in instance network info cache for port c097c9cb-baf6-4071-9b64-1feca70a79af. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:18:44.405202 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updating instance_info_cache with network_info: [{"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:44.513853 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:18:44.527651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:44.529548 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:44.545776 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:44.547864 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:44.563654 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:44.569279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:44.683507 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:18:44.818259 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999708741000177 future=<Future at 0x71a788eb9e20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:44.819377 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Instance destroyed successfully.
May 28 14:18:44.819834 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lazy-loading 'resources' on Instance uuid d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:44.844887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:44.907004 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c2303d2-69df-4ffe-9b80-4c1b8305add7 req-55a88e94-13d9-4739-8a38-0f060ad9fcc8 service nova] Releasing lock "refresh_cache-d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:44.911829 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:18:45.054553 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:45.170150 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating instance_info_cache with network_info: [{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:45.190221 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.259s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:45.190649 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:18:45.322328 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-48604213',display_name='tempest-TestStampPattern-server-48604213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-teststamppattern-server-48604213',id=60,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVGtHnRGjb57xlZUEhRDuiB+xXkZ7jN9FPaNseGT7FSrTZcPTjhLnrQvMrvAtYZ5MnPjOEKth0jcuHVqpUUaORV+U1PWfUzZ8KcOJkHdmxykCwqNz8bU9QFZM3bOMj9fA==',key_name='tempest-TestStampPattern-255717967',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:16:24Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c345e5241bd40c693ea2c6ccaf6c8f7',ramdisk_id='',reservation_id='r-bbkoz70d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-744679963',owner_user_name='tempest-TestStampPattern-744679963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:17:20Z,user_data=None,user_id='c98b8f4e148b4557bd70bd6a755850a2',uuid=d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:18:45.322534 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converting VIF {"id": "c097c9cb-baf6-4071-9b64-1feca70a79af", "address": "fa:16:3e:c0:9e:aa", "network": {"id": "07b869ee-d921-4590-bbdb-59efc466f56e", "bridge": "br-int", "label": "tempest-TestStampPattern-483794650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4c345e5241bd40c693ea2c6ccaf6c8f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc097c9cb-ba", "ovs_interfaceid": "c097c9cb-baf6-4071-9b64-1feca70a79af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:45.323064 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=c097c9cb-baf6-4071-9b64-1feca70a79af,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc097c9cb-ba') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:45.323277 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=c097c9cb-baf6-4071-9b64-1feca70a79af,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc097c9cb-ba') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:18:45.324432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:45.324684 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc097c9cb-ba, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:45.325616 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:45.326370 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:45.326986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:45.327138 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05d53299-1fc5-4cad-8674-21d727e67bd1) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:45.327505 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:45.327885 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:45.327981 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:45.329350 np0000001643 nova-compute[98269]: INFO os_vif [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9e:aa,bridge_name='br-int',has_traffic_filtering=True,id=c097c9cb-baf6-4071-9b64-1feca70a79af,network=Network(07b869ee-d921-4590-bbdb-59efc466f56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc097c9cb-ba')
May 28 14:18:45.329598 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Deleting instance files /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4_del
May 28 14:18:45.330247 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Deletion of /opt/stack/data/nova/instances/d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4_del complete
May 28 14:18:45.545832 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-vif-unplugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:45.546061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:45.546624 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:45.546785 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:45.546950 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] No waiting events found dispatching network-vif-unplugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:45.547172 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-vif-unplugged-c097c9cb-baf6-4071-9b64-1feca70a79af for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:45.547301 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-vif-unplugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:45.547478 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] Acquiring lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:45.547620 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:45.547786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:45.547939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] No waiting events found dispatching network-vif-unplugged-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:45.548061 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93c64561-afc0-4143-900b-7aa1b77088a5 req-c5e702c7-a5a7-4d16-abd3-749306e37f97 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-vif-unplugged-c097c9cb-baf6-4071-9b64-1feca70a79af for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:18:45.671939 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Releasing lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:45.672233 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Instance network_info: |[{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:18:45.695974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:18:45.696371 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:18:45.696371 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:45.696627 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:45.765108 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '039853f7e499423384aa13ada9b39d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ea6d8cf0d14c40ad9163f647b3d065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:18:45.824854 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:18:45.825176 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.70 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:18:45.835845 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Took 1.32 seconds to destroy the instance on the hypervisor.
May 28 14:18:45.837134 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:18:45.837315 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:18:45.837400 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:18:45.837624 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:45.850078 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:18:45.851080 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:18:45.851301 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Creating image(s)
May 28 14:18:45.851620 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:18:45.851728 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Ensure instance console log exists: /opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:18:45.851915 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:45.852050 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:45.852172 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:45.852560 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Start _get_guest_xml network_info=[{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '2e0b1be3-6fb1-47f5-b0e7-a00f768ca007', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ae9a9cdf-e389-4842-95d5-042b5854e493', 'attached_at': '', 'detached_at': '', 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'serial': '0e965032-e40d-46e6-b2d0-19d9d83f3142'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:18:45.854806 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:18:45.855676 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1100392465', uuid='ae9a9cdf-e389-4842-95d5-042b5854e493'), owner=OwnerMeta(userid='ad588d01280449c5a4b0284b2a806e09', username='tempest-TestVolumeBackupRestore-1573885368-project-member', projectid='7e9fd441b3ce4a35a114d090156bf49d', projectname='tempest-TestVolumeBackupRestore-1573885368'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977925.8553967) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:18:45.856655 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:18:45.857304 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:18:45.857800 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:18:45.857968 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:18:45.858921 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:18:45.859113 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:18:45.859244 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:18:45.859289 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:18:45.859402 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:18:45.859544 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:18:45.859656 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:18:45.859815 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:18:45.859933 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:18:45.860036 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:18:45.860148 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:18:45.860252 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:18:45.869235 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:18:45.869494 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:45.869616 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:45.869938 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:45.870140 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:18:45.884630 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:45.885124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:18:45.885615 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:45.886243 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:45.886243 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:18:45.886440 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:45.897633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:45.897633 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:45.902827 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:18:45.902827 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:45.907035 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:45.910055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142] added
May 28 14:18:45.910055 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:45.910055 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:45.910055 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:45.910055 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:45.910055 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:45.910055 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:45.910307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:45.910488 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:45.910598 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:45.915622 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142] added
May 28 14:18:45.915622 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:18:45.915622 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:45.915622 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:45.915622 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:18:45.915622 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:18:45.915622 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:45.915824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:18:45.915972 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:18:45.916110 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:18:46.178516 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Successfully created port: d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:18:46.198937 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:18:46.604608 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:46.618137 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Successfully updated port: d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:18:46.669738 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-changed-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:46.669901 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Refreshing instance network info cache due to event network-changed-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:46.670115 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] Acquiring lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:46.670247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] Acquired lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:46.670406 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Refreshing network info cache for port d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:46.702181 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:18:46.910980 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:18:46.916425 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:46.924819 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:46.924819 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:18:46.930130 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:18:46.930130 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:46.935783 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:46.942931 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:46.949193 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.949193 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.949193 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:46.949395 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.949395 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.949395 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:46.955229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.955229 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.955229 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:46.955399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.955399 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:46.955399 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:46.974261 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.50.100,3260]
May 28 14:18:46.974261 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.50.100,3260] successful.
May 28 14:18:46.974261 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:46.982946 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.40.100,3260]
May 28 14:18:46.982946 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.40.100,3260] successful.
May 28 14:18:46.982946 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:46.987356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:46.993724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:18:47.000425 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.000425 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.000425 np0000001643 nova-compute[98269]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.000425 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.000425 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:47.000601 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.000601 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.000601 np0000001643 nova-compute[98269]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.000601 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.000601 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:47.000796 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:47.000876 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:47.001509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] HCTL ('7', '-', '-', 0) found on session 173 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:47.001648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:47.009054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.009054 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.009054 np0000001643 nova-compute[98269]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.009054 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.009054 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:18:47.009252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.009252 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:18:47.009252 np0000001643 nova-compute[98269]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.009252 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:18:47.009252 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:18:47.009414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:47.009607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:18:47.010023 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] HCTL ('8', '-', '-', 0) found on session 174 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:18:47.010145 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:18:47.014861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Searching for a device in session 173 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:47.014861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:47.022604 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Searching for a device in session 174 and hctl ['8', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:47.107239 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Took 1.27 seconds to deallocate network for instance.
May 28 14:18:47.120762 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:47.173501 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:47.229971 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:18:47.311592 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00038452299986602156 future=<Future at 0x71a75c2645f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.311723 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.311723 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.429860128999735 future=<Future at 0x71a75c3d79b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.311857 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=0.4297993659997701 future=<Future at 0x71a75c3d79b0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.312282 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Emitting event <LifecycleEvent: 1779977912.3111072, 33304aba-a509-4200-9824-e2aeb30f76d8 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:47.312424 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] VM Stopped (Lifecycle Event)
May 28 14:18:47.348903 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:47.595181 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d5079c72-978f-45fd-87fe-cbf8a7aad99e req-30a76c06-2c44-4547-900f-a8a329442ac0 service nova] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Received event network-vif-deleted-c097c9cb-baf6-4071-9b64-1feca70a79af {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:47.614308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:47.614566 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:47.709248 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:18:47.710145 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:18:47.710350 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Creating image(s)
May 28 14:18:47.710752 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:47.710908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:47.711994 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:47.713422 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:18:47.715302 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:18:47.718287 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:18:47.719224 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:47.743787 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.001990333000321698 future=<Future at 0x71a75c3d79b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.743931 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.744144 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.4599528710000413 future=<Future at 0x71a78014d7c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.744271 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.459814275000099 future=<Future at 0x71a78014d7c0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:47.745750 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Emitting event <LifecycleEvent: 1779977912.7415428, a2484ea1-95db-4db2-b76f-1c7a785663d6 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:47.746225 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] VM Stopped (Lifecycle Event)
May 28 14:18:47.778670 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:18:47.778858 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:18:47.807335 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:47.807928 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:47.808591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:47.809006 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:18:47.811293 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:18:47.811623 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:47.825015 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: 33304aba-a509-4200-9824-e2aeb30f76d8] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:47.838014 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:18:47.852672 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-47992dc5-5879-4ea6-a4ee-5dd1f4facf61 req-e2f2e140-ac44-47fb-b299-faba33d58743 service nova] Releasing lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:47.853432 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:47.853755 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:18:47.881983 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:18:47.895844 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.084s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:47.896205 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:47.953765 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk 1073741824" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:47.954163 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:47.954507 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:48.023522 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Searching for a device in session 174 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:18:48.023736 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:18:48.043088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:48.043493 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:18:48.043727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:48.128538 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:48.128877 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Cannot resize image /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:18:48.129214 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:18:48.129356 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:18:48.129630 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:48.129818 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:48.129956 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:48.138688 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:18:48.138885 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:18:48.257130 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: a2484ea1-95db-4db2-b76f-1c7a785663d6] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:48.416436 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:18:48.567207 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:48.641825 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:18:48.684735 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Updating instance_info_cache with network_info: [{"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:48.901675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Found WWN 33000000027945b92 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:18:48.902129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:18:48.902129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000027945b92', 'path': '/dev/dm-0', 'multipath_id': '33000000027945b92'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:48.902220 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000027945b92', 'path': '/dev/dm-0', 'multipath_id': '33000000027945b92'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:18:49.071358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:49.071609 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:49.148941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.534s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:49.186693 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:49.186956 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Instance network_info: |[{"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:18:49.188681 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Start _get_guest_xml network_info=[{"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:18:49.190835 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:18:49.191952 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-2066536228', uuid='9f09edb1-e535-4052-82f6-4763ea290f9c'), owner=OwnerMeta(userid='039853f7e499423384aa13ada9b39d22', username='tempest-TestEncryptedCinderVolumes-1171403786-project-member', projectid='50ea6d8cf0d14c40ad9163f647b3d065', projectname='tempest-TestEncryptedCinderVolumes-1171403786'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977929.1916225) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:18:49.192958 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:18:49.193294 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:18:49.194137 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:18:49.194291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:18:49.195095 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:18:49.195375 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:18:49.195563 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:18:49.195662 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:18:49.195804 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:18:49.195881 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:18:49.196016 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:18:49.196264 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:18:49.196374 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:18:49.196510 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:18:49.196621 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:18:49.196757 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:18:49.204743 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Deleted allocations for instance d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4
May 28 14:18:49.210821 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2066536228',display_name='tempest-TestEncryptedCinderVolumes-server-2066536228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-2066536228',id=66,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtTLKZm4hqZ2mMyg5ZUTmL0TP00ntBtQYPRE0XNrS3lLGILzFyHn5UY7NNowKBEr5d4Y8s6FSUzRXYWJz/+fbecMoiF044A1rVjG664sfPEZnGqsEl+vdY1m+VRqvprRg==',key_name='tempest-keypair-862800098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-w7jcibow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=9f09edb1-e535-4052-82f6-4763ea290f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:18:49.210973 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:49.211582 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:6a,bridge_name='br-int',has_traffic_filtering=True,id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d9c8fa-43') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:49.212542 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f09edb1-e535-4052-82f6-4763ea290f9c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:49.406907 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1100392465',display_name='tempest-TestVolumeBackupRestore-server-1100392465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebackuprestore-server-1100392465',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJLTyABU5hxqTcYvBvIPP6vud2TbRqeJcLKW/xmtnNYJ1t8qRCNsJ4dKZN1Ii8/pRNoM8oC4AOo54Q+ASHi4+eNtt92z23vwizhPZ+i15kJuVTP18UiNQANVhVv9xxzOg==',key_name='tempest-TestVolumeBackupRestore-1918822563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e9fd441b3ce4a35a114d090156bf49d',ramdisk_id='',reservation_id='r-90qmtkg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1573885368',owner_user_name='tempest-TestVolumeBackupRestore-1573885368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:18:43Z,user_data=None,user_id='ad588d01280449c5a4b0284b2a806e09',uuid=ae9a9cdf-e389-4842-95d5-042b5854e493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:18:49.407113 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Converting VIF {"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:49.407607 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:8f:78,bridge_name='br-int',has_traffic_filtering=True,id=a5f0f427-3019-47fc-a669-ad20ab2a49eb,network=Network(329b4556-85d2-4b41-a125-ff5674e17c40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f0f427-30') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:49.408054 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lazy-loading 'pci_devices' on Instance uuid ae9a9cdf-e389-4842-95d5-042b5854e493 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:18:49.573576 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:18:49.714886 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] End _get_guest_xml xml=<domain type="qemu">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <uuid>9f09edb1-e535-4052-82f6-4763ea290f9c</uuid>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <name>instance-00000042</name>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-2066536228</nova:name>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:18:49</nova:creationTime>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:user uuid="039853f7e499423384aa13ada9b39d22">tempest-TestEncryptedCinderVolumes-1171403786-project-member</nova:user>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:project uuid="50ea6d8cf0d14c40ad9163f647b3d065">tempest-TestEncryptedCinderVolumes-1171403786</nova:project>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         <nova:port uuid="d1d9c8fa-4300-4e97-9fc0-9cc1f7842591">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <system>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <entry name="serial">9f09edb1-e535-4052-82f6-4763ea290f9c</entry>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <entry name="uuid">9f09edb1-e535-4052-82f6-4763ea290f9c</entry>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </system>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <os>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   </os>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <features>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   </features>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   <devices>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk.config"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ca:8d:6a"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <target dev="tapd1d9c8fa-43"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </interface>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/console.log" append="off"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </serial>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <video>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </video>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </rng>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:   </devices>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]: </domain>
May 28 14:18:49.714886 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Preparing to wait for external event network-vif-plugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2066536228',display_name='tempest-TestEncryptedCinderVolumes-server-2066536228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-2066536228',id=66,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtTLKZm4hqZ2mMyg5ZUTmL0TP00ntBtQYPRE0XNrS3lLGILzFyHn5UY7NNowKBEr5d4Y8s6FSUzRXYWJz/+fbecMoiF044A1rVjG664sfPEZnGqsEl+vdY1m+VRqvprRg==',key_name='tempest-keypair-862800098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-w7jcibow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=9f09edb1-e535-4052-82f6-4763ea290f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:6a,bridge_name='br-int',has_traffic_filtering=True,id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d9c8fa-43') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:49.717088 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:6a,bridge_name='br-int',has_traffic_filtering=True,id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d9c8fa-43') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:18:49.717491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.717557 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.717860 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:18:49.718436 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.718588 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b55eaffc-b779-53f0-8918-60f6a8b65311', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.719503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.719915 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:49.720284 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.722381 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.722504 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1d9c8fa-43, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.722767 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1d9c8fa-43, col_values=(('qos', UUID('83dc1323-4832-4e7e-b932-deb9fe28a0a5')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.722909 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1d9c8fa-43, col_values=(('external_ids', {'iface-id': 'd1d9c8fa-4300-4e97-9fc0-9cc1f7842591', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:8d:6a', 'vm-uuid': '9f09edb1-e535-4052-82f6-4763ea290f9c'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.723858 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.724648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:49.728713 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.729524 np0000001643 nova-compute[98269]: INFO os_vif [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:6a,bridge_name='br-int',has_traffic_filtering=True,id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d9c8fa-43')
May 28 14:18:49.845623 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.910466 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] End _get_guest_xml xml=<domain type="qemu">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <uuid>ae9a9cdf-e389-4842-95d5-042b5854e493</uuid>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <name>instance-00000041</name>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBackupRestore-server-1100392465</nova:name>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:18:45</nova:creationTime>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:user uuid="ad588d01280449c5a4b0284b2a806e09">tempest-TestVolumeBackupRestore-1573885368-project-member</nova:user>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:project uuid="7e9fd441b3ce4a35a114d090156bf49d">tempest-TestVolumeBackupRestore-1573885368</nova:project>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         <nova:port uuid="a5f0f427-3019-47fc-a669-ad20ab2a49eb">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <system>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <entry name="serial">ae9a9cdf-e389-4842-95d5-042b5854e493</entry>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <entry name="uuid">ae9a9cdf-e389-4842-95d5-042b5854e493</entry>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </system>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <os>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   </os>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <features>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   </features>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   <devices>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493/disk.config"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <alias name="ua-0e965032-e40d-46e6-b2d0-19d9d83f3142"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <serial>0e965032-e40d-46e6-b2d0-19d9d83f3142</serial>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </disk>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:78:8f:78"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <target dev="tapa5f0f427-30"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </interface>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493/console.log" append="off"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </serial>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <video>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </video>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </rng>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:   </devices>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]: </domain>
May 28 14:18:49.910466 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Preparing to wait for external event network-vif-plugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1100392465',display_name='tempest-TestVolumeBackupRestore-server-1100392465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebackuprestore-server-1100392465',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJLTyABU5hxqTcYvBvIPP6vud2TbRqeJcLKW/xmtnNYJ1t8qRCNsJ4dKZN1Ii8/pRNoM8oC4AOo54Q+ASHi4+eNtt92z23vwizhPZ+i15kJuVTP18UiNQANVhVv9xxzOg==',key_name='tempest-TestVolumeBackupRestore-1918822563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e9fd441b3ce4a35a114d090156bf49d',ramdisk_id='',reservation_id='r-90qmtkg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1573885368',owner_user_name='tempest-TestVolumeBackupRestore-1573885368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:18:43Z,user_data=None,user_id='ad588d01280449c5a4b0284b2a806e09',uuid=ae9a9cdf-e389-4842-95d5-042b5854e493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Converting VIF {"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:8f:78,bridge_name='br-int',has_traffic_filtering=True,id=a5f0f427-3019-47fc-a669-ad20ab2a49eb,network=Network(329b4556-85d2-4b41-a125-ff5674e17c40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f0f427-30') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:8f:78,bridge_name='br-int',has_traffic_filtering=True,id=a5f0f427-3019-47fc-a669-ad20ab2a49eb,network=Network(329b4556-85d2-4b41-a125-ff5674e17c40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f0f427-30') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:18:49.912737 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.913105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.913105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:18:49.913399 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.913546 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b7bdd26-fa62-5bea-90f4-11ed1ee81412', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.928477 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.929028 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:49.934743 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.936651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.936799 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5f0f427-30, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.937101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5f0f427-30, col_values=(('qos', UUID('84716076-c7d4-43de-ac5b-3f19b62c929d')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.937259 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5f0f427-30, col_values=(('external_ids', {'iface-id': 'a5f0f427-3019-47fc-a669-ad20ab2a49eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:8f:78', 'vm-uuid': 'ae9a9cdf-e389-4842-95d5-042b5854e493'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:18:49.937921 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.938984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:18:49.947193 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:49.948147 np0000001643 nova-compute[98269]: INFO os_vif [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:8f:78,bridge_name='br-int',has_traffic_filtering=True,id=a5f0f427-3019-47fc-a669-ad20ab2a49eb,network=Network(329b4556-85d2-4b41-a125-ff5674e17c40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f0f427-30')
May 28 14:18:50.120000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:50.120192 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:50.123061 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:18:50.123219 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Claim successful on node np0000001643
May 28 14:18:50.213779 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-90a77941-d41c-4985-8d89-8648701d57bf tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Lock "d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.205s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:51.204553 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004328159998294723 future=<Future at 0x71a78014d7c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:51.205108 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] Emitting event <LifecycleEvent: 1779977916.2039952, 3a509dcf-af9c-4813-90a7-724d0adde626 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:51.205108 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:51.205346 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] VM Stopped (Lifecycle Event)
May 28 14:18:51.206810 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.611158204000276 future=<Future at 0x71a788eb9e20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:51.206996 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.610954707000019 future=<Future at 0x71a788eb9e20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:51.243813 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:51.243945 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:51.244057 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:ca:8d:6a, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:18:51.244988 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Using config drive
May 28 14:18:51.336276 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:18:51.336568 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:18:51.462348 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:51.462491 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:18:51.462600 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] No VIF found with MAC fa:16:3e:78:8f:78, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:18:51.462987 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Using config drive
May 28 14:18:51.708528 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-4fd1c725-e344-4d67-aaba-7c4fc4a54a95 tempest-TestStampPattern-744679963 tempest-TestStampPattern-744679963-project-member] [instance: 3a509dcf-af9c-4813-90a7-724d0adde626] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:51.752466 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:51.839563 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:18:51.865897 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Creating config drive at /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk.config
May 28 14:18:51.870142 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnusnfdis {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:51.923114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnusnfdis" returned: 0 in 0.053s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:51.955656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:51.969439 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:52.078671 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Creating config drive at /opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493/disk.config
May 28 14:18:52.081507 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1wlub0wd {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:52.136769 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1wlub0wd" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:18:52.352091 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.229s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:52.352091 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:18:52.417156 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.443199 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.607301 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-57da8e9f-ce4f-4c56-b029-355f8110b08f req-01dbf282-88d2-4dd8-8752-de15748e9a42 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-vif-plugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:52.607301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-57da8e9f-ce4f-4c56-b029-355f8110b08f req-01dbf282-88d2-4dd8-8752-de15748e9a42 service nova] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:52.607582 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-57da8e9f-ce4f-4c56-b029-355f8110b08f req-01dbf282-88d2-4dd8-8752-de15748e9a42 service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:52.607690 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-57da8e9f-ce4f-4c56-b029-355f8110b08f req-01dbf282-88d2-4dd8-8752-de15748e9a42 service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:52.607868 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-57da8e9f-ce4f-4c56-b029-355f8110b08f req-01dbf282-88d2-4dd8-8752-de15748e9a42 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Processing event network-vif-plugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:18:52.734756 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.749412 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.754839 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.756703 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.776270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.781671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.821043 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.841536 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.844160 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:52.855639 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:18:52.855946 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:18:52.856613 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:52.856672 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:52.934792 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:18:52.946531 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:53.015279 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-94bb3925-3c98-461e-b866-01761289cdb8 req-2bee606f-ad36-4a2d-8fc7-fdcacb6c662d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-vif-plugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:53.015279 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-94bb3925-3c98-461e-b866-01761289cdb8 req-2bee606f-ad36-4a2d-8fc7-fdcacb6c662d service nova] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:53.015459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-94bb3925-3c98-461e-b866-01761289cdb8 req-2bee606f-ad36-4a2d-8fc7-fdcacb6c662d service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:53.015624 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-94bb3925-3c98-461e-b866-01761289cdb8 req-2bee606f-ad36-4a2d-8fc7-fdcacb6c662d service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:53.015759 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-94bb3925-3c98-461e-b866-01761289cdb8 req-2bee606f-ad36-4a2d-8fc7-fdcacb6c662d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Processing event network-vif-plugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:18:53.161598 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:53.238047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:53.240538 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:53.242727 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:53.260718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:53.359367 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:18:53.420288 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Successfully created port: e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:18:53.663674 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977933.6632686, 9f09edb1-e535-4052-82f6-4763ea290f9c => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:53.664296 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:18:53.664493 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:18:53.664630 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] VM Started (Lifecycle Event)
May 28 14:18:53.667379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:18:53.669222 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:18:53.670353 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Instance spawned successfully.
May 28 14:18:53.670633 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:18:53.673816 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Instance spawned successfully.
May 28 14:18:53.674500 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:18:53.864786 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:18:53.925981 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Successfully updated port: e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:18:53.990222 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-changed-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:53.990398 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Refreshing instance network info cache due to event network-changed-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:53.990599 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] Acquiring lock "refresh_cache-4539d73f-a158-4d1e-92d8-591eab3db8a7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:53.990727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] Acquired lock "refresh_cache-4539d73f-a158-4d1e-92d8-591eab3db8a7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:53.990889 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Refreshing network info cache for port e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:54.168156 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:54.174093 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:54.180621 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.180844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.181273 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.181505 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.181817 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.182153 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.185241 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.185241 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.185241 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.185358 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.185607 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.185797 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:18:54.368033 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Booting with volume snapshot b1c2a058-b087-4223-bbab-fff93378adec at /dev/vda
May 28 14:18:54.429763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-4539d73f-a158-4d1e-92d8-591eab3db8a7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:54.494999 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:54.574213 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:18:54.680078 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:18:54.680078 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977934.6790235, 9f09edb1-e535-4052-82f6-4763ea290f9c => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:54.680078 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] VM Paused (Lifecycle Event)
May 28 14:18:54.688412 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2d4aeb9d-3877-473b-b42c-cbe94c53b1a6 req-6289c9ae-db7d-4243-96f8-860c7b6312ce service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-vif-plugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:54.688685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2d4aeb9d-3877-473b-b42c-cbe94c53b1a6 req-6289c9ae-db7d-4243-96f8-860c7b6312ce service nova] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:54.688951 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2d4aeb9d-3877-473b-b42c-cbe94c53b1a6 req-6289c9ae-db7d-4243-96f8-860c7b6312ce service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:54.689056 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2d4aeb9d-3877-473b-b42c-cbe94c53b1a6 req-6289c9ae-db7d-4243-96f8-860c7b6312ce service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:54.689250 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2d4aeb9d-3877-473b-b42c-cbe94c53b1a6 req-6289c9ae-db7d-4243-96f8-860c7b6312ce service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] No waiting events found dispatching network-vif-plugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:54.691517 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2d4aeb9d-3877-473b-b42c-cbe94c53b1a6 req-6289c9ae-db7d-4243-96f8-860c7b6312ce service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received unexpected event network-vif-plugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 for instance with vm_state building and task_state spawning.
May 28 14:18:54.695251 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Took 8.84 seconds to spawn the instance on the hypervisor.
May 28 14:18:54.695444 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:54.696705 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Took 6.99 seconds to spawn the instance on the hypervisor.
May 28 14:18:54.696840 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:54.797603 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:54.846739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:54.938078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:55.086530 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-db3ae01d-58dd-4efa-be87-5079444fa727 req-cc397d80-836d-4c73-997d-dece35d7c9f7 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-vif-plugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:55.086721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-db3ae01d-58dd-4efa-be87-5079444fa727 req-cc397d80-836d-4c73-997d-dece35d7c9f7 service nova] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:55.086927 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-db3ae01d-58dd-4efa-be87-5079444fa727 req-cc397d80-836d-4c73-997d-dece35d7c9f7 service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:55.087023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-db3ae01d-58dd-4efa-be87-5079444fa727 req-cc397d80-836d-4c73-997d-dece35d7c9f7 service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:55.087167 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-db3ae01d-58dd-4efa-be87-5079444fa727 req-cc397d80-836d-4c73-997d-dece35d7c9f7 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] No waiting events found dispatching network-vif-plugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:18:55.087308 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-db3ae01d-58dd-4efa-be87-5079444fa727 req-cc397d80-836d-4c73-997d-dece35d7c9f7 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received unexpected event network-vif-plugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb for instance with vm_state active and task_state None.
May 28 14:18:55.143297 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:55.182365 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:55.185601 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977935.1845076, ae9a9cdf-e389-4842-95d5-042b5854e493 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:55.185601 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] VM Started (Lifecycle Event)
May 28 14:18:55.215398 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Took 16.44 seconds to build instance.
May 28 14:18:55.223705 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Took 12.52 seconds to build instance.
May 28 14:18:55.299440 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-812797cb-7b91-4f00-ae32-d7464dee00ee req-8e4d3d4a-8bc6-4d99-895a-bb2654285815 service nova] Releasing lock "refresh_cache-4539d73f-a158-4d1e-92d8-591eab3db8a7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:55.299855 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-4539d73f-a158-4d1e-92d8-591eab3db8a7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:55.300035 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:18:55.687784 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:55.693045 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:55.717007 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-62b6e2a2-1992-4ffc-8424-b6e2878d90c7 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.947s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:55.725008 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.034s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:18:55.864071 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:18:56.045557 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:56.055280 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-changed-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:56.055280 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Refreshing instance network info cache due to event network-changed-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:56.055280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] Acquiring lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:56.055280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] Acquired lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:56.055280 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Refreshing network info cache for port d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:56.196345 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977936.1960027, ae9a9cdf-e389-4842-95d5-042b5854e493 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:56.196465 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] VM Paused (Lifecycle Event)
May 28 14:18:56.201779 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Updating instance_info_cache with network_info: [{"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:56.556623 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:56.708874 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:56.711631 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-4539d73f-a158-4d1e-92d8-591eab3db8a7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:56.712041 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Instance network_info: |[{"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:18:56.713817 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977936.7135537, 9f09edb1-e535-4052-82f6-4763ea290f9c => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:56.713981 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] VM Resumed (Lifecycle Event)
May 28 14:18:56.919498 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:57.063034 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Updated VIF entry in instance network info cache for port d1d9c8fa-4300-4e97-9fc0-9cc1f7842591. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:18:57.063288 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Updating instance_info_cache with network_info: [{"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:57.219608 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:57.222133 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:57.466013 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:57.467377 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing instance network info cache due to event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:57.467588 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] Acquiring lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:57.467664 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] Acquired lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:57.467782 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:57.565475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5487b151-c546-440b-974a-05990b3742f2 req-ebc3b6dd-4e61-408a-9612-7d86c492b2ba service nova] Releasing lock "refresh_cache-9f09edb1-e535-4052-82f6-4763ea290f9c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:57.624432 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:57.624432 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing instance network info cache due to event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:57.624432 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] Acquiring lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:57.624906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] Acquired lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:57.624906 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:57.725997 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977937.7251685, ae9a9cdf-e389-4842-95d5-042b5854e493 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:57.726537 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] VM Resumed (Lifecycle Event)
May 28 14:18:57.878333 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:18:57.890771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:18:57.918957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:18:57.965056 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:18:57.965287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:18:57.973027 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:57.980043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:18:57.981129 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe37:2cff', 'fe80::f830:cfff:fea4:1adf', 'fe80::fc16:3eff:feca:8d6a', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fe78:8f78', 'fe80::cc6a:3eff:fe07:605c'] 
May 28 14:18:57.981548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:18:57.981548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:18:57.981897 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:18:57.982186 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Updating existing volume attachment record: 59e629ed-ac88-41a6-a2a4-734721ee433c {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:18:58.131186 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:58.234003 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:18:58.240348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:18:58.442285 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:58.491713 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:18:58.592006 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updated VIF entry in instance network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:18:58.592380 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating instance_info_cache with network_info: [{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:58.664367 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updated VIF entry in instance network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:18:58.664651 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:18:58.821952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:18:58.821952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:18:59.094710 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4952fc49-c5fc-477b-8b89-a337f7ae009a req-73ce08ae-f5df-4c1c-95c5-899aa82536c6 service nova] Releasing lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:59.166962 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-53131bb6-dfb4-482c-8939-42d3f876b78a req-8db5522c-2e38-421c-b98d-3831ecc7f072 service nova] Releasing lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:18:59.324306 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Detaching volume 96923d8a-30e8-4bce-bb16-0979fda4b6db
May 28 14:18:59.371535 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Attempting to driver detach volume 96923d8a-30e8-4bce-bb16-0979fda4b6db from mountpoint /dev/vdb
May 28 14:18:59.377312 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Found disk vdb by alias ua-96923d8a-30e8-4bce-bb16-0979fda4b6db {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:18:59.378460 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Found disk vdb by alias ua-96923d8a-30e8-4bce-bb16-0979fda4b6db {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:18:59.378867 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Attempting to detach device vdb from instance db49aa69-cf97-4002-a027-262f598da41b from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:18:59.378946 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:18:59.378946 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:59.378946 np0000001643 nova-compute[98269]:   <alias name="ua-96923d8a-30e8-4bce-bb16-0979fda4b6db"/>
May 28 14:18:59.378946 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:18:59.378946 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:59.378946 np0000001643 nova-compute[98269]:   <serial>96923d8a-30e8-4bce-bb16-0979fda4b6db</serial>
May 28 14:18:59.378946 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:18:59.378946 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:59.378946 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:18:59.391776 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully detached device vdb from instance db49aa69-cf97-4002-a027-262f598da41b from the persistent domain config.
May 28 14:18:59.392119 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] (1/8): Attempting to detach device vdb with device alias ua-96923d8a-30e8-4bce-bb16-0979fda4b6db from instance db49aa69-cf97-4002-a027-262f598da41b from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:18:59.392411 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:18:59.392411 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:18:59.392411 np0000001643 nova-compute[98269]:   <alias name="ua-96923d8a-30e8-4bce-bb16-0979fda4b6db"/>
May 28 14:18:59.392411 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-3"/>
May 28 14:18:59.392411 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:18:59.392411 np0000001643 nova-compute[98269]:   <serial>96923d8a-30e8-4bce-bb16-0979fda4b6db</serial>
May 28 14:18:59.392411 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:18:59.392411 np0000001643 nova-compute[98269]: </disk>
May 28 14:18:59.392411 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:18:59.432753 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:59.540274 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:59.540685 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing instance network info cache due to event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:59.540753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] Acquiring lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:59.540893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] Acquired lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:59.540983 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:59.705939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:18:59.706085 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing instance network info cache due to event network-changed-95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:18:59.706232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] Acquiring lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:18:59.706296 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] Acquired lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:18:59.706429 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Refreshing network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:18:59.818558 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005188219997762644 future=<Future at 0x71a788eb9e20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:59.818959 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:18:59.819330 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Emitting event <LifecycleEvent: 1779977924.817875, d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:18:59.819546 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] VM Stopped (Lifecycle Event)
May 28 14:18:59.849377 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:18:59.938946 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:00.000465 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977940.000082, db49aa69-cf97-4002-a027-262f598da41b => ua-96923d8a-30e8-4bce-bb16-0979fda4b6db> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:19:00.002467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-96923d8a-30e8-4bce-bb16-0979fda4b6db for instance db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:19:00.005329 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully detached device vdb from instance db49aa69-cf97-4002-a027-262f598da41b from the live domain config.
May 28 14:19:00.006694 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:19:00.007137 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:00.007330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:00.007859 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:00.008271 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '96923d8a-30e8-4bce-bb16-0979fda4b6db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:19:00.008469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:19:00.032286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:19:00.032286 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:19:00.032286 np0000001643 nova-compute[98269]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:00.032286 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:00.032286 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:00.032554 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:19:00.032554 np0000001643 nova-compute[98269]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db (non-flash)
May 28 14:19:00.032554 np0000001643 nova-compute[98269]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:00.032554 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:00.032554 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:00.032675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '174')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:19:00.032737 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '165')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:00.033571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db', '164')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:00.034641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c339a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:19:00.034896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Removing multipathed devices sdf, sde {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:19:00.035250 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flush multipath device 3300000000387f473 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:19:00.042951 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:00.069633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:00.085140 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:19:00.086311 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:19:00.086771 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Creating image(s)
May 28 14:19:00.087012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:19:00.087108 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Ensure instance console log exists: /opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:19:00.087903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:00.088089 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:00.088234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:00.088671 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Start _get_guest_xml network_info=[{"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '59e629ed-ac88-41a6-a2a4-734721ee433c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4539d73f-a158-4d1e-92d8-591eab3db8a7', 'attached_at': '', 'detached_at': '', 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'serial': '74b388d7-5f42-41ad-bb19-f86586b76638'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:19:00.091029 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:19:00.092097 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-408904034', uuid='4539d73f-a158-4d1e-92d8-591eab3db8a7'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977940.0917299) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:19:00.093270 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:19:00.093587 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:19:00.094490 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:19:00.095961 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:19:00.096944 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:19:00.097281 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:19:00.097424 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:19:00.097565 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:19:00.097684 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:19:00.097769 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:19:00.097859 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:19:00.098043 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:19:00.098144 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:19:00.098282 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:19:00.098402 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:19:00.098574 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:19:00.110649 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:19:00.110973 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:00.111129 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:00.119189 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:00.177982 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:19:00.178161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:19:00.179122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:19:00.193498 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:19:00.193746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:19:00.205727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.208807 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:00.237937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260]
May 28 14:19:00.237937 np0000001643 nova-compute[98269]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.40.100,3260] successful.
May 28 14:19:00.237937 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.253678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.266083 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.298619 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260]
May 28 14:19:00.298619 np0000001643 nova-compute[98269]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-96923d8a-30e8-4bce-bb16-0979fda4b6db, portal: 192.168.50.100,3260] successful.
May 28 14:19:00.298619 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.311262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.311511 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:00.311698 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== disconnect_volume: return (304ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:00.311820 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:19:00.313856 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.203s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:00.314147 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:19:00.322413 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: d9e5ad3a-cd88-4d56-8c9c-8f782ded06e4] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:00.327061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:00.327133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:00.328421 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:00.328421 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:00.328564 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:00.329084 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:00.343528 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:00.343528 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.344646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:00.344646 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.358965 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638] added
May 28 14:19:00.358965 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:00.358965 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:00.358965 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:00.358965 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:00.358965 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:00.358965 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.359299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:00.359918 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:00.360104 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638] added
May 28 14:19:00.362618 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:00.362618 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:00.362618 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:00.548856 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:00.572022 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:00.700976 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updated VIF entry in instance network info cache for port 95672d9b-6717-4879-bdbe-58e4d4af4a41. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:00.701759 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [{"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:00.753542 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updated VIF entry in instance network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:00.753763 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating instance_info_cache with network_info: [{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:00.868984 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'flavor' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:01.091599 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:01.205723 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5b2e7eef-6917-4627-a06d-8aecde6be92a req-4bffcab1-d61a-4196-bba1-790e70f009b2 service nova] Releasing lock "refresh_cache-db49aa69-cf97-4002-a027-262f598da41b" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:01.255459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] Releasing lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:01.255612 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:01.255717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing instance network info cache due to event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:01.255846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] Acquiring lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:01.255949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] Acquired lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:01.256047 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:01.360505 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:01.362925 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:01.375475 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:01.375475 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:01.386155 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:01.386155 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.394297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.401161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.411536 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.411536 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.411536 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:01.411661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.411661 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.411661 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:01.419090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.419090 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.419090 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:01.419237 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.419237 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.419237 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:01.439349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.40.100,3260]
May 28 14:19:01.439349 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.40.100,3260] successful.
May 28 14:19:01.439349 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.451072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.456856 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.50.100,3260]
May 28 14:19:01.456856 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.50.100,3260] successful.
May 28 14:19:01.456856 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.466022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.466022 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.466022 np0000001643 nova-compute[98269]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.466022 np0000001643 nova-compute[98269]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.466022 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:01.466205 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.466205 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.466205 np0000001643 nova-compute[98269]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.466205 np0000001643 nova-compute[98269]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.466205 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:01.466469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:01.466605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:01.467217 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('9', '-', '-', 0) found on session 175 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:01.467324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:01.472187 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:01.482736 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 175 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:01.482736 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:01.490323 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:01.490323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:01.491077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('10', '-', '-', 0) found on session 176 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:01.491140 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:01.508215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 176 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:01.508516 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:01.758811 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:01.878555 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-6e7fda54-4e4f-4e16-b645-546265171aa5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.057s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:02.070372 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:02.204649 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updated VIF entry in instance network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:02.204861 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating instance_info_cache with network_info: [{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:02.328584 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:19:02.707260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f15ab7e-f9d8-47ab-a0bd-b8334a8fe974 req-1495be41-8349-4902-bd4f-6ab6837ff82d service nova] Releasing lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:03.343813 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 3300000004890998b for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:19:03.344244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:03.344244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (3233ms) {'type': 'block', 'scsi_wwn': '3300000004890998b', 'path': '/dev/dm-3', 'multipath_id': '3300000004890998b'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:03.344379 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004890998b', 'path': '/dev/dm-3', 'multipath_id': '3300000004890998b'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:19:03.353759 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:03.353952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:03.354141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:03.354289 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:03.354532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:03.356494 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Terminating instance
May 28 14:19:03.522109 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:03.679664 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:03.849924 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408904034',display_name='tempest-TestVolumeBootPattern-server-408904034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-408904034',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-ike5dje3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:18:54Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=4539d73f-a158-4d1e-92d8-591eab3db8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:19:03.850106 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:03.850878 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=e015002a-bd87-43a8-86a6-1d0ce7e3dfd8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape015002a-bd') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:03.851598 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid 4539d73f-a158-4d1e-92d8-591eab3db8a7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:03.861347 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:19:03.880172 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:03.881288 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:03.898697 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:03.902348 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:03.924352 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.071878 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
May 28 14:19:04.074804 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:19:04.075077 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid ae9a9cdf-e389-4842-95d5-042b5854e493 {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:19:04.075244 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid 9f09edb1-e535-4052-82f6-4763ea290f9c {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:19:04.076337 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Triggering sync for uuid 4539d73f-a158-4d1e-92d8-591eab3db8a7 {{(pid=98269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 14:19:04.077000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:04.077528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:04.078344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:04.078730 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:04.079961 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 29.75 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:19:04.080282 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:04.080718 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:04.084372 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-084ecf43-48f2-4279-b629-fa930f59f4ff req-525b3805-1f9e-4157-a9ef-dabb4410dec1 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:04.084705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-084ecf43-48f2-4279-b629-fa930f59f4ff req-525b3805-1f9e-4157-a9ef-dabb4410dec1 service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:04.084876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-084ecf43-48f2-4279-b629-fa930f59f4ff req-525b3805-1f9e-4157-a9ef-dabb4410dec1 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:04.085024 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-084ecf43-48f2-4279-b629-fa930f59f4ff req-525b3805-1f9e-4157-a9ef-dabb4410dec1 service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:04.085345 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-084ecf43-48f2-4279-b629-fa930f59f4ff req-525b3805-1f9e-4157-a9ef-dabb4410dec1 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] No waiting events found dispatching network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:04.085345 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-084ecf43-48f2-4279-b629-fa930f59f4ff req-525b3805-1f9e-4157-a9ef-dabb4410dec1 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:04.208723 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999685169000259 future=<Future at 0x71a75c349d60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:04.208978 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999403277000056 future=<Future at 0x71a75c349d60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:04.209176 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999201393000021 future=<Future at 0x71a75c349d60 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:04.212573 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] Instance destroyed successfully.
May 28 14:19:04.212980 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'resources' on Instance uuid db49aa69-cf97-4002-a027-262f598da41b {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:04.354668 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] End _get_guest_xml xml=<domain type="qemu">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <uuid>4539d73f-a158-4d1e-92d8-591eab3db8a7</uuid>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <name>instance-00000043</name>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-408904034</nova:name>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:19:00</nova:creationTime>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         <nova:port uuid="e015002a-bd87-43a8-86a6-1d0ce7e3dfd8">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <system>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <entry name="serial">4539d73f-a158-4d1e-92d8-591eab3db8a7</entry>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <entry name="uuid">4539d73f-a158-4d1e-92d8-591eab3db8a7</entry>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </system>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <os>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   </os>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <features>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   </features>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   <devices>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7/disk.config"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <alias name="ua-74b388d7-5f42-41ad-bb19-f86586b76638"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-3"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <serial>74b388d7-5f42-41ad-bb19-f86586b76638</serial>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:09:7a:22"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <target dev="tape015002a-bd"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </interface>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7/console.log" append="off"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </serial>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <video>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </video>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </rng>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:   </devices>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]: </domain>
May 28 14:19:04.354668 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Preparing to wait for external event network-vif-plugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408904034',display_name='tempest-TestVolumeBootPattern-server-408904034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-408904034',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-ike5dje3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:18:54Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=4539d73f-a158-4d1e-92d8-591eab3db8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=e015002a-bd87-43a8-86a6-1d0ce7e3dfd8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape015002a-bd') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:04.358399 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=e015002a-bd87-43a8-86a6-1d0ce7e3dfd8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape015002a-bd') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:19:04.359184 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.359518 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:04.359741 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:19:04.361186 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.361387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ac69d4a-b5af-53bd-aa5f-a3c51d429fa6', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:04.364084 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.365050 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:04.370014 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.372584 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.372765 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape015002a-bd, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:04.373068 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape015002a-bd, col_values=(('qos', UUID('cbae4fc2-bfe2-484d-91cd-d5d487f7a437')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:04.373233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape015002a-bd, col_values=(('external_ids', {'iface-id': 'e015002a-bd87-43a8-86a6-1d0ce7e3dfd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:7a:22', 'vm-uuid': '4539d73f-a158-4d1e-92d8-591eab3db8a7'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:04.376206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.376206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:04.385778 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.386995 np0000001643 nova-compute[98269]: INFO os_vif [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=e015002a-bd87-43a8-86a6-1d0ce7e3dfd8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape015002a-bd')
May 28 14:19:04.594574 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.516s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:04.596086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.518s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:04.715731 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-859358347',display_name='tempest-TestMinimumBasicScenario-server-859358347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-859358347',id=61,image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQYP+V8aFByge7xp6cgO0POP+ecYlEeU6kAzd/PQCST0aF5OYTjbftUVxGTVTseCuc472pkiq4aQdIP5tmMv/GKtKfmNByGUfz8XuImX+jBpT4GF4lH1DDR7J470N+wA==',key_name='tempest-TestMinimumBasicScenario-1748400774',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:17:27Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-yfonxw7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c6d6fc1-a9bb-4fc7-8c97-644ad4e29610',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:19Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=db49aa69-cf97-4002-a027-262f598da41b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:19:04.715969 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "address": "fa:16:3e:37:2c:ff", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95672d9b-67", "ovs_interfaceid": "95672d9b-6717-4879-bdbe-58e4d4af4a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:04.716485 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:04.716724 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:19:04.718042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.718251 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95672d9b-67, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:04.729591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.730489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:04.735185 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.736278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.736425 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50a11c8c-3ac4-4762-9c95-df6f063c36bc) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:04.737100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.737369 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:04.742286 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:04.744209 np0000001643 nova-compute[98269]: INFO os_vif [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95672d9b-6717-4879-bdbe-58e4d4af4a41,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95672d9b-67')
May 28 14:19:04.744544 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Deleting instance files /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b_del
May 28 14:19:04.745213 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Deletion of /opt/stack/data/nova/instances/db49aa69-cf97-4002-a027-262f598da41b_del complete
May 28 14:19:04.849900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:05.250762 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 14:19:05.251354 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:19:05.251651 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:19:05.251760 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:19:05.252018 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:05.331058 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:05.338181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:05.642125 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1564893f-40ab-407f-a179-2c9485c14585 req-d848354a-3465-4c62-9e30-1bdba78989d6 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-deleted-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:05.642530 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-1564893f-40ab-407f-a179-2c9485c14585 req-d848354a-3465-4c62-9e30-1bdba78989d6 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Neutron deleted interface 95672d9b-6717-4879-bdbe-58e4d4af4a41; detaching it from the instance and deleting it from the info cache
May 28 14:19:05.644114 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1564893f-40ab-407f-a179-2c9485c14585 req-d848354a-3465-4c62-9e30-1bdba78989d6 service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Detach interface failed, port_id=95672d9b-6717-4879-bdbe-58e4d4af4a41, reason: Instance db49aa69-cf97-4002-a027-262f598da41b could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:19:05.904983 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:05.905117 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:05.905177 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:09:7a:22, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:19:05.905496 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Using config drive
May 28 14:19:06.094833 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:06.151479 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6433b537-899e-4827-a56a-04a6c3f2983a req-6b6af686-3e01-4701-9cb6-f8238100d61b service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:06.151813 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6433b537-899e-4827-a56a-04a6c3f2983a req-6b6af686-3e01-4701-9cb6-f8238100d61b service nova] Acquiring lock "db49aa69-cf97-4002-a027-262f598da41b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:06.151964 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6433b537-899e-4827-a56a-04a6c3f2983a req-6b6af686-3e01-4701-9cb6-f8238100d61b service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:06.152073 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6433b537-899e-4827-a56a-04a6c3f2983a req-6b6af686-3e01-4701-9cb6-f8238100d61b service nova] Lock "db49aa69-cf97-4002-a027-262f598da41b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:06.152177 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6433b537-899e-4827-a56a-04a6c3f2983a req-6b6af686-3e01-4701-9cb6-f8238100d61b service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] No waiting events found dispatching network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:06.152270 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6433b537-899e-4827-a56a-04a6c3f2983a req-6b6af686-3e01-4701-9cb6-f8238100d61b service nova] [instance: db49aa69-cf97-4002-a027-262f598da41b] Received event network-vif-unplugged-95672d9b-6717-4879-bdbe-58e4d4af4a41 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:06.409841 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:06.516482 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Creating config drive at /opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7/disk.config
May 28 14:19:06.519460 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpii_dmfkq {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:06.571669 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpii_dmfkq" returned: 0 in 0.052s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:06.597170 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: db49aa69-cf97-4002-a027-262f598da41b] Took 1.35 seconds to deallocate network for instance.
May 28 14:19:06.987498 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:06.989075 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.005787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.088782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.111756 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:07.112010 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:07.326030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.328441 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.332196 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.349980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.350573 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:07.361524 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:07.361739 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:07.683056 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977947.6826682, 4539d73f-a158-4d1e-92d8-591eab3db8a7 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:07.683212 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] VM Started (Lifecycle Event)
May 28 14:19:07.864428 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:19:08.188731 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:08.191342 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977948.1911087, 4539d73f-a158-4d1e-92d8-591eab3db8a7 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:08.191546 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] VM Paused (Lifecycle Event)
May 28 14:19:08.371499 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.259s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:08.418196 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Deleted allocations for instance db49aa69-cf97-4002-a027-262f598da41b
May 28 14:19:08.693438 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:08.695361 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:19:09.197442 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:19:09.427424 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-cec33546-4adc-4b0f-b36a-041b71f1526a tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "db49aa69-cf97-4002-a027-262f598da41b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.073s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:09.428033 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "db49aa69-cf97-4002-a027-262f598da41b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.351s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:09.428273 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] [instance: db49aa69-cf97-4002-a027-262f598da41b] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 14:19:09.428419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "db49aa69-cf97-4002-a027-262f598da41b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:09.738078 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:09.851562 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:09.909899 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-688cd985-58e3-4cb0-943f-b05a734982d5 req-058e800d-2283-4440-9c25-e35665ce77a1 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-vif-plugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:09.910397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-688cd985-58e3-4cb0-943f-b05a734982d5 req-058e800d-2283-4440-9c25-e35665ce77a1 service nova] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:09.910575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-688cd985-58e3-4cb0-943f-b05a734982d5 req-058e800d-2283-4440-9c25-e35665ce77a1 service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:09.910712 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-688cd985-58e3-4cb0-943f-b05a734982d5 req-058e800d-2283-4440-9c25-e35665ce77a1 service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:09.910854 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-688cd985-58e3-4cb0-943f-b05a734982d5 req-058e800d-2283-4440-9c25-e35665ce77a1 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Processing event network-vif-plugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:19:09.911346 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:19:09.917583 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977949.9167993, 4539d73f-a158-4d1e-92d8-591eab3db8a7 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:09.917583 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:19:09.918066 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] VM Resumed (Lifecycle Event)
May 28 14:19:09.921583 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Instance spawned successfully.
May 28 14:19:09.921913 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:19:10.421468 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:10.426830 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:19:10.435234 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:10.435351 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:10.435741 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:10.436011 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:10.437630 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:10.437630 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:10.934960 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:19:10.943009 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Took 10.86 seconds to spawn the instance on the hypervisor.
May 28 14:19:10.943195 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:11.457035 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Took 21.38 seconds to build instance.
May 28 14:19:11.960650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.887s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:11.960650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.881s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:11.960650 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:19:11.960650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:11.973912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7d5b1799-2807-4443-aaa5-17e02d7d750c req-ebcf2ee5-c30a-4b83-ad39-f0795594337c service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-vif-plugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:11.974379 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d5b1799-2807-4443-aaa5-17e02d7d750c req-ebcf2ee5-c30a-4b83-ad39-f0795594337c service nova] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:11.974628 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d5b1799-2807-4443-aaa5-17e02d7d750c req-ebcf2ee5-c30a-4b83-ad39-f0795594337c service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:11.975460 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7d5b1799-2807-4443-aaa5-17e02d7d750c req-ebcf2ee5-c30a-4b83-ad39-f0795594337c service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:11.975460 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7d5b1799-2807-4443-aaa5-17e02d7d750c req-ebcf2ee5-c30a-4b83-ad39-f0795594337c service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] No waiting events found dispatching network-vif-plugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:11.975460 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-7d5b1799-2807-4443-aaa5-17e02d7d750c req-ebcf2ee5-c30a-4b83-ad39-f0795594337c service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received unexpected event network-vif-plugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 for instance with vm_state active and task_state None.
May 28 14:19:12.483990 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:12.484531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:12.484531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:12.484672 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:12.484832 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:12.486864 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Terminating instance
May 28 14:19:12.990412 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:19:13.006341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.007368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.024684 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.026853 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.042329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.047144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.184524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:13.184735 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:13.304125 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999737484999969 future=<Future at 0x71a778137020 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:13.306574 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Instance destroyed successfully.
May 28 14:19:13.307070 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid 4539d73f-a158-4d1e-92d8-591eab3db8a7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:13.686785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:19:13.809994 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408904034',display_name='tempest-TestVolumeBootPattern-server-408904034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-408904034',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:19:10Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-ike5dje3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:19:11Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=4539d73f-a158-4d1e-92d8-591eab3db8a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:19:13.810303 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "address": "fa:16:3e:09:7a:22", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape015002a-bd", "ovs_interfaceid": "e015002a-bd87-43a8-86a6-1d0ce7e3dfd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:13.811278 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=e015002a-bd87-43a8-86a6-1d0ce7e3dfd8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape015002a-bd') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:13.811686 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=e015002a-bd87-43a8-86a6-1d0ce7e3dfd8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape015002a-bd') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:19:13.813464 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.813826 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape015002a-bd, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:13.815237 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.816327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:13.817069 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.817301 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbae4fc2-bfe2-484d-91cd-d5d487f7a437) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:13.817975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.818610 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:13.820666 np0000001643 nova-compute[98269]: INFO os_vif [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:7a:22,bridge_name='br-int',has_traffic_filtering=True,id=e015002a-bd87-43a8-86a6-1d0ce7e3dfd8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape015002a-bd')
May 28 14:19:13.822164 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:19:13.822463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:13.822603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:13.822975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:13.823240 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b388d7-5f42-41ad-bb19-f86586b76638', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:19:13.823367 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638 (non-flash)
May 28 14:19:13.849012 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:13.849508 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', '176')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:19:13.849508 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', '175')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:13.850143 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638', '176')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:13.850906 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c2c9b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:19:13.851118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:19:13.851390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 3300000004890998b {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:19:13.903161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:13.961294 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:14.030533 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-vif-unplugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:14.030903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:14.031087 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:14.031167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:14.031286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] No waiting events found dispatching network-vif-unplugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:14.031753 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-vif-unplugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:14.031753 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-vif-unplugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:14.031753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] Acquiring lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:14.031753 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:14.031903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:14.032001 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] No waiting events found dispatching network-vif-unplugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:14.032065 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9b4fa14b-318a-41a3-bca0-94096ce00a7a req-9c579616-cbcb-4569-a45a-4b93918e91a9 service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-vif-unplugged-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:14.069260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:19:14.069489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:19:14.070298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:19:14.082178 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:19:14.082380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:19:14.092792 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:14.094830 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:14.123267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.40.100,3260]
May 28 14:19:14.123267 np0000001643 nova-compute[98269]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.40.100,3260] successful.
May 28 14:19:14.123267 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:14.136320 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:14.146778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:14.182626 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.50.100,3260]
May 28 14:19:14.182626 np0000001643 nova-compute[98269]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-74b388d7-5f42-41ad-bb19-f86586b76638, portal: 192.168.50.100,3260] successful.
May 28 14:19:14.182626 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:14.198959 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:14.199201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:14.199411 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (376ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:14.199576 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:19:14.199899 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Deleting instance files /opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7_del
May 28 14:19:14.200376 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Deletion of /opt/stack/data/nova/instances/4539d73f-a158-4d1e-92d8-591eab3db8a7_del complete
May 28 14:19:14.235962 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:14.236328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:14.241107 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:19:14.241628 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Claim successful on node np0000001643
May 28 14:19:14.705985 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Took 1.72 seconds to destroy the instance on the hypervisor.
May 28 14:19:14.706748 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:19:14.707191 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:19:14.707365 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:19:14.707781 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:14.782325 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:14.852701 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:15.440976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:15.441171 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:15.480993 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:15.718919 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:15.943462 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:19:15.983053 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Took 1.28 seconds to deallocate network for instance.
May 28 14:19:16.086650 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-149c8450-8940-4d4b-b8e9-501f7cb05038 req-ac75a44a-987e-41ef-bab1-3d333468b55c service nova] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Received event network-vif-deleted-e015002a-bd87-43a8-86a6-1d0ce7e3dfd8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:16.449681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.213s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:16.450067 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:19:16.540978 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Took 0.56 seconds to detach 1 volumes for instance.
May 28 14:19:16.542613 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Deleting volume: 74b388d7-5f42-41ad-bb19-f86586b76638 {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:19:16.955793 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:19:16.956324 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:19:16.956377 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:16.956691 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:17.044640 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8481a6da3424bd79d4706a19f2de577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19477b13dbf4580a9341cfc05b6b7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:19:17.096237 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:17.096418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:17.341060 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:17.341321 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:17.360207 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Successfully created port: ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:19:17.460867 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:19:17.783567 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Successfully updated port: ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:19:17.845308 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:17.845308 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing instance network info cache due to event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:17.845308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] Acquiring lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:17.845308 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] Acquired lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:17.845308 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:17.846523 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:19:17.963958 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:19:18.285430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:18.351606 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:18.355046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.256s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:18.421180 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance 4539d73f-a158-4d1e-92d8-591eab3db8a7
May 28 14:19:18.448613 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:19:18.581516 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:18.821671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:18.973169 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:19:18.974122 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:19:18.974372 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Creating image(s)
May 28 14:19:18.974794 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "/opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:18.974928 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "/opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:18.975337 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "/opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:18.975594 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "42090e032e6febe7315f18c539b9f3a3a079c816" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:18.975857 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "42090e032e6febe7315f18c539b9f3a3a079c816" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:19.083266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f229619c-d4e2-4b7c-9ff6-542cc6eef40e req-971aa961-b854-4a91-b273-f93986c97900 service nova] Releasing lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:19.083776 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquired lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:19.084048 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:19:19.208967 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004585529995893012 future=<Future at 0x71a75c349d60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:19.209081 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:19.210559 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.094569143999706 future=<Future at 0x71a778137020 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:19.210559 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.094484807999834 future=<Future at 0x71a778137020 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:19.210559 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] Emitting event <LifecycleEvent: 1779977944.2083075, db49aa69-cf97-4002-a027-262f598da41b => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:19.210559 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] VM Stopped (Lifecycle Event)
May 28 14:19:19.434778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ec61c9f7-195a-4cd1-b249-2c3d00efa9df tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "4539d73f-a158-4d1e-92d8-591eab3db8a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.950s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:19.520643 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:19:19.523541 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:19:19.523851 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.part --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:19.612601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.part --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:19.613085 np0000001643 nova-compute[98269]: DEBUG nova.virt.images [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] fc1c8cef-8324-4e74-80c1-68bc8d48ceed was qcow2, converting to raw {{(pid=98269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 14:19:19.613966 np0000001643 nova-compute[98269]: DEBUG nova.privsep.utils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 14:19:19.614386 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.part /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.converted {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:19.658868 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:19:19.712681 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d0b12cae-2e53-40cc-aded-3aa4a662ffe3 tempest-TaggedBootDevicesTest-1877897096 tempest-TaggedBootDevicesTest-1877897096-project-member] [instance: db49aa69-cf97-4002-a027-262f598da41b] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:19.769907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.part /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.converted" returned: 0 in 0.155s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:19.775060 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.converted --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:19.845323 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:19.854854 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:19.872766 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816.converted --force-share --output=json" returned: 0 in 0.098s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:19.873234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "42090e032e6febe7315f18c539b9f3a3a079c816" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.897s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:19.873588 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:19:19.876156 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:19:19.880343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:19.968551 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816 --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:19.968846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "42090e032e6febe7315f18c539b9f3a3a079c816" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:19.969284 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "42090e032e6febe7315f18c539b9f3a3a079c816" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:19.969768 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:19:19.972159 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:19:19.972463 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:20.026019 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:20.093583 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816 --force-share --output=json" returned: 0 in 0.121s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:20.094639 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816,backing_fmt=raw /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:20.164467 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816,backing_fmt=raw /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk 1073741824" returned: 0 in 0.070s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:20.164929 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "42090e032e6febe7315f18c539b9f3a3a079c816" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:20.165230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:20.258867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816 --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:20.259280 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:19:20.259531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:20.347521 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:20.347869 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Cannot resize image /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:19:20.348232 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:19:20.348475 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Ensure instance console log exists: /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:19:20.348860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:20.348993 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:20.349118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:20.531098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Releasing lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:20.531574 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance network_info: |[{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:19:20.533284 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Start _get_guest_xml network_info=[{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T14:19:11Z,direct_url=<?>,disk_format='qcow2',id=fc1c8cef-8324-4e74-80c1-68bc8d48ceed,min_disk=0,min_ram=0,name='tempest-scenario-img--483173778',owner='d19477b13dbf4580a9341cfc05b6b7e1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T14:19:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'fc1c8cef-8324-4e74-80c1-68bc8d48ceed'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:19:20.537073 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:19:20.538372 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='fc1c8cef-8324-4e74-80c1-68bc8d48ceed', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1736171292', uuid='02b6505e-e619-44c7-9c9d-2c247851bbb7'), owner=OwnerMeta(userid='c8481a6da3424bd79d4706a19f2de577', username='tempest-TestMinimumBasicScenario-1492567984-project-member', projectid='d19477b13dbf4580a9341cfc05b6b7e1', projectname='tempest-TestMinimumBasicScenario-1492567984'), image=ImageMeta(id='fc1c8cef-8324-4e74-80c1-68bc8d48ceed', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977960.5380263) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:19:20.539437 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:19:20.539785 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:19:20.540782 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:19:20.540961 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:19:20.541872 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:19:20.542250 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T14:19:11Z,direct_url=<?>,disk_format='qcow2',id=fc1c8cef-8324-4e74-80c1-68bc8d48ceed,min_disk=0,min_ram=0,name='tempest-scenario-img--483173778',owner='d19477b13dbf4580a9341cfc05b6b7e1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T14:19:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:19:20.542354 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:19:20.542430 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:19:20.542553 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:19:20.542639 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:19:20.542743 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:19:20.542921 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:19:20.543051 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:19:20.543179 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:19:20.543356 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:19:20.543508 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:19:20.554081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1736171292',display_name='tempest-TestMinimumBasicScenario-server-1736171292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-1736171292',id=68,image_ref='fc1c8cef-8324-4e74-80c1-68bc8d48ceed',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZi3di/U9b0AJ+OUUb8sQFprIpK1ZqmTQ+7cjDfGpCJ3aNVITLgXYo66+i9HTOCBMN4TN0wDJTKiWK6nqd7y1HCIni2PC6Jb4JL7bowd5RKS1QQYkM8To+uVup/40m9sw==',key_name='tempest-TestMinimumBasicScenario-526461137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-2j99a5z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fc1c8cef-8324-4e74-80c1-68bc8d48ceed',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:19:18Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=02b6505e-e619-44c7-9c9d-2c247851bbb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:19:20.554354 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:20.554885 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2e:e9,bridge_name='br-int',has_traffic_filtering=True,id=ab8e3551-ee50-433f-8a4e-049d64e9d63a,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8e3551-ee') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:20.555455 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'pci_devices' on Instance uuid 02b6505e-e619-44c7-9c9d-2c247851bbb7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:21.059156 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] End _get_guest_xml xml=<domain type="qemu">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <uuid>02b6505e-e619-44c7-9c9d-2c247851bbb7</uuid>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <name>instance-00000044</name>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestMinimumBasicScenario-server-1736171292</nova:name>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:19:20</nova:creationTime>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:image uuid="fc1c8cef-8324-4e74-80c1-68bc8d48ceed">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:properties/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:user uuid="c8481a6da3424bd79d4706a19f2de577">tempest-TestMinimumBasicScenario-1492567984-project-member</nova:user>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:project uuid="d19477b13dbf4580a9341cfc05b6b7e1">tempest-TestMinimumBasicScenario-1492567984</nova:project>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="fc1c8cef-8324-4e74-80c1-68bc8d48ceed"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         <nova:port uuid="ab8e3551-ee50-433f-8a4e-049d64e9d63a">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <system>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <entry name="serial">02b6505e-e619-44c7-9c9d-2c247851bbb7</entry>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <entry name="uuid">02b6505e-e619-44c7-9c9d-2c247851bbb7</entry>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </system>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <os>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   </os>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <features>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   </features>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   <devices>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk.config"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:13:2e:e9"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <target dev="tapab8e3551-ee"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </interface>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/console.log" append="off"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </serial>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <video>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </video>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </rng>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:   </devices>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]: </domain>
May 28 14:19:21.059156 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:19:21.059156 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Preparing to wait for external event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:19:21.059156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1736171292',display_name='tempest-TestMinimumBasicScenario-server-1736171292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-1736171292',id=68,image_ref='fc1c8cef-8324-4e74-80c1-68bc8d48ceed',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZi3di/U9b0AJ+OUUb8sQFprIpK1ZqmTQ+7cjDfGpCJ3aNVITLgXYo66+i9HTOCBMN4TN0wDJTKiWK6nqd7y1HCIni2PC6Jb4JL7bowd5RKS1QQYkM8To+uVup/40m9sw==',key_name='tempest-TestMinimumBasicScenario-526461137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-2j99a5z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fc1c8cef-8324-4e74-80c1-68bc8d48ceed',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:19:18Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=02b6505e-e619-44c7-9c9d-2c247851bbb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2e:e9,bridge_name='br-int',has_traffic_filtering=True,id=ab8e3551-ee50-433f-8a4e-049d64e9d63a,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8e3551-ee') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2e:e9,bridge_name='br-int',has_traffic_filtering=True,id=ab8e3551-ee50-433f-8a4e-049d64e9d63a,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8e3551-ee') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:21.062961 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:19:21.063558 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:21.063558 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78b773d6-80fe-5a3b-8ad0-a3f0782e1133', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:21.070356 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:21.071580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:21.074052 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:21.074281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab8e3551-ee, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:21.074798 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab8e3551-ee, col_values=(('qos', UUID('46f2c9b6-c259-468f-8d0b-2fdcac73d28c')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:21.075029 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab8e3551-ee, col_values=(('external_ids', {'iface-id': 'ab8e3551-ee50-433f-8a4e-049d64e9d63a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:2e:e9', 'vm-uuid': '02b6505e-e619-44c7-9c9d-2c247851bbb7'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:21.075990 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:21.077610 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:21.083967 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:21.085998 np0000001643 nova-compute[98269]: INFO os_vif [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2e:e9,bridge_name='br-int',has_traffic_filtering=True,id=ab8e3551-ee50-433f-8a4e-049d64e9d63a,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8e3551-ee')
May 28 14:19:21.237334 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:21.237597 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing instance network info cache due to event network-changed-a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:21.237868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] Acquiring lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:21.238002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] Acquired lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:21.238186 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Refreshing network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:21.742629 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:21.774946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:21.775189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:21.775456 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:21.775690 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:21.775871 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:21.779376 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Terminating instance
May 28 14:19:22.036120 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:22.152958 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updated VIF entry in instance network info cache for port a5f0f427-3019-47fc-a669-ad20ab2a49eb. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:22.153289 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating instance_info_cache with network_info: [{"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:22.282902 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:19:22.311843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:22.329740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:22.334255 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:22.359720 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:22.361414 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:22.483074 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ef0aef-bef0-4ac0-82b8-3a46dca4a99c req-8c8ad629-40d1-467b-9a50-9cc8499d43b2 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-vif-unplugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:22.483591 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-39ef0aef-bef0-4ac0-82b8-3a46dca4a99c req-8c8ad629-40d1-467b-9a50-9cc8499d43b2 service nova] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:22.483797 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-39ef0aef-bef0-4ac0-82b8-3a46dca4a99c req-8c8ad629-40d1-467b-9a50-9cc8499d43b2 service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:22.483996 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-39ef0aef-bef0-4ac0-82b8-3a46dca4a99c req-8c8ad629-40d1-467b-9a50-9cc8499d43b2 service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:22.484052 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ef0aef-bef0-4ac0-82b8-3a46dca4a99c req-8c8ad629-40d1-467b-9a50-9cc8499d43b2 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] No waiting events found dispatching network-vif-unplugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:22.484139 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-39ef0aef-bef0-4ac0-82b8-3a46dca4a99c req-8c8ad629-40d1-467b-9a50-9cc8499d43b2 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-vif-unplugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:22.611018 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999722416000168 future=<Future at 0x71a7801f5e20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:22.612007 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:22.612007 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:22.612191 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No VIF found with MAC fa:16:3e:13:2e:e9, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:19:22.612519 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Using config drive
May 28 14:19:22.617286 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Instance destroyed successfully.
May 28 14:19:22.617870 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lazy-loading 'resources' on Instance uuid ae9a9cdf-e389-4842-95d5-042b5854e493 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:22.654980 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-54ae50a2-62f4-4c51-8cd8-02ecf0e48112 req-775d8121-6c4f-4c1a-a48e-542d327a0add service nova] Releasing lock "refresh_cache-ae9a9cdf-e389-4842-95d5-042b5854e493" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:23.120408 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:23.122960 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1100392465',display_name='tempest-TestVolumeBackupRestore-server-1100392465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebackuprestore-server-1100392465',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJLTyABU5hxqTcYvBvIPP6vud2TbRqeJcLKW/xmtnNYJ1t8qRCNsJ4dKZN1Ii8/pRNoM8oC4AOo54Q+ASHi4+eNtt92z23vwizhPZ+i15kJuVTP18UiNQANVhVv9xxzOg==',key_name='tempest-TestVolumeBackupRestore-1918822563',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:18:54Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e9fd441b3ce4a35a114d090156bf49d',ramdisk_id='',reservation_id='r-90qmtkg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-1573885368',owner_user_name='tempest-TestVolumeBackupRestore-1573885368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:55Z,user_data=None,user_id='ad588d01280449c5a4b0284b2a806e09',uuid=ae9a9cdf-e389-4842-95d5-042b5854e493,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:19:23.123257 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Converting VIF {"id": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "address": "fa:16:3e:78:8f:78", "network": {"id": "329b4556-85d2-4b41-a125-ff5674e17c40", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1023778706-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e9fd441b3ce4a35a114d090156bf49d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f0f427-30", "ovs_interfaceid": "a5f0f427-3019-47fc-a669-ad20ab2a49eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:23.123949 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:8f:78,bridge_name='br-int',has_traffic_filtering=True,id=a5f0f427-3019-47fc-a669-ad20ab2a49eb,network=Network(329b4556-85d2-4b41-a125-ff5674e17c40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f0f427-30') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:23.124306 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:8f:78,bridge_name='br-int',has_traffic_filtering=True,id=a5f0f427-3019-47fc-a669-ad20ab2a49eb,network=Network(329b4556-85d2-4b41-a125-ff5674e17c40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f0f427-30') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:19:23.126563 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.126776 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5f0f427-30, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:23.127815 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.129063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:23.133669 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.134482 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.134635 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84716076-c7d4-43de-ac5b-3f19b62c929d) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:23.135118 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.135703 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:23.140258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.142169 np0000001643 nova-compute[98269]: INFO os_vif [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:8f:78,bridge_name='br-int',has_traffic_filtering=True,id=a5f0f427-3019-47fc-a669-ad20ab2a49eb,network=Network(329b4556-85d2-4b41-a125-ff5674e17c40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f0f427-30')
May 28 14:19:23.143698 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:19:23.144071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:23.144239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:23.144654 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:23.145036 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e965032-e40d-46e6-b2d0-19d9d83f3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:19:23.145210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:19:23.167383 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:23.167383 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:23.167383 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:23.167860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:23.167860 np0000001643 nova-compute[98269]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142 (non-flash)
May 28 14:19:23.167860 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:23.167860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '174')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:19:23.167860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '174')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:23.168833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142', '173')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:23.169586 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a784f1be20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'): ({'sdb'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:19:23.169830 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:19:23.170077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Flush multipath device 33000000027945b92 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:19:23.219808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:23.229019 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Creating config drive at /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk.config
May 28 14:19:23.231943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1jn20q5v {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:23.262676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:23.284442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1jn20q5v" returned: 0 in 0.052s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:23.303800 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:19:23.303973 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:19:23.304712 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:19:23.314880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:19:23.315133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:19:23.324202 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:23.347249 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.40.100,3260]
May 28 14:19:23.347249 np0000001643 nova-compute[98269]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.40.100,3260] successful.
May 28 14:19:23.347249 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:23.358086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:23.368884 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:23.395310 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.50.100,3260]
May 28 14:19:23.395310 np0000001643 nova-compute[98269]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-0e965032-e40d-46e6-b2d0-19d9d83f3142, portal: 192.168.50.100,3260] successful.
May 28 14:19:23.395310 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:23.405635 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:23.405959 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:23.406087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] <== disconnect_volume: return (261ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:23.406225 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:19:23.406500 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Deleting instance files /opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493_del
May 28 14:19:23.406934 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Deletion of /opt/stack/data/nova/instances/ae9a9cdf-e389-4842-95d5-042b5854e493_del complete
May 28 14:19:23.657651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.680478 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.762221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.811747 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8dc65964-646d-4639-a793-d5fe23be780c req-e08d102e-da25-45f2-832b-dcde6a279df4 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:23.812078 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dc65964-646d-4639-a793-d5fe23be780c req-e08d102e-da25-45f2-832b-dcde6a279df4 service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:23.812151 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dc65964-646d-4639-a793-d5fe23be780c req-e08d102e-da25-45f2-832b-dcde6a279df4 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:23.812231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8dc65964-646d-4639-a793-d5fe23be780c req-e08d102e-da25-45f2-832b-dcde6a279df4 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:23.812345 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8dc65964-646d-4639-a793-d5fe23be780c req-e08d102e-da25-45f2-832b-dcde6a279df4 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Processing event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:19:23.915783 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Took 1.63 seconds to destroy the instance on the hypervisor.
May 28 14:19:23.916693 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:19:23.917009 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:19:23.917184 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:19:23.918404 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:23.969969 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.971377 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.973195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:23.991952 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:24.004495 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:24.368887 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977964.3684857, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:24.369282 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] VM Started (Lifecycle Event)
May 28 14:19:24.370509 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:19:24.374277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:19:24.376778 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance spawned successfully.
May 28 14:19:24.377039 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:19:24.545608 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0dbdba01-3db5-4f14-9fed-52cb81075eff req-cc11245e-f3c0-4ad7-9fdc-0b897b60c683 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-vif-unplugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:24.546606 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0dbdba01-3db5-4f14-9fed-52cb81075eff req-cc11245e-f3c0-4ad7-9fdc-0b897b60c683 service nova] Acquiring lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:24.546849 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0dbdba01-3db5-4f14-9fed-52cb81075eff req-cc11245e-f3c0-4ad7-9fdc-0b897b60c683 service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:24.547000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0dbdba01-3db5-4f14-9fed-52cb81075eff req-cc11245e-f3c0-4ad7-9fdc-0b897b60c683 service nova] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:24.547173 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0dbdba01-3db5-4f14-9fed-52cb81075eff req-cc11245e-f3c0-4ad7-9fdc-0b897b60c683 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] No waiting events found dispatching network-vif-unplugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:24.547347 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0dbdba01-3db5-4f14-9fed-52cb81075eff req-cc11245e-f3c0-4ad7-9fdc-0b897b60c683 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-vif-unplugged-a5f0f427-3019-47fc-a669-ad20ab2a49eb for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:24.728825 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:24.856596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:24.872598 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:24.874618 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:19:24.886262 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:24.886504 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:24.886865 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:24.887071 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:24.887303 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:24.887550 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:25.230696 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Took 1.31 seconds to deallocate network for instance.
May 28 14:19:25.376478 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:19:25.376889 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977965.3764899, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:25.376889 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] VM Paused (Lifecycle Event)
May 28 14:19:25.392497 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Took 6.42 seconds to spawn the instance on the hypervisor.
May 28 14:19:25.392619 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:25.783532 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:19:25.792847 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:25.792997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:25.871384 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-491b2cb7-5859-4b57-87ce-0a289ff3b2a6 req-e3c8d20a-7ec4-4b05-b951-f9c30d2ec241 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:25.871581 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-491b2cb7-5859-4b57-87ce-0a289ff3b2a6 req-e3c8d20a-7ec4-4b05-b951-f9c30d2ec241 service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:25.871722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-491b2cb7-5859-4b57-87ce-0a289ff3b2a6 req-e3c8d20a-7ec4-4b05-b951-f9c30d2ec241 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:25.871844 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-491b2cb7-5859-4b57-87ce-0a289ff3b2a6 req-e3c8d20a-7ec4-4b05-b951-f9c30d2ec241 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:25.872113 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-491b2cb7-5859-4b57-87ce-0a289ff3b2a6 req-e3c8d20a-7ec4-4b05-b951-f9c30d2ec241 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] No waiting events found dispatching network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:25.872234 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-491b2cb7-5859-4b57-87ce-0a289ff3b2a6 req-e3c8d20a-7ec4-4b05-b951-f9c30d2ec241 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received unexpected event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a for instance with vm_state active and task_state None.
May 28 14:19:25.872333 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-491b2cb7-5859-4b57-87ce-0a289ff3b2a6 req-e3c8d20a-7ec4-4b05-b951-f9c30d2ec241 service nova] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Received event network-vif-deleted-a5f0f427-3019-47fc-a669-ad20ab2a49eb {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:25.879677 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:25.881349 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977965.881178, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:25.881454 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] VM Resumed (Lifecycle Event)
May 28 14:19:25.903215 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Took 11.71 seconds to build instance.
May 28 14:19:26.292119 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:26.292297 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:26.296948 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:19:26.383487 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:26.387146 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:19:26.404828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.220s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:26.530771 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:26.531006 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:26.843820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:27.033849 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:19:27.541334 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.249s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:27.542504 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.699s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:27.545769 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:19:27.545897 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Claim successful on node np0000001643
May 28 14:19:27.592665 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Deleted allocations for instance ae9a9cdf-e389-4842-95d5-042b5854e493
May 28 14:19:28.136996 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:28.304308 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003883650001625938 future=<Future at 0x71a778137020 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:28.304441 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:28.304556 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.306025263000265 future=<Future at 0x71a7801f5e20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:28.304668 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.305916070999956 future=<Future at 0x71a7801f5e20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:28.305992 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Emitting event <LifecycleEvent: 1779977953.3037071, 4539d73f-a158-4d1e-92d8-591eab3db8a7 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:28.305992 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] VM Stopped (Lifecycle Event)
May 28 14:19:28.348476 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:28.349363 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:28.601500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8b925c48-2933-4e62-9e6a-57c7abef68a3 tempest-TestVolumeBackupRestore-1573885368 tempest-TestVolumeBackupRestore-1573885368-project-member] Lock "ae9a9cdf-e389-4842-95d5-042b5854e493" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.825s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:28.807967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d9d6e7fb-4965-41d0-b3f5-b35e97097a3f tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 4539d73f-a158-4d1e-92d8-591eab3db8a7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:28.814944 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:28.815053 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:28.852755 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'flavor' on Instance uuid 02b6505e-e619-44c7-9c9d-2c247851bbb7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:29.317322 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:19:29.823030 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.280s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:29.823432 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:19:29.856379 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:29.860807 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:30.328240 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:19:30.328680 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:19:30.329784 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:30.329784 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:30.479719 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:19:30.831667 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:19:30.893438 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Successfully created port: f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:19:30.945933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:30.946106 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:30.946294 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Attaching volume ef8420ee-1dc7-426f-8841-158eee5d5af2 to /dev/vdb
May 28 14:19:30.981855 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:30.993681 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:19:31.014851 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:31.036898 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:31.060837 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:19:31.061161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:19:31.070571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:19:31.071507 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feca:8d6a', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fe13:2ee9', 'fe80::f830:cfff:fea4:1adf'] 
May 28 14:19:31.071641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:19:31.071781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:19:31.072061 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:31.072340 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating existing volume attachment record: dad00faa-2cc2-4518-91f0-7d0890bba56b {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:19:31.336343 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:19:31.415652 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Successfully updated port: f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:19:31.467610 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-changed-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:31.467610 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Refreshing instance network info cache due to event network-changed-f43b9136-291f-43be-8c7b-4f8bbea45ad2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:31.468083 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] Acquiring lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:31.468520 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] Acquired lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:31.468767 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Refreshing network info cache for port f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:31.634550 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:19:31.635770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef8420ee-1dc7-426f-8841-158eee5d5af2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:31.636140 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:31.637018 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:31.637398 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef8420ee-1dc7-426f-8841-158eee5d5af2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:19:31.651154 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:31.651828 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:31.652272 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:31.652481 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:31.652890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:31.653049 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:31.663656 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:31.663656 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:31.670277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:31.670277 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:31.675802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2] added
May 28 14:19:31.675802 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:31.675802 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:31.675802 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:31.675802 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:31.675802 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:31.675802 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:31.676081 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:31.676267 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:31.676467 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:31.682229 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2] added
May 28 14:19:31.682229 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:31.682229 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:31.682229 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:31.682229 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:31.682229 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:31.682229 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:31.682509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:31.682509 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:31.682646 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:31.845399 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Booting with volume a0387be8-fecf-4d90-aea2-b4297f1ff5a2 at /dev/vda
May 28 14:19:31.881472 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:31.898999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:19:31.917413 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:31.921552 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:31.962819 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:19:31.962962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:19:31.971135 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:31.974422 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:19:31.975342 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feca:8d6a', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fe13:2ee9', 'fe80::f830:cfff:fea4:1adf'] 
May 28 14:19:31.976060 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:19:31.976060 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:19:31.976060 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:31.976276 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Updating existing volume attachment record: d5890eaa-0465-4015-a479-5d9c08e40cf9 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:19:32.061752 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:19:32.214377 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:32.341468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:32.341971 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:32.677091 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:32.683477 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:32.690506 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:32.690506 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:32.697665 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:32.697665 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.699676 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:32.704328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.710273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.716459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efe0695b-ad32-46bb-83b0-ee9ff7cad699 req-813be3a4-14a3-460e-a87e-3842f7c8837a service nova] Releasing lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:32.716900 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:32.717066 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:19:32.718745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:19:32.718745 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:32.718866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:19:32.718866 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:32.718971 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:19:32.718971 np0000001643 nova-compute[98269]: 
May 28 14:19:32.724841 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:19:32.724841 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:32.725022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:19:32.725022 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:32.725229 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:19:32.725229 np0000001643 nova-compute[98269]: 
May 28 14:19:32.745894 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.40.100,3260]
May 28 14:19:32.745894 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.40.100,3260] successful.
May 28 14:19:32.745894 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.759012 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.759887 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.50.100,3260]
May 28 14:19:32.759887 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.50.100,3260] successful.
May 28 14:19:32.759887 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.772976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.772976 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.772976 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:32.773144 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.773144 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.773144 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:32.773410 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:32.773596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:32.774193 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] HCTL ('7', '-', '-', 0) found on session 177 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:32.774304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:32.775388 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.793664 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:32.793664 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching for a device in session 177 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef8420ee-1dc7-426f-8841-158eee5d5af2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] HCTL ('8', '-', '-', 0) found on session 178 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:32.793664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:32.807495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Searching for a device in session 178 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:32.807495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ef8420ee-1dc7-426f-8841-158eee5d5af2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:32.845541 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 9f09edb1-e535-4052-82f6-4763ea290f9c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:33.150159 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:33.299307 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:19:33.463712 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:33.630709 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Updating instance_info_cache with network_info: [{"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:33.652960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:19:33.829193 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:33.852579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:34.094467 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:19:34.095679 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:19:34.095972 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Creating image(s)
May 28 14:19:34.096314 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:19:34.096575 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Ensure instance console log exists: /opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:19:34.096833 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:34.097037 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:34.097213 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:34.133956 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:34.134226 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Instance network_info: |[{"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:19:34.134949 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Start _get_guest_xml network_info=[{"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'd5890eaa-0465-4015-a479-5d9c08e40cf9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '563740fa-6c02-44e3-8d86-46d77ca4060d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'serial': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:19:34.138200 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:19:34.139707 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-1332459080', uuid='563740fa-6c02-44e3-8d86-46d77ca4060d'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977974.1392562) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:19:34.141252 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:19:34.141663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:19:34.143041 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:19:34.143263 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:19:34.144417 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:19:34.144844 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:19:34.145060 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:19:34.145215 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:19:34.145404 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:19:34.145586 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:19:34.145754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:19:34.145977 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:19:34.146140 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:19:34.146312 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:19:34.146529 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:19:34.146714 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:19:34.159017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:19:34.159374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:34.159571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:34.335431 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:34.335708 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:34.336074 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:34.336074 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:19:34.668994 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Found WWN 3300000007bd57fb4 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:19:34.669302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:34.669477 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000007bd57fb4', 'path': '/dev/dm-0', 'multipath_id': '3300000007bd57fb4'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:34.670605 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007bd57fb4', 'path': '/dev/dm-0', 'multipath_id': '3300000007bd57fb4'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:19:34.671661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.512s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:34.672009 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:19:34.673537 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'flavor' on Instance uuid 02b6505e-e619-44c7-9c9d-2c247851bbb7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:34.686932 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:34.687607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:34.687904 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:34.688517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:34.693657 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:34.693657 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:34.704318 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:34.704318 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:34.705249 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:34.705249 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:34.719297 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2] added
May 28 14:19:34.719297 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:34.719297 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:34.719297 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:34.719297 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:34.719297 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:34.719297 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:34.719608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:34.719951 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:34.719951 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:34.721323 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2] added
May 28 14:19:34.721323 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:34.721323 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:34.721323 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:34.721323 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:34.721323 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:34.721323 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:34.721796 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:34.721962 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:34.722108 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:34.860684 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:34.918986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:34.919190 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:34.919402 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Attaching volume 5487b2fc-5f01-470b-9299-04945fe7922e to /dev/vdb
May 28 14:19:34.954410 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:34.964516 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:19:34.985004 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:35.030668 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:19:35.031160 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:19:35.038881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:19:35.039874 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feca:8d6a', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fe13:2ee9', 'fe80::f830:cfff:fea4:1adf'] 
May 28 14:19:35.040006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:19:35.040124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:19:35.040395 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:35.040663 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Updating existing volume attachment record: 28e386c2-47ae-4f81-9581-5102a86217ba {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:19:35.176580 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Attempting to attach volume ef8420ee-1dc7-426f-8841-158eee5d5af2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:19:35.180132 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:19:35.180132 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:19:35.180132 np0000001643 nova-compute[98269]:   <alias name="ua-ef8420ee-1dc7-426f-8841-158eee5d5af2"/>
May 28 14:19:35.180132 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:19:35.180132 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:19:35.180132 np0000001643 nova-compute[98269]:   <serial>ef8420ee-1dc7-426f-8841-158eee5d5af2</serial>
May 28 14:19:35.180132 np0000001643 nova-compute[98269]: </disk>
May 28 14:19:35.180132 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:19:35.356804 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:35.444894 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:35.445778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:35.541419 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:35.545816 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:35.633573 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:35.633989 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:35.649559 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9f09edb1-e535-4052-82f6-4763ea290f9c', 'attached_at': '', 'detached_at': '', 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'serial': '5487b2fc-5f01-470b-9299-04945fe7922e'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:19:35.656537 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:19:35.657578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:35.658853 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:35.720312 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:35.722712 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:35.729154 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:35.729587 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:35.735086 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:35.735086 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.739234 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:19:35.739234 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:35.756098 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:35.756098 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.758103 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.769050 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.775365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.775365 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.775365 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:35.775664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.775664 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.775664 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:35.783262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.783262 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.783262 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:35.783398 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.783398 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.783398 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:35.791795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:35.792148 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=13263MB free_disk=72.68567276000977GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:19:35.792327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:35.792849 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:35.810273 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.40.100,3260]
May 28 14:19:35.810273 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.40.100,3260] successful.
May 28 14:19:35.810273 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.821624 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.826748 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.50.100,3260]
May 28 14:19:35.826748 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.50.100,3260] successful.
May 28 14:19:35.826748 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.834815 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.834815 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.834815 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.834815 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.834815 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:35.834958 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.834958 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.834958 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.834958 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.834958 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:35.835300 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:35.835429 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:35.836025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('9', '-', '-', 0) found on session 179 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:35.836123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:35.843102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:35.852373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 179 and hctl ['9', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:35.862168 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:35.862998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:35.862998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:35.862998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('10', '-', '-', 0) found on session 180 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:35.863131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:35.875903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 180 and hctl ['10', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:36.400299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:36.825198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:36.825198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:36.825198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:36.825198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] No VIF found with MAC fa:16:3e:13:2e:e9, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:19:36.853088 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 179 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:36.853893 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:36.866864 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 9f09edb1-e535-4052-82f6-4763ea290f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:19:36.869860 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:19:36.869988 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 563740fa-6c02-44e3-8d86-46d77ca4060d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:19:36.870165 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:19:36.870296 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:19:35 up 46 min,  2 users,  load average: 3.70, 4.77, 4.45\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_50ea6d8cf0d14c40ad9163f647b3d065': '1', 'io_workload': '1', 'num_proj_d19477b13dbf4580a9341cfc05b6b7e1': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:19:36.876331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 180 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:36.876483 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:37.064312 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:37.064576 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:37.567365 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:19:37.611019 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003960599997299141 future=<Future at 0x71a7801f5e20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:37.611169 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:37.612241 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779977962.6105196, ae9a9cdf-e389-4842-95d5-042b5854e493 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:37.612353 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] VM Stopped (Lifecycle Event)
May 28 14:19:37.693190 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:19:37.837495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:38.073790 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:19:38.074158 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.281s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:38.074407 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:19:38.114608 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ae9a9cdf-e389-4842-95d5-042b5854e493] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:38.152030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:38.385544 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-aef26ba7-43ac-4dae-bdbb-e0a604f64ec5 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.439s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:38.710907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 330000000da5e95b4 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:19:38.711481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.040s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:38.712069 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (4551ms) {'type': 'block', 'scsi_wwn': '330000000da5e95b4', 'path': '/dev/dm-1', 'multipath_id': '330000000da5e95b4'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:38.712608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.054s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:38.712823 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000da5e95b4', 'path': '/dev/dm-1', 'multipath_id': '330000000da5e95b4'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:19:38.713997 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:19:38.726407 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:38.726791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:38.727011 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:38.727380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:38.727722 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:38.727897 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:38.740803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:38.740803 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:38.745961 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:38.745961 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:38.753322 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e] added
May 28 14:19:38.753322 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:38.753322 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:38.753322 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:38.753322 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:38.753322 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:38.753322 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:38.753583 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:38.753730 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:38.753854 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:38.757637 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e] added
May 28 14:19:38.757637 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:38.757637 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:38.757637 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:38.757637 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:38.757637 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:38.757637 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:38.757834 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:38.758010 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:38.758152 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:39.072149 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:39.072344 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:39.072576 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:39.072764 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:39.072979 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:39.073040 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:19:39.073244 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.75 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:19:39.225653 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1332459080',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1332459080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-volume-backed-server-1332459080',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF77g2fWASCrmEfslyDdebSqKeKtp2IDCP37SVXO2fzo2/UZQPAAiPsAjretgUK+FMJrR49XQswrWq0lIrYYTmWsE/DMB01ietMZHgp6QLY3DF/4v1hvMefJf+90OqqNMw==',key_name='tempest-keypair-275380116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-pnb2emxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:19:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=563740fa-6c02-44e3-8d86-46d77ca4060d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:19:39.226180 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:39.226365 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b3:6e,bridge_name='br-int',has_traffic_filtering=True,id=f43b9136-291f-43be-8c7b-4f8bbea45ad2,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43b9136-29') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:39.226946 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid 563740fa-6c02-44e3-8d86-46d77ca4060d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:39.513616 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:39.513658 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing instance network info cache due to event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:39.517499 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] Acquiring lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:39.517695 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] Acquired lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:39.517884 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:39.730867 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] End _get_guest_xml xml=<domain type="qemu">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <uuid>563740fa-6c02-44e3-8d86-46d77ca4060d</uuid>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <name>instance-00000045</name>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1332459080</nova:name>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:19:34</nova:creationTime>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         <nova:port uuid="f43b9136-291f-43be-8c7b-4f8bbea45ad2">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <system>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <entry name="serial">563740fa-6c02-44e3-8d86-46d77ca4060d</entry>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <entry name="uuid">563740fa-6c02-44e3-8d86-46d77ca4060d</entry>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </system>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <os>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   </os>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <features>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   </features>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   <devices>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d/disk.config"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <alias name="ua-a0387be8-fecf-4d90-aea2-b4297f1ff5a2"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-1"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <serial>a0387be8-fecf-4d90-aea2-b4297f1ff5a2</serial>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:6d:b3:6e"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <target dev="tapf43b9136-29"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </interface>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d/console.log" append="off"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </serial>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <video>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </video>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </rng>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:   </devices>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]: </domain>
May 28 14:19:39.730867 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:19:39.732860 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Preparing to wait for external event network-vif-plugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:19:39.732860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:39.732860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:39.732860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:39.732860 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1332459080',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1332459080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-volume-backed-server-1332459080',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF77g2fWASCrmEfslyDdebSqKeKtp2IDCP37SVXO2fzo2/UZQPAAiPsAjretgUK+FMJrR49XQswrWq0lIrYYTmWsE/DMB01ietMZHgp6QLY3DF/4v1hvMefJf+90OqqNMw==',key_name='tempest-keypair-275380116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-pnb2emxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:19:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=563740fa-6c02-44e3-8d86-46d77ca4060d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:19:39.732860 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:39.735060 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b3:6e,bridge_name='br-int',has_traffic_filtering=True,id=f43b9136-291f-43be-8c7b-4f8bbea45ad2,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43b9136-29') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:39.735060 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b3:6e,bridge_name='br-int',has_traffic_filtering=True,id=f43b9136-291f-43be-8c7b-4f8bbea45ad2,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43b9136-29') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:19:39.735060 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:39.735060 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:39.735060 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:19:39.735457 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:39.735633 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a35eeca-32dd-5af5-8f01-a30392994cb8', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:39.736326 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:39.737103 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:39.741756 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:39.741936 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf43b9136-29, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:39.742288 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf43b9136-29, col_values=(('qos', UUID('76454f73-eaf3-4a40-9be9-21e7c633352d')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:39.742458 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf43b9136-29, col_values=(('external_ids', {'iface-id': 'f43b9136-291f-43be-8c7b-4f8bbea45ad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b3:6e', 'vm-uuid': '563740fa-6c02-44e3-8d86-46d77ca4060d'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:39.743179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:39.744492 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:39.748560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:39.749342 np0000001643 nova-compute[98269]: INFO os_vif [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b3:6e,bridge_name='br-int',has_traffic_filtering=True,id=f43b9136-291f-43be-8c7b-4f8bbea45ad2,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43b9136-29')
May 28 14:19:39.754178 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:39.758967 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:39.766476 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:39.766476 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:39.773549 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:39.773549 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.780677 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.791971 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.800507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.800507 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.800507 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.800507 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.800507 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:39.801126 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.801126 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.801126 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.801126 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.801126 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:39.809757 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.809757 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.809757 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.809757 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.809757 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:39.809951 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.809951 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.809951 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.809951 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.809951 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:39.840415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.40.100,3260]
May 28 14:19:39.840415 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.40.100,3260] successful.
May 28 14:19:39.840415 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.851774 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.859273 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:39.862238 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.50.100,3260]
May 28 14:19:39.862238 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.50.100,3260] successful.
May 28 14:19:39.862238 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.867025 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.867025 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.867025 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.867025 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.867025 np0000001643 nova-compute[98269]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.867025 np0000001643 nova-compute[98269]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.867025 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:39.867293 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.867293 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.867293 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.867293 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.867293 np0000001643 nova-compute[98269]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.867293 np0000001643 nova-compute[98269]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.867293 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:39.868282 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:39.868282 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:39.868771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('11', '-', '-', 0) found on session 181 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:39.868907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:39.874942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:39.883860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 181 and hctl ['11', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:39.889823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.889823 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.889823 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.889823 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.889823 np0000001643 nova-compute[98269]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.889823 np0000001643 nova-compute[98269]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.889823 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:39.892507 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('12', '-', '-', 0) found on session 182 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:39.892507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:39.908951 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 182 and hctl ['12', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:40.020795 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:40.359475 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:40.518306 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updated VIF entry in instance network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:40.518623 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:40.809987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:40.884215 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 181 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:40.884376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:40.908289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 182 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:40.908494 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:41.021670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-55d3cfba-8934-4809-ba2c-975a813f0ad1 req-b85e0bf1-6973-46cd-b272-b66fc1650b0a service nova] Releasing lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:41.262223 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:41.262223 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing instance network info cache due to event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:41.262223 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] Acquiring lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:41.262223 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] Acquired lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:41.262223 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:41.276639 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:41.276639 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:41.276639 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:6d:b3:6e, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:19:41.276639 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Using config drive
May 28 14:19:41.728474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:19:41.764614 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:41.782622 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:41.904714 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Creating config drive at /opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d/disk.config
May 28 14:19:41.908338 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfahse30j {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:41.962741 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfahse30j" returned: 0 in 0.054s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:19:42.050556 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:42.165977 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updated VIF entry in instance network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:42.166345 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:42.353553 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.377718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.469827 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.668750 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f35c5e9c-e6e0-4f65-ac66-b9badc1afa5a req-bc6ee719-720a-4414-9e37-ab442f370c57 service nova] Releasing lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:42.701874 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.733344 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.735466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.737652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.747137 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found WWN 3300000004fd7da48 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:19:42.747137 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:42.748658 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== connect_volume: return (7090ms) {'type': 'block', 'scsi_wwn': '3300000004fd7da48', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000004fd7da48'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:42.748658 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004fd7da48', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000004fd7da48'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:19:42.751484 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:19:42.751484 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:19:42.751484 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:19:42.754718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:42.770710 np0000001643 nova-compute[98269]: WARNING os_brick.encryptors.luks [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 14:19:42.770710 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:19:42.770710 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:19:42.770710 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:19:42.770894 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x71a780e65a60>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '9f09edb1-e535-4052-82f6-4763ea290f9c', 'attached_at': '', 'detached_at': '', 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'serial': '5487b2fc-5f01-470b-9299-04945fe7922e'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:19:42.770995 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98269) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 14:19:42.827650 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:42.828030 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:19:43.075475 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977983.0750868, 563740fa-6c02-44e3-8d86-46d77ca4060d => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:43.075724 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] VM Started (Lifecycle Event)
May 28 14:19:43.578566 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:43.581361 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977983.5810668, 563740fa-6c02-44e3-8d86-46d77ca4060d => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:43.581543 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] VM Paused (Lifecycle Event)
May 28 14:19:44.083855 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:44.086083 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:19:44.588654 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:19:44.744044 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:44.860591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:46.576138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:46.576562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:46.704198 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:19:46.704198 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:19:46.704198 np0000001643 nova-compute[98269]:     <volume>5487b2fc-5f01-470b-9299-04945fe7922e</volume>
May 28 14:19:46.704198 np0000001643 nova-compute[98269]:   </usage>
May 28 14:19:46.704198 np0000001643 nova-compute[98269]: </secret>
May 28 14:19:46.704198 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:19:46.709484 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 9f09edb1-e535-4052-82f6-4763ea290f9c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:46.823391 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:19:46.823664 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:19:47.078171 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:19:47.212566 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Attempting to attach volume 5487b2fc-5f01-470b-9299-04945fe7922e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:19:47.213934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:   <alias name="ua-5487b2fc-5f01-470b-9299-04945fe7922e"/>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:   <serial>5487b2fc-5f01-470b-9299-04945fe7922e</serial>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="8a201b37-5a39-4be7-ba8d-4b15b7ec0deb"/>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]: </disk>
May 28 14:19:47.213934 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:19:47.623686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:47.624010 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:47.627745 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:19:47.627937 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Claim successful on node np0000001643
May 28 14:19:48.844129 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:48.846567 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:49.251754 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f4787da7-02fe-4b71-a565-1f3b3e7a5b45 req-f0cf32e8-0f0f-4a8b-bac8-356847561432 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-vif-plugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:49.251948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f4787da7-02fe-4b71-a565-1f3b3e7a5b45 req-f0cf32e8-0f0f-4a8b-bac8-356847561432 service nova] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:49.252101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f4787da7-02fe-4b71-a565-1f3b3e7a5b45 req-f0cf32e8-0f0f-4a8b-bac8-356847561432 service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:49.252227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f4787da7-02fe-4b71-a565-1f3b3e7a5b45 req-f0cf32e8-0f0f-4a8b-bac8-356847561432 service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:49.252355 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f4787da7-02fe-4b71-a565-1f3b3e7a5b45 req-f0cf32e8-0f0f-4a8b-bac8-356847561432 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Processing event network-vif-plugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:19:49.252805 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:19:49.255723 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779977989.2555165, 563740fa-6c02-44e3-8d86-46d77ca4060d => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:19:49.255869 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] VM Resumed (Lifecycle Event)
May 28 14:19:49.257007 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:19:49.260625 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Instance spawned successfully.
May 28 14:19:49.260975 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:19:49.348211 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:19:49.745130 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:49.758134 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:49.760035 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:19:49.766076 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:49.766194 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:49.766548 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:49.766784 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:49.767086 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:49.767620 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:19:49.842470 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:49.842633 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:49.842672 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:49.842766 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:ca:8d:6a, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:19:49.854022 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.230s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:49.854598 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:19:49.861552 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:50.262319 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:19:50.273201 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Took 16.18 seconds to spawn the instance on the hypervisor.
May 28 14:19:50.273476 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:50.359796 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:19:50.360271 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:19:50.360847 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:50.361096 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:50.437411 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '117f5a19409d45e9be5e969913c67263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cb6ddda14738b70c2460eb02dc4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:19:50.782093 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Took 23.98 seconds to build instance.
May 28 14:19:50.857910 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Successfully created port: a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:19:50.864026 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:19:51.283562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.490s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:51.315092 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f4e574a-4d6a-4701-bd0b-bfb42c3aa32f req-935ccd10-f1ce-4d60-a53a-f79ec7a78a4a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-vif-plugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:51.315092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f4e574a-4d6a-4701-bd0b-bfb42c3aa32f req-935ccd10-f1ce-4d60-a53a-f79ec7a78a4a service nova] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:51.315092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f4e574a-4d6a-4701-bd0b-bfb42c3aa32f req-935ccd10-f1ce-4d60-a53a-f79ec7a78a4a service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:51.315092 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f4e574a-4d6a-4701-bd0b-bfb42c3aa32f req-935ccd10-f1ce-4d60-a53a-f79ec7a78a4a service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:51.315092 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f4e574a-4d6a-4701-bd0b-bfb42c3aa32f req-935ccd10-f1ce-4d60-a53a-f79ec7a78a4a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] No waiting events found dispatching network-vif-plugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:51.315092 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2f4e574a-4d6a-4701-bd0b-bfb42c3aa32f req-935ccd10-f1ce-4d60-a53a-f79ec7a78a4a service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received unexpected event network-vif-plugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 for instance with vm_state active and task_state None.
May 28 14:19:51.368760 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:19:51.378468 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Successfully updated port: a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:19:51.395904 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fa9e10a-274f-4e2f-a549-d6c009b00918 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.477s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:51.874426 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Booting with volume 04b04bd2-a23e-4158-9272-b4d04c93da61 at /dev/vda
May 28 14:19:51.879214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:51.879324 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquired lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:51.879431 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:19:51.910882 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:51.921760 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:19:51.941866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:19:51.984614 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:19:51.984948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:19:51.994687 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:19:51.996149 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feca:8d6a', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fe13:2ee9', 'fe80::f830:cfff:fea4:1adf', 'fe80::fc16:3eff:fe6d:b36e', 'fe80::8097:21ff:fe89:3b01'] 
May 28 14:19:51.996320 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:19:51.996461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:19:51.996802 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:51.997107 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Updating existing volume attachment record: dea124e1-552c-4c42-9fb7-d088bc33ad21 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:19:52.055044 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-changed-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:52.055210 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Refreshing instance network info cache due to event network-changed-f43b9136-291f-43be-8c7b-4f8bbea45ad2. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:52.056014 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] Acquiring lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:52.056515 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] Acquired lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:52.056774 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Refreshing network info cache for port f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:52.118750 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:52.118954 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:52.454743 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:19:52.559731 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:52.622994 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Detaching volume 5487b2fc-5f01-470b-9299-04945fe7922e
May 28 14:19:52.649659 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:52.683087 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Attempting to driver detach volume 5487b2fc-5f01-470b-9299-04945fe7922e from mountpoint /dev/vdb
May 28 14:19:52.730640 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '9f09edb1-e535-4052-82f6-4763ea290f9c', 'attached_at': '', 'detached_at': '', 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'serial': '5487b2fc-5f01-470b-9299-04945fe7922e'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:19:52.735146 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-5487b2fc-5f01-470b-9299-04945fe7922e {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:19:52.735566 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-5487b2fc-5f01-470b-9299-04945fe7922e {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:19:52.735706 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Attempting to detach device vdb from instance 9f09edb1-e535-4052-82f6-4763ea290f9c from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:19:52.736066 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   <alias name="ua-5487b2fc-5f01-470b-9299-04945fe7922e"/>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   <serial>5487b2fc-5f01-470b-9299-04945fe7922e</serial>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="8a201b37-5a39-4be7-ba8d-4b15b7ec0deb"/>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]: </disk>
May 28 14:19:52.736066 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:19:52.746613 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 9f09edb1-e535-4052-82f6-4763ea290f9c from the persistent domain config.
May 28 14:19:52.746844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] (1/8): Attempting to detach device vdb with device alias ua-5487b2fc-5f01-470b-9299-04945fe7922e from instance 9f09edb1-e535-4052-82f6-4763ea290f9c from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:19:52.747154 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   <alias name="ua-5487b2fc-5f01-470b-9299-04945fe7922e"/>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   <serial>5487b2fc-5f01-470b-9299-04945fe7922e</serial>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="8a201b37-5a39-4be7-ba8d-4b15b7ec0deb"/>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]: </disk>
May 28 14:19:52.747154 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:19:52.838822 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Updating instance_info_cache with network_info: [{"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:52.957357 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:53.129820 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Updated VIF entry in instance network info cache for port f43b9136-291f-43be-8c7b-4f8bbea45ad2. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:53.130164 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Updating instance_info_cache with network_info: [{"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:53.311473 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779977993.3110585, 9f09edb1-e535-4052-82f6-4763ea290f9c => ua-5487b2fc-5f01-470b-9299-04945fe7922e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:19:53.312587 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5487b2fc-5f01-470b-9299-04945fe7922e for instance 9f09edb1-e535-4052-82f6-4763ea290f9c {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:19:53.314895 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 9f09edb1-e535-4052-82f6-4763ea290f9c from the live domain config.
May 28 14:19:53.317029 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:19:53.317377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:53.317627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:53.318082 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:53.318428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5487b2fc-5f01-470b-9299-04945fe7922e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:19:53.318619 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:19:53.341175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Releasing lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:53.341175 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Instance network_info: |[{"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:19:53.342623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:53.342623 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:53.342623 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:53.342623 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:53.342623 np0000001643 nova-compute[98269]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:53.342623 np0000001643 nova-compute[98269]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:53.342623 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:53.342883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:53.342883 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:53.342883 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:53.342883 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:53.342883 np0000001643 nova-compute[98269]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:53.342883 np0000001643 nova-compute[98269]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e (non-flash)
May 28 14:19:53.342883 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:53.342883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', '182')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:19:53.343165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', '181')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:53.343833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e', '182')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:19:53.344543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c1725c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'): ({'sdg'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:19:53.344721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:19:53.344952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flush multipath device 3300000004fd7da48 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:19:53.375277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:53.383066 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-changed-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:53.383181 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Refreshing instance network info cache due to event network-changed-a20f15c5-498b-4095-80a5-5e3bed89e7ae. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:19:53.383331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] Acquiring lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:53.383418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] Acquired lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:53.383800 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Refreshing network info cache for port a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:19:53.422884 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:19:53.456306 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:19:53.456533 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:19:53.457962 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:19:53.469730 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:19:53.469902 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:19:53.480526 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:53.508634 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.40.100,3260]
May 28 14:19:53.508634 np0000001643 nova-compute[98269]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.40.100,3260] successful.
May 28 14:19:53.508634 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:53.523399 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:53.535037 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:53.567414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.50.100,3260]
May 28 14:19:53.567414 np0000001643 nova-compute[98269]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-5487b2fc-5f01-470b-9299-04945fe7922e, portal: 192.168.50.100,3260] successful.
May 28 14:19:53.567414 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:53.586509 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:53.587731 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:53.587842 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== disconnect_volume: return (270ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:53.587930 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:19:53.632354 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-46b25875-5586-4abd-840a-4f424beb8edf req-edcdb6d3-1d89-4296-ac91-46a12d9b9553 service nova] Releasing lock "refresh_cache-563740fa-6c02-44e3-8d86-46d77ca4060d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:53.885674 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:54.102502 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:19:54.103533 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:19:54.103764 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Creating image(s)
May 28 14:19:54.104121 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:19:54.104248 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Ensure instance console log exists: /opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:19:54.104482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:54.104661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:54.104784 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:54.105279 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Start _get_guest_xml network_info=[{"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'dea124e1-552c-4c42-9fb7-d088bc33ad21', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '20b5dfd0-1a53-4169-99be-7859b4ccfa21', 'attached_at': '', 'detached_at': '', 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'serial': '04b04bd2-a23e-4158-9272-b4d04c93da61'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:19:54.109124 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:19:54.110185 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-181217873', uuid='20b5dfd0-1a53-4169-99be-7859b4ccfa21'), owner=OwnerMeta(userid='117f5a19409d45e9be5e969913c67263', username='tempest-TestVolumeBootPatternV346-425599745-project-member', projectid='18d5cb6ddda14738b70c2460eb02dc4c', projectname='tempest-TestVolumeBootPatternV346-425599745'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779977994.1098406) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:19:54.111596 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:19:54.111856 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:19:54.112924 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:19:54.113083 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:19:54.114110 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:19:54.114384 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:19:54.115492 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:19:54.115492 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:19:54.115492 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:19:54.115631 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:19:54.115680 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:19:54.115804 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:19:54.120619 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:19:54.120619 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:19:54.120619 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:19:54.120619 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:19:54.131912 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:19:54.132218 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:19:54.132330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:54.132746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:54.132928 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:19:54.144206 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 9f09edb1-e535-4052-82f6-4763ea290f9c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:54.146418 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:54.148329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:19:54.149235 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:54.149460 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:54.150124 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:19:54.150406 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:54.161489 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:54.161489 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:54.170913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:19:54.170913 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:54.177435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61] added
May 28 14:19:54.177435 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:54.177435 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:54.177435 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:54.177435 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:54.177435 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:54.177435 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:54.177752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:54.178072 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:54.178296 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:54.183564 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61] added
May 28 14:19:54.183564 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:19:54.183564 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:54.183564 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:54.183564 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:19:54.183564 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:19:54.183564 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:54.183767 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:19:54.183849 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:19:54.184003 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:19:54.258862 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:54.386116 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Updated VIF entry in instance network info cache for port a20f15c5-498b-4095-80a5-5e3bed89e7ae. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:19:54.386471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Updating instance_info_cache with network_info: [{"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:54.746554 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:54.866919 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:54.891330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b013febe-9fc0-450e-82e9-52b7e36f8b5a req-48563446-a964-45d4-848c-b3a8d8f75f8f service nova] Releasing lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:55.153228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-315aef6d-0c58-4c47-a1d0-2535fdcdbd0e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.034s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:55.178772 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:19:55.184441 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:55.193794 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:55.193794 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:19:55.200891 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:19:55.200891 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.208669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.214697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.225977 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.225977 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.225977 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.225977 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.225977 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:55.226223 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.226223 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.226223 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.226223 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.226223 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:55.230678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.230678 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.230678 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.230678 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.230678 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:55.230876 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.230876 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.230876 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.230876 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.230876 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:55.261951 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.50.100,3260]
May 28 14:19:55.261951 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.50.100,3260] successful.
May 28 14:19:55.261951 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.266765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.40.100,3260]
May 28 14:19:55.266765 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.40.100,3260] successful.
May 28 14:19:55.266765 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.275958 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.280412 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:19:55.290192 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.290192 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.290192 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.290192 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.290192 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.290192 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.290192 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:55.290539 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.290539 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.290539 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.290539 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.290539 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.290539 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.290539 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:55.290674 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:55.290755 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:55.291380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] HCTL ('11', '-', '-', 0) found on session 183 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:55.291547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:55.299331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.299331 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.299331 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.299331 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.299331 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.299331 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.299331 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:19:55.299598 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.299598 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:19:55.299598 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.299598 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:19:55.299598 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.299598 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:19:55.299598 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:19:55.299857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:55.299966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:19:55.301148 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] HCTL ('12', '-', '-', 0) found on session 184 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:19:55.301346 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:19:55.308937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 183 and hctl ['11', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:55.321878 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 184 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:55.322026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:55.443662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:55.443886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:55.444071 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:55.444204 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:55.444328 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:55.447412 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Terminating instance
May 28 14:19:55.467597 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:55.467780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:55.467972 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Rebooting instance
May 28 14:19:55.952276 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:19:55.971760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:55.971760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.000356 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.021709 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.022062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.057727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:19:56.057843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquired lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:19:56.057953 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:19:56.174318 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f2144b71-3478-4f4e-bb57-47f2e803f31d req-0d5fc3ec-6acc-402f-894d-12aa76b2c7e5 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-vif-unplugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:56.175907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f2144b71-3478-4f4e-bb57-47f2e803f31d req-0d5fc3ec-6acc-402f-894d-12aa76b2c7e5 service nova] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:56.175907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f2144b71-3478-4f4e-bb57-47f2e803f31d req-0d5fc3ec-6acc-402f-894d-12aa76b2c7e5 service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:56.176548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f2144b71-3478-4f4e-bb57-47f2e803f31d req-0d5fc3ec-6acc-402f-894d-12aa76b2c7e5 service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:56.176548 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f2144b71-3478-4f4e-bb57-47f2e803f31d req-0d5fc3ec-6acc-402f-894d-12aa76b2c7e5 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] No waiting events found dispatching network-vif-unplugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:56.176548 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f2144b71-3478-4f4e-bb57-47f2e803f31d req-0d5fc3ec-6acc-402f-894d-12aa76b2c7e5 service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-vif-unplugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:56.233652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.291948 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99961496800006 future=<Future at 0x71a75c790620 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:56.292301 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999224596000204 future=<Future at 0x71a75c790620 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:56.292538 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998942274000001 future=<Future at 0x71a75c790620 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:19:56.293414 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Instance destroyed successfully.
May 28 14:19:56.293909 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'resources' on Instance uuid 9f09edb1-e535-4052-82f6-4763ea290f9c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:56.309175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 183 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:19:56.309468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:19:56.560664 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:56.796976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2066536228',display_name='tempest-TestEncryptedCinderVolumes-server-2066536228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-2066536228',id=66,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtTLKZm4hqZ2mMyg5ZUTmL0TP00ntBtQYPRE0XNrS3lLGILzFyHn5UY7NNowKBEr5d4Y8s6FSUzRXYWJz/+fbecMoiF044A1rVjG664sfPEZnGqsEl+vdY1m+VRqvprRg==',key_name='tempest-keypair-862800098',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:18:54Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-w7jcibow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=9f09edb1-e535-4052-82f6-4763ea290f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:19:56.797293 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "address": "fa:16:3e:ca:8d:6a", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d9c8fa-43", "ovs_interfaceid": "d1d9c8fa-4300-4e97-9fc0-9cc1f7842591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:56.797995 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:8d:6a,bridge_name='br-int',has_traffic_filtering=True,id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d9c8fa-43') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:56.798296 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:8d:6a,bridge_name='br-int',has_traffic_filtering=True,id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d9c8fa-43') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:19:56.799738 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.799957 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1d9c8fa-43, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:56.801978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.802477 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:56.802969 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:56.803110 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83dc1323-4832-4e7e-b932-deb9fe28a0a5) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:56.804646 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:56.806329 np0000001643 nova-compute[98269]: INFO os_vif [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:8d:6a,bridge_name='br-int',has_traffic_filtering=True,id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d9c8fa-43')
May 28 14:19:56.806650 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Deleting instance files /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c_del
May 28 14:19:56.807605 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Deletion of /opt/stack/data/nova/instances/9f09edb1-e535-4052-82f6-4763ea290f9c_del complete
May 28 14:19:56.836007 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:56.960240 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:57.169850 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Found WWN 330000000bb663941 for multipath device dm-4 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:19:57.170143 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:19:57.170359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000bb663941', 'path': '/dev/dm-4', 'multipath_id': '330000000bb663941'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:19:57.170531 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bb663941', 'path': '/dev/dm-4', 'multipath_id': '330000000bb663941'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:19:57.313704 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 14:19:57.314159 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:19:57.314431 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:19:57.314536 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:19:57.314755 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:57.407614 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:19:57.462274 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Releasing lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:19:57.679832 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-181217873',display_name='tempest-TestVolumeBootPatternV346-server-181217873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-181217873',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgjUpJPstY5DK+vXWF78r5HGX5GX1PcXTXMGOqC2DF1fVZyAh0BF+RT1x4VaB6k+BEnRnCwpgkO6+5c2xafZr1z+LZrXO4WS2zkVx8202rXFccQovCp6ylp9NiBhwteRQ==',key_name='tempest-keypair-2102280864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-19pxnn52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=20b5dfd0-1a53-4169-99be-7859b4ccfa21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:19:57.679993 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:57.680525 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:84,bridge_name='br-int',has_traffic_filtering=True,id=a20f15c5-498b-4095-80a5-5e3bed89e7ae,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20f15c5-49') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:57.681374 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lazy-loading 'pci_devices' on Instance uuid 20b5dfd0-1a53-4169-99be-7859b4ccfa21 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:19:57.966249 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:19:58.189355 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] End _get_guest_xml xml=<domain type="qemu">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <uuid>20b5dfd0-1a53-4169-99be-7859b4ccfa21</uuid>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <name>instance-00000046</name>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPatternV346-server-181217873</nova:name>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:19:54</nova:creationTime>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:user uuid="117f5a19409d45e9be5e969913c67263">tempest-TestVolumeBootPatternV346-425599745-project-member</nova:user>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:project uuid="18d5cb6ddda14738b70c2460eb02dc4c">tempest-TestVolumeBootPatternV346-425599745</nova:project>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         <nova:port uuid="a20f15c5-498b-4095-80a5-5e3bed89e7ae">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <system>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <entry name="serial">20b5dfd0-1a53-4169-99be-7859b4ccfa21</entry>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <entry name="uuid">20b5dfd0-1a53-4169-99be-7859b4ccfa21</entry>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </system>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <os>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   </os>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <features>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   </features>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   <devices>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21/disk.config"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <alias name="ua-04b04bd2-a23e-4158-9272-b4d04c93da61"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-4"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <serial>04b04bd2-a23e-4158-9272-b4d04c93da61</serial>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </disk>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ab:4a:84"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <target dev="tapa20f15c5-49"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </interface>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21/console.log" append="off"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </serial>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <video>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </video>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </rng>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:   </devices>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]: </domain>
May 28 14:19:58.189355 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:19:58.192336 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Preparing to wait for external event network-vif-plugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:19:58.192336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:58.192336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:58.192336 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:58.192336 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-181217873',display_name='tempest-TestVolumeBootPatternV346-server-181217873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-181217873',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgjUpJPstY5DK+vXWF78r5HGX5GX1PcXTXMGOqC2DF1fVZyAh0BF+RT1x4VaB6k+BEnRnCwpgkO6+5c2xafZr1z+LZrXO4WS2zkVx8202rXFccQovCp6ylp9NiBhwteRQ==',key_name='tempest-keypair-2102280864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-19pxnn52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=20b5dfd0-1a53-4169-99be-7859b4ccfa21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:19:58.192336 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:19:58.192336 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:84,bridge_name='br-int',has_traffic_filtering=True,id=a20f15c5-498b-4095-80a5-5e3bed89e7ae,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20f15c5-49') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:19:58.192811 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:84,bridge_name='br-int',has_traffic_filtering=True,id=a20f15c5-498b-4095-80a5-5e3bed89e7ae,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20f15c5-49') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:19:58.192811 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:58.192917 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:58.193179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:19:58.193784 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:58.193936 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e537b32c-5159-555d-a9cd-79b89fa0fa1f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:58.195595 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:58.196034 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:58.198834 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:58.199047 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa20f15c5-49, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:58.199360 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa20f15c5-49, col_values=(('qos', UUID('5741ed99-02ad-4cf2-b5ed-a241b58bde1f')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:58.199564 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa20f15c5-49, col_values=(('external_ids', {'iface-id': 'a20f15c5-498b-4095-80a5-5e3bed89e7ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:4a:84', 'vm-uuid': '20b5dfd0-1a53-4169-99be-7859b4ccfa21'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:19:58.201852 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:19:58.206890 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:19:58.208145 np0000001643 nova-compute[98269]: INFO os_vif [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4a:84,bridge_name='br-int',has_traffic_filtering=True,id=a20f15c5-498b-4095-80a5-5e3bed89e7ae,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20f15c5-49')
May 28 14:19:58.234410 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-vif-unplugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:58.234949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] Acquiring lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:58.235398 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:58.235543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:19:58.235674 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] No waiting events found dispatching network-vif-unplugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:19:58.235923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-vif-unplugged-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:19:58.235923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Received event network-vif-deleted-d1d9c8fa-4300-4e97-9fc0-9cc1f7842591 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:19:58.236080 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Neutron deleted interface d1d9c8fa-4300-4e97-9fc0-9cc1f7842591; detaching it from the instance and deleting it from the info cache
May 28 14:19:58.237616 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-de3126d8-edf8-4f69-821b-d7123587d148 req-2c07ff20-3db8-435f-ad67-ba28ca4e027e service nova] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Detach interface failed, port_id=d1d9c8fa-4300-4e97-9fc0-9cc1f7842591, reason: Instance 9f09edb1-e535-4052-82f6-4763ea290f9c could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:19:58.345938 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:19:58.847832 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Took 1.53 seconds to deallocate network for instance.
May 28 14:19:59.354347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:19:59.354347 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:19:59.574437 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:19:59.574437 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:19:59.726468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:59.726591 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:19:59.726897 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No VIF found with MAC fa:16:3e:ab:4a:84, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:19:59.727264 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Using config drive
May 28 14:19:59.868747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:00.078473 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:20:00.234994 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:00.359105 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Creating config drive at /opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21/disk.config
May 28 14:20:00.362794 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8bmbtxxi {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:00.418409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8bmbtxxi" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:00.584534 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.229s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:00.633379 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deleted allocations for instance 9f09edb1-e535-4052-82f6-4763ea290f9c
May 28 14:20:00.801619 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:00.827919 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:00.830150 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:00.923024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.016962 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7fba3273-8aa1-4e48-84bf-950f90e3278a req-02f41323-7fb1-4952-9ca0-257e70958e50 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-vif-plugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:01.017239 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7fba3273-8aa1-4e48-84bf-950f90e3278a req-02f41323-7fb1-4952-9ca0-257e70958e50 service nova] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:01.017468 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7fba3273-8aa1-4e48-84bf-950f90e3278a req-02f41323-7fb1-4952-9ca0-257e70958e50 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:01.017598 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7fba3273-8aa1-4e48-84bf-950f90e3278a req-02f41323-7fb1-4952-9ca0-257e70958e50 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:01.017739 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7fba3273-8aa1-4e48-84bf-950f90e3278a req-02f41323-7fb1-4952-9ca0-257e70958e50 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Processing event network-vif-plugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:20:01.178121 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.181660 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.183651 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.184782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.211532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.346620 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.351771 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.371907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.373907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.400079 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.648522 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-270f72c1-2081-4118-a28b-5b2806b8ddfc tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "9f09edb1-e535-4052-82f6-4763ea290f9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.204s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:01.700562 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.709197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:01.714879 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978001.7145023, 20b5dfd0-1a53-4169-99be-7859b4ccfa21 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:01.715256 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] VM Started (Lifecycle Event)
May 28 14:20:01.716056 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:20:01.727040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:20:01.734442 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Instance spawned successfully.
May 28 14:20:01.735001 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:20:01.987225 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance shutdown successfully.
May 28 14:20:02.219940 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:02.226902 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:02.243611 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:02.243743 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:02.243968 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:02.244174 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:02.244420 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:02.244682 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:02.495460 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.522690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.529316 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.662618 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.731618 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:20:02.731712 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978002.7314196, 20b5dfd0-1a53-4169-99be-7859b4ccfa21 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:02.731874 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] VM Paused (Lifecycle Event)
May 28 14:20:02.749468 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Took 8.65 seconds to spawn the instance on the hypervisor.
May 28 14:20:02.754887 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:02.874914 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.876836 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.878801 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.879773 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:02.900301 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:03.092790 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-vif-plugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:03.093550 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:03.093795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:03.094036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:03.094150 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] No waiting events found dispatching network-vif-plugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:03.094546 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received unexpected event network-vif-plugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae for instance with vm_state active and task_state None.
May 28 14:20:03.094546 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:03.094681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:03.094813 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:03.095162 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:03.095319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] No waiting events found dispatching network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:03.095988 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received unexpected event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a for instance with vm_state active and task_state reboot_started.
May 28 14:20:03.096238 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:03.096238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:03.096507 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:03.096573 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:03.096778 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] No waiting events found dispatching network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:03.096895 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received unexpected event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a for instance with vm_state active and task_state reboot_started.
May 28 14:20:03.097024 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:03.097189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:03.097343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:03.097504 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:03.097641 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] No waiting events found dispatching network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:03.097776 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received unexpected event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a for instance with vm_state active and task_state reboot_started.
May 28 14:20:03.097921 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:03.098114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:03.098325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:03.098382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:03.098522 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] No waiting events found dispatching network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:03.098655 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1ab2ebe7-1e2c-45f7-ac94-bcc7809341df req-f4735c96-fd39-4ce4-a560-c256e37d1b37 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received unexpected event network-vif-plugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a for instance with vm_state active and task_state reboot_started.
May 28 14:20:03.200893 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:03.234934 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:03.238583 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978003.2383068, 20b5dfd0-1a53-4169-99be-7859b4ccfa21 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:03.238913 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] VM Resumed (Lifecycle Event)
May 28 14:20:03.271442 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Took 15.69 seconds to build instance.
May 28 14:20:03.331797 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance running successfully.
May 28 14:20:03.332571 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance soft rebooted successfully.
May 28 14:20:03.332571 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:03.740974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:03.742923 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:03.773047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bfc6d20f-cc38-4c63-a6b6-622a6e9f9b3a tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.196s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:03.840662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ba7de50f-041f-475f-a769-a0bc396e5568 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.373s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:04.245732 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999644492999778 future=<Future at 0x71a7801f5f40 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:04.245989 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 02b6505e-e619-44c7-9c9d-2c247851bbb7 due to new event <LifecycleEvent: 1779978004.2457876, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:20:04.246178 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978004.2457876, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:04.246386 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] VM Resumed (Lifecycle Event)
May 28 14:20:04.518228 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-changed-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:04.518719 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Refreshing instance network info cache due to event network-changed-a20f15c5-498b-4095-80a5-5e3bed89e7ae. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:04.519434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] Acquiring lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:04.521611 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] Acquired lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:04.521611 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Refreshing network info cache for port a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:04.748836 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:04.751002 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:04.871515 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:05.023020 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:05.256016 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978005.255674, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:05.256216 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] VM Started (Lifecycle Event)
May 28 14:20:05.772596 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:05.775392 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:05.902557 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:06.059480 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Updated VIF entry in instance network info cache for port a20f15c5-498b-4095-80a5-5e3bed89e7ae. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:20:06.060894 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Updating instance_info_cache with network_info: [{"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:06.517174 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:06.517471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:06.562326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a58fea14-0674-410b-ac94-ff2125302171 req-7c770357-3236-4044-b02c-d26aa46d300a service nova] Releasing lock "refresh_cache-20b5dfd0-1a53-4169-99be-7859b4ccfa21" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:07.020620 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:20:07.566772 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:07.567371 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:07.570836 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:20:07.571001 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Claim successful on node np0000001643
May 28 14:20:08.201782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:08.779755 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:20:08.780031 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:20:09.282766 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:20:09.789337 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.222s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:09.789903 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:20:09.872856 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:10.296190 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:20:10.297316 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:20:10.297316 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:10.297316 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:10.385656 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '039853f7e499423384aa13ada9b39d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ea6d8cf0d14c40ad9163f647b3d065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:20:10.799122 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:20:10.853980 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Successfully created port: df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:20:11.291848 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003369010000824346 future=<Future at 0x71a75c790620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:11.292913 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779977996.2913666, 9f09edb1-e535-4052-82f6-4763ea290f9c => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:11.293214 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:11.293304 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] VM Stopped (Lifecycle Event)
May 28 14:20:11.294180 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.951160258000073 future=<Future at 0x71a7801f5f40 state=cancelled>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:11.294836 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=7.950868006999826 future=<Future at 0x71a7801f5f40 state=cancelled>) was cancelled while queued, skipping {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:11.295072 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:11.302986 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:20:11.357751 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Successfully updated port: df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:20:11.404588 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-changed-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:11.404740 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Refreshing instance network info cache due to event network-changed-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:11.404952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] Acquiring lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:11.405143 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] Acquired lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:11.405315 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Refreshing network info cache for port df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:11.795882 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 9f09edb1-e535-4052-82f6-4763ea290f9c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:11.859724 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:11.907556 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:11.965812 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:20:12.094818 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:12.312535 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:20:12.313383 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:20:12.313625 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Creating image(s)
May 28 14:20:12.314020 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:12.314170 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:12.314607 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:12.315244 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:20:12.317557 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:20:12.318567 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:12.404906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:12.405438 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:12.406076 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:12.406682 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:20:12.410887 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:20:12.411302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:12.521310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.110s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:12.521862 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:12.585186 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk 1073741824" returned: 0 in 0.063s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:12.585793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:12.586228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:12.602697 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fbe99b92-2118-46cf-9420-3ae48752df14 req-405bdd27-a40e-40bb-bc7c-ae44e514a791 service nova] Releasing lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:12.603806 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:12.604136 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:20:12.680729 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.094s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:12.681204 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:20:12.681500 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:12.785938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:12.786389 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Cannot resize image /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:20:12.786807 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:20:12.786976 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Ensure instance console log exists: /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:20:12.787291 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:12.787553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:12.787679 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:13.169205 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:20:13.202623 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:13.309909 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:13.439765 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Updating instance_info_cache with network_info: [{"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:13.942410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:13.942857 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Instance network_info: |[{"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:20:13.944817 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Start _get_guest_xml network_info=[{"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:20:13.949411 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:20:13.950676 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1449946465', uuid='1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e'), owner=OwnerMeta(userid='039853f7e499423384aa13ada9b39d22', username='tempest-TestEncryptedCinderVolumes-1171403786-project-member', projectid='50ea6d8cf0d14c40ad9163f647b3d065', projectname='tempest-TestEncryptedCinderVolumes-1171403786'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978013.950306) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:20:13.951819 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:20:13.952136 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:20:13.952882 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:20:13.953078 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:20:13.953903 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:20:13.954236 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:20:13.954392 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:20:13.954489 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:20:13.954619 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:20:13.954737 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:20:13.954825 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:20:13.954964 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:20:13.955070 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:20:13.955200 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:20:13.955286 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:20:13.955396 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:20:13.965268 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1449946465',display_name='tempest-TestEncryptedCinderVolumes-server-1449946465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1449946465',id=71,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Dl2W27PjwKqBRcL2OG+ApuKgTjQLRQB1V+C00+gx+Vxip15UwM4EHAd5eIL3oKmVLda7g9gSwwoJrY/1SLLkvdLll7JU2d85vo4G5VSKij8A+/16LsGjlSaAuVpXFaA==',key_name='tempest-keypair-483978194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-i16x80x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:20:13.965420 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:20:13.965931 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:0d,bridge_name='br-int',has_traffic_filtering=True,id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3b0bb9-52') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:20:13.966527 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:20:14.470281 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] End _get_guest_xml xml=<domain type="qemu">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <uuid>1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e</uuid>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <name>instance-00000047</name>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1449946465</nova:name>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:20:13</nova:creationTime>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:user uuid="039853f7e499423384aa13ada9b39d22">tempest-TestEncryptedCinderVolumes-1171403786-project-member</nova:user>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:project uuid="50ea6d8cf0d14c40ad9163f647b3d065">tempest-TestEncryptedCinderVolumes-1171403786</nova:project>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         <nova:port uuid="df3b0bb9-525e-4a62-a2fb-fb0a7ad28760">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <system>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <entry name="serial">1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e</entry>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <entry name="uuid">1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e</entry>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </system>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <os>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   </os>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <features>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   </features>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   <devices>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </disk>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk.config"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </disk>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:4c:76:0d"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <target dev="tapdf3b0bb9-52"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </interface>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/console.log" append="off"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </serial>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <video>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </video>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </rng>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:   </devices>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]: </domain>
May 28 14:20:14.470281 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Preparing to wait for external event network-vif-plugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1449946465',display_name='tempest-TestEncryptedCinderVolumes-server-1449946465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1449946465',id=71,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Dl2W27PjwKqBRcL2OG+ApuKgTjQLRQB1V+C00+gx+Vxip15UwM4EHAd5eIL3oKmVLda7g9gSwwoJrY/1SLLkvdLll7JU2d85vo4G5VSKij8A+/16LsGjlSaAuVpXFaA==',key_name='tempest-keypair-483978194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-i16x80x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:0d,bridge_name='br-int',has_traffic_filtering=True,id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3b0bb9-52') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:20:14.472732 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:0d,bridge_name='br-int',has_traffic_filtering=True,id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3b0bb9-52') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:20:14.473314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:14.473694 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:14.474192 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:20:14.474978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:14.475304 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76fd981c-ba9c-5466-af92-6284b8644f99', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:14.476369 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:14.477342 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:14.479011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:14.479229 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf3b0bb9-52, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:14.479691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf3b0bb9-52, col_values=(('qos', UUID('d149f079-4b8f-434c-a150-18223bc94123')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:14.479936 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf3b0bb9-52, col_values=(('external_ids', {'iface-id': 'df3b0bb9-525e-4a62-a2fb-fb0a7ad28760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:76:0d', 'vm-uuid': '1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:14.480867 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:14.482432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:14.487105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:14.488059 np0000001643 nova-compute[98269]: INFO os_vif [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:0d,bridge_name='br-int',has_traffic_filtering=True,id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3b0bb9-52')
May 28 14:20:14.874401 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:16.006109 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:20:16.006562 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:20:16.006562 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:4c:76:0d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:20:16.006784 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Using config drive
May 28 14:20:16.512839 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:16.657509 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Creating config drive at /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk.config
May 28 14:20:16.662577 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuakes79c {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:16.724002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuakes79c" returned: 0 in 0.061s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:17.149190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.178963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.181281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.256991 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.360590 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ee72ed9a-a50e-4bf1-b082-ad9dc062a58d req-e21e86a2-61f5-4761-bc4f-e706c7ce15c0 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-vif-plugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:17.360948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ee72ed9a-a50e-4bf1-b082-ad9dc062a58d req-e21e86a2-61f5-4761-bc4f-e706c7ce15c0 service nova] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:17.361178 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ee72ed9a-a50e-4bf1-b082-ad9dc062a58d req-e21e86a2-61f5-4761-bc4f-e706c7ce15c0 service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:17.361315 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ee72ed9a-a50e-4bf1-b082-ad9dc062a58d req-e21e86a2-61f5-4761-bc4f-e706c7ce15c0 service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:17.361957 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ee72ed9a-a50e-4bf1-b082-ad9dc062a58d req-e21e86a2-61f5-4761-bc4f-e706c7ce15c0 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Processing event network-vif-plugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:20:17.544781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.547488 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.553233 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.554024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.575128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:17.933409 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978017.9329355, 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:17.933610 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] VM Started (Lifecycle Event)
May 28 14:20:17.935645 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:20:17.941056 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:20:17.943047 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Instance spawned successfully.
May 28 14:20:17.943403 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:20:18.437148 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:18.439315 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:18.451399 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:18.451399 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:18.451399 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:18.451773 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:18.452315 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:18.452793 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:18.942299 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:20:18.942636 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978018.942415, 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:18.942802 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] VM Paused (Lifecycle Event)
May 28 14:20:18.958346 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Took 6.65 seconds to spawn the instance on the hypervisor.
May 28 14:20:18.959945 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:19.432320 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8a3b407-3b58-4e67-bb58-1ef677639811 req-6140eb60-4631-4b27-8126-084be5502ec6 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-vif-plugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:19.432579 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8a3b407-3b58-4e67-bb58-1ef677639811 req-6140eb60-4631-4b27-8126-084be5502ec6 service nova] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:19.432783 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8a3b407-3b58-4e67-bb58-1ef677639811 req-6140eb60-4631-4b27-8126-084be5502ec6 service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:19.433961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8a3b407-3b58-4e67-bb58-1ef677639811 req-6140eb60-4631-4b27-8126-084be5502ec6 service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:19.434104 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8a3b407-3b58-4e67-bb58-1ef677639811 req-6140eb60-4631-4b27-8126-084be5502ec6 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] No waiting events found dispatching network-vif-plugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:19.434262 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-e8a3b407-3b58-4e67-bb58-1ef677639811 req-6140eb60-4631-4b27-8126-084be5502ec6 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received unexpected event network-vif-plugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 for instance with vm_state active and task_state None.
May 28 14:20:19.445307 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:19.447041 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978019.4468298, 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:19.447180 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] VM Resumed (Lifecycle Event)
May 28 14:20:19.468651 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Took 11.94 seconds to build instance.
May 28 14:20:19.481053 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:19.877062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:19.949717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:19.953812 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:19.969530 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3da148c0-ac25-4bc5-96bd-3c4f62f64ddd tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.452s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:20.774031 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-changed-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:20.774479 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Refreshing instance network info cache due to event network-changed-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:20.774712 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] Acquiring lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:20.774907 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] Acquired lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:20.775051 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Refreshing network info cache for port df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:21.277625 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:21.548814 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:21.666551 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Updated VIF entry in instance network info cache for port df3b0bb9-525e-4a62-a2fb-fb0a7ad28760. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:20:21.666551 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Updating instance_info_cache with network_info: [{"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:22.168381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-13d9ecc5-32c9-4bbe-b878-7a02132f0cdb req-d0d07d47-5e89-4bcb-8226-a35925dbabb8 service nova] Releasing lock "refresh_cache-1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:24.481869 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:24.877090 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:29.482608 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:29.879283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:32.842156 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:32.842655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:33.343908 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:20:33.896562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:33.896946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:33.900113 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:20:33.900240 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Claim successful on node np0000001643
May 28 14:20:34.484189 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:34.826999 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:34.827219 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:20:34.827300 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:34.880491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:35.136984 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:20:35.137369 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:20:35.330914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:35.639787 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:20:36.146903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.250s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:36.147914 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.816s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:36.148185 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:20:36.150556 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:36.150799 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:20:36.654415 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:20:36.657462 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:20:36.657709 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:20:36.658037 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:36.658288 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:36.735652 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:20:37.132482 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Successfully created port: 5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:20:37.162512 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:20:37.178795 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:20:37.180403 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:20:37.181941 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:37.268676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:37.269109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:37.359851 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:37.360345 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:20:37.364126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:37.449667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:37.450188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:37.537407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:37.541690 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:20:37.543052 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:37.576700 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Successfully updated port: 5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:20:37.591200 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:37.591509 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12566MB free_disk=72.65270233154297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:20:37.591686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:37.591970 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:37.618545 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-changed-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:37.618679 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Refreshing instance network info cache due to event network-changed-5ccc8779-f760-4aed-a816-816570d17e8f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:37.618851 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] Acquiring lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:37.618986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] Acquired lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:37.619691 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Refreshing network info cache for port 5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:37.667485 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Booting with volume snapshot 73a7345a-34cd-4117-be99-e51ffdf0afa8 at /dev/vda
May 28 14:20:38.079834 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:38.122133 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:38.174236 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:20:38.287731 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:38.640777 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:20:38.640891 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 563740fa-6c02-44e3-8d86-46d77ca4060d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:20:38.640972 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 20b5dfd0-1a53-4169-99be-7859b4ccfa21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:20:38.641072 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:20:38.641212 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance ad03deb0-8239-40a6-a767-977c60aa5ef5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:20:38.641374 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:20:38.641543 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:20:37 up 47 min,  2 users,  load average: 3.74, 4.62, 4.42\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_d19477b13dbf4580a9341cfc05b6b7e1': '1', 'io_workload': '1', 'num_proj_6a701352f7484e2d810439622b1c8bda': '2', 'num_proj_18d5cb6ddda14738b70c2460eb02dc4c': '1', 'num_proj_50ea6d8cf0d14c40ad9163f647b3d065': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:20:38.789344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-c71bc557-1f03-4c27-9f6d-211f8ddf2478 req-0e59ecee-41ef-4395-80f8-221e1d3fc09e service nova] Releasing lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:38.790653 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:38.790789 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:20:38.860308 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:20:38.860523 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:20:39.343997 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:20:39.362834 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:20:39.473857 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:39.484990 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:39.585343 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Updating instance_info_cache with network_info: [{"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:39.868969 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:20:39.869111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.277s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:39.869393 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:20:39.881790 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:40.087137 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:40.087431 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Instance network_info: |[{"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:20:40.869478 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:40.869890 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:40.871629 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:40.871927 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:40.872156 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:40.872378 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.95 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:20:40.898821 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:40.899466 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing instance network info cache due to event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:40.899686 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] Acquiring lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:40.899866 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] Acquired lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:40.899911 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:41.040244 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:20:41.050750 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:20:41.070120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:41.111870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:20:41.111870 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:20:41.119523 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:20:41.120644 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe6d:b36e', 'fe80::8097:21ff:fe89:3b01', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb', 'fe80::fc16:3eff:fe13:2ee9', 'fe80::f830:cfff:fea4:1adf', 'fe80::fc16:3eff:fe4c:760d', 'fe80::9422:aaff:fe91:e13f'] 
May 28 14:20:41.121543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:20:41.121543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:20:41.121543 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:20:41.121543 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Updating existing volume attachment record: b085b3a8-1c35-4a81-82e5-d56f73da0b5c {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:20:41.403557 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:41.430206 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:41.431613 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing instance network info cache due to event network-changed-ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:41.431943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] Acquiring lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:41.696876 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:41.813478 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updated VIF entry in instance network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:20:41.813721 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:41.927015 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:41.927418 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:42.046093 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:20:42.315357 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e8d2c24e-8064-4c2d-8c0d-28c0c4242de7 req-9299b7b9-ad2d-4e35-b93b-31ed3388cc81 service nova] Releasing lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:42.315747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] Acquired lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:42.315873 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Refreshing network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:42.431735 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Detaching volume ef8420ee-1dc7-426f-8841-158eee5d5af2
May 28 14:20:42.482224 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Attempting to driver detach volume ef8420ee-1dc7-426f-8841-158eee5d5af2 from mountpoint /dev/vdb
May 28 14:20:42.491267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Found disk vdb by alias ua-ef8420ee-1dc7-426f-8841-158eee5d5af2 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:20:42.496627 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Found disk vdb by alias ua-ef8420ee-1dc7-426f-8841-158eee5d5af2 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:20:42.496787 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Attempting to detach device vdb from instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:20:42.497068 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:20:42.497068 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:20:42.497068 np0000001643 nova-compute[98269]:   <alias name="ua-ef8420ee-1dc7-426f-8841-158eee5d5af2"/>
May 28 14:20:42.497068 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:20:42.497068 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:20:42.497068 np0000001643 nova-compute[98269]:   <serial>ef8420ee-1dc7-426f-8841-158eee5d5af2</serial>
May 28 14:20:42.497068 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:20:42.497068 np0000001643 nova-compute[98269]: </disk>
May 28 14:20:42.497068 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:20:42.503829 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully detached device vdb from instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 from the persistent domain config.
May 28 14:20:42.504047 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] (1/8): Attempting to detach device vdb with device alias ua-ef8420ee-1dc7-426f-8841-158eee5d5af2 from instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:20:42.504433 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:20:42.504433 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:20:42.504433 np0000001643 nova-compute[98269]:   <alias name="ua-ef8420ee-1dc7-426f-8841-158eee5d5af2"/>
May 28 14:20:42.504433 np0000001643 nova-compute[98269]:   <source dev="/dev/dm-0"/>
May 28 14:20:42.504433 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:20:42.504433 np0000001643 nova-compute[98269]:   <serial>ef8420ee-1dc7-426f-8841-158eee5d5af2</serial>
May 28 14:20:42.504433 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:20:42.504433 np0000001643 nova-compute[98269]: </disk>
May 28 14:20:42.504433 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:20:42.817781 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:43.019798 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779978043.0187073, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => ua-ef8420ee-1dc7-426f-8841-158eee5d5af2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:20:43.020229 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ef8420ee-1dc7-426f-8841-158eee5d5af2 for instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:20:43.022471 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully detached device vdb from instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 from the live domain config.
May 28 14:20:43.023525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:20:43.023789 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef8420ee-1dc7-426f-8841-158eee5d5af2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:20:43.023943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:43.024423 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:43.024947 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef8420ee-1dc7-426f-8841-158eee5d5af2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:20:43.026535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:20:43.051559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:20:43.051559 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:20:43.051559 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:43.051559 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:43.051559 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:43.051559 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:43.051559 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:43.051772 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:20:43.051772 np0000001643 nova-compute[98269]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2 (non-flash)
May 28 14:20:43.051772 np0000001643 nova-compute[98269]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:43.051772 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:43.051772 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:43.051772 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:43.051772 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:43.051923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:20:43.051923 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', '177')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:20:43.052728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2', '178')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:20:43.054521 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c15b240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:20:43.055286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:20:43.056691 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Flush multipath device 3300000007bd57fb4 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:20:43.094001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:20:43.113612 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:43.138358 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:20:43.197222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:20:43.197222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:20:43.197222 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:20:43.206762 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:20:43.206948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:20:43.218658 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.221111 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:20:43.222217 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:20:43.222458 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Creating image(s)
May 28 14:20:43.222792 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:20:43.222906 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Ensure instance console log exists: /opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:20:43.223098 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:43.223296 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:43.223533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:43.224024 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Start _get_guest_xml network_info=[{"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T14:20:30Z,direct_url=<?>,disk_format='raw',id=20c0c9f7-e62c-4b11-ab10-655eabc3cfce,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1211151056',owner='6a701352f7484e2d810439622b1c8bda',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T14:20:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'b085b3a8-1c35-4a81-82e5-d56f73da0b5c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ad03deb0-8239-40a6-a767-977c60aa5ef5', 'attached_at': '', 'detached_at': '', 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'serial': '81e3bdd9-bd48-4a90-909a-1524da9ff44a'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:20:43.226320 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:20:43.227328 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-905069880', uuid='ad03deb0-8239-40a6-a767-977c60aa5ef5'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='20c0c9f7-e62c-4b11-ab10-655eabc3cfce', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978043.2269948) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:20:43.228523 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:20:43.228842 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:20:43.229844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:20:43.229996 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:20:43.230877 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:20:43.231193 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T14:20:30Z,direct_url=<?>,disk_format='raw',id=20c0c9f7-e62c-4b11-ab10-655eabc3cfce,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1211151056',owner='6a701352f7484e2d810439622b1c8bda',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T14:20:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:20:43.231372 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:20:43.231474 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:20:43.231596 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:20:43.231690 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:20:43.231828 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:20:43.231978 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:20:43.232066 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:20:43.232308 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:20:43.232423 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:20:43.232571 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:20:43.245472 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updated VIF entry in instance network info cache for port ab8e3551-ee50-433f-8a4e-049d64e9d63a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:20:43.245789 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [{"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:43.251285 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:20:43.251559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:20:43.251691 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:43.257391 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.40.100,3260]
May 28 14:20:43.257391 np0000001643 nova-compute[98269]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.40.100,3260] successful.
May 28 14:20:43.257391 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.272721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.283424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.313577 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.50.100,3260]
May 28 14:20:43.313577 np0000001643 nova-compute[98269]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-ef8420ee-1dc7-426f-8841-158eee5d5af2, portal: 192.168.50.100,3260] successful.
May 28 14:20:43.313577 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.327026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.327307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:43.327459 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] <== disconnect_volume: return (303ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:20:43.327585 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:20:43.330671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.079s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:43.330883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:20:43.343255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:43.343980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:43.345961 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:43.346461 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:20:43.347228 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:43.347228 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:20:43.359841 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:20:43.359841 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.369424 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:20:43.369424 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.374562 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a] added
May 28 14:20:43.374562 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:20:43.374562 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:43.374562 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:43.374562 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:43.374562 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:43.374562 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.374862 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:20:43.374911 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:20:43.375083 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:20:43.385262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a] added
May 28 14:20:43.385262 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:20:43.385262 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:43.385262 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:43.385262 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:43.385262 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:43.385262 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:43.385829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:20:43.386080 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:20:43.386223 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:20:43.441528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:43.441713 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:43.748775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3d935cbb-641c-430c-b084-670ba8ce754f req-5d076989-5e52-486a-915a-f2d5d5a03f1a service nova] Releasing lock "refresh_cache-02b6505e-e619-44c7-9c9d-2c247851bbb7" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:43.875177 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'flavor' on Instance uuid 02b6505e-e619-44c7-9c9d-2c247851bbb7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:20:43.945477 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:20:44.375443 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:20:44.386730 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:20:44.389280 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:20:44.389280 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:20:44.400165 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:20:44.400165 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.404820 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.411679 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.418832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.418832 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.418832 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.418832 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.418832 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:44.419016 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.419016 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.419016 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.419016 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.419016 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:44.426952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.426952 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.426952 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.426952 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.426952 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:44.427161 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.427161 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.427161 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.427161 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.427161 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:44.451966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.40.100,3260]
May 28 14:20:44.451966 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.40.100,3260] successful.
May 28 14:20:44.451966 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.467296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.472026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.50.100,3260]
May 28 14:20:44.472026 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.50.100,3260] successful.
May 28 14:20:44.472026 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.485951 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:44.486296 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:44.490836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.490836 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.490836 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.490836 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.490836 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.490836 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.490836 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:44.491117 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.491117 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.491117 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.491117 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.491117 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.491117 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.491117 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:44.491352 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:44.491683 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:20:44.492533 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('7', '-', '-', 0) found on session 185 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:20:44.492761 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:44.507015 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:44.514084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:44.514084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:20:44.514084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('8', '-', '-', 0) found on session 186 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:20:44.514084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:20:44.514084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 185 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:44.514084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:20:44.524090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 186 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:44.524433 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:20:44.827185 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:44.827583 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:20:44.881228 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-20760a78-dc6d-40fc-964e-99e4812a71d4 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.954s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:44.905945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:44.954318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:45.345545 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:20:46.025130 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:46.025473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:46.025473 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Attaching volume 4af3e945-4f5f-4004-9b63-d7c7297b6033 to /dev/vdb
May 28 14:20:46.071164 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:20:46.082651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:20:46.107251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:46.166651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:20:46.166969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:20:46.177220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:20:46.178331 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe6d:b36e', 'fe80::8097:21ff:fe89:3b01', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb', 'fe80::fc16:3eff:fe13:2ee9', 'fe80::f830:cfff:fea4:1adf', 'fe80::fc16:3eff:fe4c:760d', 'fe80::9422:aaff:fe91:e13f'] 
May 28 14:20:46.178524 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:20:46.178686 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:20:46.178954 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:20:46.179222 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Updating existing volume attachment record: b1137277-840f-4d6b-b749-6afd304eb7b4 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:20:46.361978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 3300000006a502339 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:20:46.362536 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:46.362809 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (3111ms) {'type': 'block', 'scsi_wwn': '3300000006a502339', 'path': '/dev/dm-0', 'multipath_id': '3300000006a502339'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:20:46.363001 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006a502339', 'path': '/dev/dm-0', 'multipath_id': '3300000006a502339'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:20:46.364149 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:46.364428 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:46.364704 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:46.364871 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:46.364963 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:46.367771 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Terminating instance
May 28 14:20:46.736910 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:46.737188 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:46.757897 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e', 'attached_at': '', 'detached_at': '', 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'serial': '4af3e945-4f5f-4004-9b63-d7c7297b6033'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:20:46.759290 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:20:46.759578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:20:46.759729 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:46.760143 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:46.760319 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:20:46.773991 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:46.774644 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:46.775301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:46.775678 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:20:46.776093 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:46.776309 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:20:46.786242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:20:46.786242 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:46.791936 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:20:46.791936 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:46.799231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033] added
May 28 14:20:46.799231 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:20:46.799231 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:46.799231 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:46.799231 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:46.799231 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:46.799231 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:46.799487 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:20:46.799592 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:20:46.799756 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:20:46.802890 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033] added
May 28 14:20:46.802890 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:20:46.802890 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:46.802890 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:46.802890 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:46.802890 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:46.802890 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:46.803078 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:20:46.803165 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:20:46.803284 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:20:46.870988 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:20:46.873326 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-905069880',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-905069880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-image-snapshot-server-905069880',id=72,image_ref='20c0c9f7-e62c-4b11-ab10-655eabc3cfce',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxZGnAF7Zs7ay9IHa2qOI4WYGrRecsja8hSvGNj8Z3ptD1jQ1MnZjdw4/rQwFIxWXWHs5G51RPUi9UJDGum/ETzLqdKxpm6oPVL2ugXLpF7rb/noZMF3+50gYeb9gYBcQ==',key_name='tempest-keypair-2084678533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-yb4jc4d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1916664954',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=ad03deb0-8239-40a6-a767-977c60aa5ef5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:20:46.873584 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:20:46.874919 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccc8779-f760-4aed-a816-816570d17e8f,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc8779-f7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:20:46.875572 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid ad03deb0-8239-40a6-a767-977c60aa5ef5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:20:46.887837 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:46.889863 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:46.905735 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:46.924873 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.028475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bc1b3975-ce32-439a-9c56-78ba461d6475 req-69ca5505-ee37-4e6c-9222-a05baccb6a9f service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:47.028845 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bc1b3975-ce32-439a-9c56-78ba461d6475 req-69ca5505-ee37-4e6c-9222-a05baccb6a9f service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:47.028845 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bc1b3975-ce32-439a-9c56-78ba461d6475 req-69ca5505-ee37-4e6c-9222-a05baccb6a9f service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:47.028929 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-bc1b3975-ce32-439a-9c56-78ba461d6475 req-69ca5505-ee37-4e6c-9222-a05baccb6a9f service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:47.029040 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bc1b3975-ce32-439a-9c56-78ba461d6475 req-69ca5505-ee37-4e6c-9222-a05baccb6a9f service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] No waiting events found dispatching network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:47.029547 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-bc1b3975-ce32-439a-9c56-78ba461d6475 req-69ca5505-ee37-4e6c-9222-a05baccb6a9f service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:20:47.189471 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999694244999773 future=<Future at 0x71a780547f20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:47.190111 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999090757999966 future=<Future at 0x71a780547f20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:47.190111 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998953202999928 future=<Future at 0x71a780547f20 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:20:47.191508 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Instance destroyed successfully.
May 28 14:20:47.192002 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lazy-loading 'resources' on Instance uuid 02b6505e-e619-44c7-9c9d-2c247851bbb7 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:20:47.239898 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:20:47.381796 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] End _get_guest_xml xml=<domain type="qemu">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <uuid>ad03deb0-8239-40a6-a767-977c60aa5ef5</uuid>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <name>instance-00000048</name>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-905069880</nova:name>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:20:43</nova:creationTime>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:diskFormat>raw</nova:diskFormat>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="img_bdm_v2">True</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid=""/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         <nova:port uuid="5ccc8779-f760-4aed-a816-816570d17e8f">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <system>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <entry name="serial">ad03deb0-8239-40a6-a767-977c60aa5ef5</entry>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <entry name="uuid">ad03deb0-8239-40a6-a767-977c60aa5ef5</entry>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </system>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <os>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   </os>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <features>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   </features>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   <devices>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5/disk.config"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </disk>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <alias name="ua-81e3bdd9-bd48-4a90-909a-1524da9ff44a"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <serial>81e3bdd9-bd48-4a90-909a-1524da9ff44a</serial>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </disk>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:77:39:d9"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <target dev="tap5ccc8779-f7"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </interface>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5/console.log" append="off"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </serial>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <video>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </video>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </rng>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:   </devices>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]: </domain>
May 28 14:20:47.381796 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:20:47.384238 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Preparing to wait for external event network-vif-plugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:20:47.384238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:47.384238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:47.384238 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:47.384238 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-905069880',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-905069880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-image-snapshot-server-905069880',id=72,image_ref='20c0c9f7-e62c-4b11-ab10-655eabc3cfce',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxZGnAF7Zs7ay9IHa2qOI4WYGrRecsja8hSvGNj8Z3ptD1jQ1MnZjdw4/rQwFIxWXWHs5G51RPUi9UJDGum/ETzLqdKxpm6oPVL2ugXLpF7rb/noZMF3+50gYeb9gYBcQ==',key_name='tempest-keypair-2084678533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-yb4jc4d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1916664954',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=ad03deb0-8239-40a6-a767-977c60aa5ef5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:20:47.384238 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:20:47.384629 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccc8779-f760-4aed-a816-816570d17e8f,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc8779-f7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:20:47.384751 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccc8779-f760-4aed-a816-816570d17e8f,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc8779-f7') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:20:47.385270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.385624 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:47.385845 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:20:47.386612 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.386812 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45ea2204-ca62-5ad7-aef7-ffad4ce9d94c', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:47.405415 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.405945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:47.410888 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.412784 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.412928 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccc8779-f7, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:47.413206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ccc8779-f7, col_values=(('qos', UUID('696f7565-a07c-4c19-af70-55f6660adf4a')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:47.413348 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ccc8779-f7, col_values=(('external_ids', {'iface-id': '5ccc8779-f760-4aed-a816-816570d17e8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:39:d9', 'vm-uuid': 'ad03deb0-8239-40a6-a767-977c60aa5ef5'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:47.414130 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.415071 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:47.423089 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.423886 np0000001643 nova-compute[98269]: INFO os_vif [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccc8779-f760-4aed-a816-816570d17e8f,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc8779-f7')
May 28 14:20:47.694046 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1736171292',display_name='tempest-TestMinimumBasicScenario-server-1736171292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testminimumbasicscenario-server-1736171292',id=68,image_ref='fc1c8cef-8324-4e74-80c1-68bc8d48ceed',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZi3di/U9b0AJ+OUUb8sQFprIpK1ZqmTQ+7cjDfGpCJ3aNVITLgXYo66+i9HTOCBMN4TN0wDJTKiWK6nqd7y1HCIni2PC6Jb4JL7bowd5RKS1QQYkM8To+uVup/40m9sw==',key_name='tempest-TestMinimumBasicScenario-526461137',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:19:25Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19477b13dbf4580a9341cfc05b6b7e1',ramdisk_id='',reservation_id='r-2j99a5z7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fc1c8cef-8324-4e74-80c1-68bc8d48ceed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1492567984',owner_user_name='tempest-TestMinimumBasicScenario-1492567984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:20:03Z,user_data=None,user_id='c8481a6da3424bd79d4706a19f2de577',uuid=02b6505e-e619-44c7-9c9d-2c247851bbb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:20:47.694297 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converting VIF {"id": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "address": "fa:16:3e:13:2e:e9", "network": {"id": "97408316-bceb-4340-9819-51359248d692", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-933750517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d19477b13dbf4580a9341cfc05b6b7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab8e3551-ee", "ovs_interfaceid": "ab8e3551-ee50-433f-8a4e-049d64e9d63a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:20:47.694693 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:2e:e9,bridge_name='br-int',has_traffic_filtering=True,id=ab8e3551-ee50-433f-8a4e-049d64e9d63a,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8e3551-ee') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:20:47.695105 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:2e:e9,bridge_name='br-int',has_traffic_filtering=True,id=ab8e3551-ee50-433f-8a4e-049d64e9d63a,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8e3551-ee') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:20:47.696144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.696318 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab8e3551-ee, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:47.697283 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.697827 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:47.702708 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.703399 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.703532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46f2c9b6-c259-468f-8d0b-2fdcac73d28c) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:47.704048 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.704391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:47.709619 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:47.711780 np0000001643 nova-compute[98269]: INFO os_vif [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:2e:e9,bridge_name='br-int',has_traffic_filtering=True,id=ab8e3551-ee50-433f-8a4e-049d64e9d63a,network=Network(97408316-bceb-4340-9819-51359248d692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab8e3551-ee')
May 28 14:20:47.712094 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Deleting instance files /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7_del
May 28 14:20:47.712902 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Deletion of /opt/stack/data/nova/instances/02b6505e-e619-44c7-9c9d-2c247851bbb7_del complete
May 28 14:20:47.791316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:47.791625 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:47.795489 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:20:47.795718 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Claim successful on node np0000001643
May 28 14:20:47.800075 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:20:47.803704 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:20:47.812050 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:20:47.812050 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:20:47.817817 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:20:47.817817 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.823281 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:20:47.823651 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:20:47.824461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.830795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.840106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.840106 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.840106 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.840106 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.840106 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.840106 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.840106 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:47.840349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.840349 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.840349 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.840349 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.840349 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.840349 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.840349 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:47.845417 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.845417 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.845417 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.845417 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.845417 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.845417 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.845417 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:47.845610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.845610 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.845610 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.845610 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.845610 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.845610 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.845610 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:47.880474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.40.100,3260]
May 28 14:20:47.880474 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.40.100,3260] successful.
May 28 14:20:47.880474 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.885638 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.50.100,3260]
May 28 14:20:47.885638 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.50.100,3260] successful.
May 28 14:20:47.885638 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.891507 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.898669 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.907655 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.907905 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:47.908170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:47.908377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:20:47.909554 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('13', '-', '-', 0) found on session 187 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:20:47.909704 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.915296 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:47.916165 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:47.916165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:20:47.916847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('14', '-', '-', 0) found on session 188 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:20:47.916946 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:20:47.923121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 187 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:47.923121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:20:47.930377 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 188 and hctl ['14', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:48.218701 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 14:20:48.219117 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:20:48.219325 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:20:48.219474 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:20:48.219715 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:48.309190 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:48.583004 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-26abd484-d920-446a-96fd-ce6a70904378 req-dbc3bca4-ca5c-44d9-bf99-71a008718aa8 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-deleted-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:48.583362 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-26abd484-d920-446a-96fd-ce6a70904378 req-dbc3bca4-ca5c-44d9-bf99-71a008718aa8 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Neutron deleted interface ab8e3551-ee50-433f-8a4e-049d64e9d63a; detaching it from the instance and deleting it from the info cache
May 28 14:20:48.584894 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-26abd484-d920-446a-96fd-ce6a70904378 req-dbc3bca4-ca5c-44d9-bf99-71a008718aa8 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Detach interface failed, port_id=ab8e3551-ee50-433f-8a4e-049d64e9d63a, reason: Instance 02b6505e-e619-44c7-9c9d-2c247851bbb7 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:20:48.930416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 188 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:48.930563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:20:48.938464 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:20:48.938651 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:20:48.938763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:77:39:d9, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:20:48.939269 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Using config drive
May 28 14:20:49.031821 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:49.089076 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fa9681a1-b991-4b27-bf06-fbc687434fc6 req-9c3045a0-53e2-4bdd-873a-b7637b6bcd93 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:49.089259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa9681a1-b991-4b27-bf06-fbc687434fc6 req-9c3045a0-53e2-4bdd-873a-b7637b6bcd93 service nova] Acquiring lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:49.089397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa9681a1-b991-4b27-bf06-fbc687434fc6 req-9c3045a0-53e2-4bdd-873a-b7637b6bcd93 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:49.089541 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-fa9681a1-b991-4b27-bf06-fbc687434fc6 req-9c3045a0-53e2-4bdd-873a-b7637b6bcd93 service nova] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:49.089958 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fa9681a1-b991-4b27-bf06-fbc687434fc6 req-9c3045a0-53e2-4bdd-873a-b7637b6bcd93 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] No waiting events found dispatching network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:49.090155 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-fa9681a1-b991-4b27-bf06-fbc687434fc6 req-9c3045a0-53e2-4bdd-873a-b7637b6bcd93 service nova] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Received event network-vif-unplugged-ab8e3551-ee50-433f-8a4e-049d64e9d63a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:20:49.091116 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:20:49.091462 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:20:49.444307 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:49.533616 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Took 1.31 seconds to deallocate network for instance.
May 28 14:20:49.569882 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Creating config drive at /opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5/disk.config
May 28 14:20:49.575858 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_schdrkn {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:49.596391 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:20:49.649409 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_schdrkn" returned: 0 in 0.073s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:20:49.791376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found WWN 33000000042e4a820 for multipath device dm-9 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:20:49.791960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:49.793026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '33000000042e4a820', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '33000000042e4a820'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:20:49.793215 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000042e4a820', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '33000000042e4a820'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:20:49.795430 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:20:49.795708 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:20:49.795896 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:20:49.796684 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71a7801f5a90>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e', 'attached_at': '', 'detached_at': '', 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'serial': '4af3e945-4f5f-4004-9b63-d7c7297b6033'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:20:49.796872 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98269) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 14:20:49.797034 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] opening encrypted volume /dev/dm-9 {{(pid=98269) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 14:20:49.830565 np0000001643 nova-compute[98269]: WARNING os_brick.encryptors.luks [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 14:20:49.830705 np0000001643 nova-compute[98269]: INFO os_brick.encryptors.luks [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] /dev/dm-9 is not a valid LUKS device; formatting device for first use
May 28 14:20:49.830835 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] formatting encrypted volume /dev/dm-9 {{(pid=98269) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 14:20:49.905829 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:50.033110 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:50.041861 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:50.055736 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:50.057956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:50.108928 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.317s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:50.109797 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.068s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:50.110118 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:20:50.149135 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:50.209227 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:50.210205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '117f5a19409d45e9be5e969913c67263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cb6ddda14738b70c2460eb02dc4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978050.8216765, ad03deb0-8239-40a6-a767-977c60aa5ef5 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] VM Started (Lifecycle Event)
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-vif-plugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Processing event network-vif-plugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-vif-plugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] No waiting events found dispatching network-vif-plugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-0fa6ac3d-650e-401b-916f-73ce8b34ed22 req-d94bbefc-4c8a-45eb-898e-1da1ca4a616e service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received unexpected event network-vif-plugged-5ccc8779-f760-4aed-a816-816570d17e8f for instance with vm_state building and task_state spawning.
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Instance spawned successfully.
May 28 14:20:51.176879 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:20:51.180017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:51.180017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:20:51.244335 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Successfully created port: 10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:20:51.325878 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:51.329466 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:51.460135 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.351s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:51.553820 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Deleted allocations for instance 02b6505e-e619-44c7-9c9d-2c247851bbb7
May 28 14:20:51.632482 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:20:51.686505 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Took 8.46 seconds to spawn the instance on the hypervisor.
May 28 14:20:51.686505 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:51.830655 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:20:51.830965 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978051.8307433, ad03deb0-8239-40a6-a767-977c60aa5ef5 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:51.831081 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] VM Paused (Lifecycle Event)
May 28 14:20:51.860538 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Successfully updated port: 10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:20:51.919360 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-changed-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:51.919626 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Refreshing instance network info cache due to event network-changed-10860281-714d-496c-8291-f49e6d56579f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:51.919795 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] Acquiring lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:51.919893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] Acquired lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:51.919993 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Refreshing network info cache for port 10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:52.151128 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Booting with volume 13a32d7b-7505-42a9-bc59-f9d2ee13dd9f at /dev/vda
May 28 14:20:52.217193 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Took 18.37 seconds to build instance.
May 28 14:20:52.244416 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:20:52.258065 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:20:52.285608 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:20:52.337866 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:52.345442 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978052.3450723, ad03deb0-8239-40a6-a767-977c60aa5ef5 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:20:52.345704 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] VM Resumed (Lifecycle Event)
May 28 14:20:52.348176 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:20:52.348176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:20:52.363079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:52.368274 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:20:52.369454 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe6d:b36e', 'fe80::8097:21ff:fe89:3b01', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb', 'fe80::fc16:3eff:fe4c:760d', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fe77:39d9'] 
May 28 14:20:52.369623 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:20:52.369728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:20:52.369979 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:20:52.370192 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Updating existing volume attachment record: d01997ba-b53d-4dc6-967d-07eadf5fb384 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:20:52.423433 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:52.536081 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:20:52.565456 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d6dceefa-d03e-4ba8-8a21-74fdef9319b3 tempest-TestMinimumBasicScenario-1492567984 tempest-TestMinimumBasicScenario-1492567984-project-member] Lock "02b6505e-e619-44c7-9c9d-2c247851bbb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.201s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:52.708376 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:52.721193 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5bc21740-0496-4572-a15e-977e2d7e9ede tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.878s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:52.791414 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:52.857573 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:20:52.864349 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:20:53.293664 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b56aef9a-8cc2-4219-9f76-ed75cf902f95 req-31fe57db-6351-4176-b28f-12d2a8046f22 service nova] Releasing lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:53.294113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquired lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:53.294361 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:20:53.870846 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:20:53.995739 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-changed-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:20:53.998366 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Refreshing instance network info cache due to event network-changed-5ccc8779-f760-4aed-a816-816570d17e8f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:20:53.998576 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] Acquiring lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:20:53.998673 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] Acquired lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:20:53.998777 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Refreshing network info cache for port 5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:20:54.053125 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:54.269990 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Updating instance_info_cache with network_info: [{"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:54.504702 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:54.538306 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:20:54.539732 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:20:54.540026 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Creating image(s)
May 28 14:20:54.540964 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:20:54.541228 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Ensure instance console log exists: /opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:20:54.541567 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:54.541848 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:54.542078 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:54.771041 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Releasing lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:54.778474 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Instance network_info: |[{"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:20:54.778474 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Start _get_guest_xml network_info=[{"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'd01997ba-b53d-4dc6-967d-07eadf5fb384', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '99929164-66e4-49d4-9241-c61f6e2cc985', 'attached_at': '', 'detached_at': '', 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'serial': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:20:54.785555 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:20:54.785555 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-935027716', uuid='99929164-66e4-49d4-9241-c61f6e2cc985'), owner=OwnerMeta(userid='117f5a19409d45e9be5e969913c67263', username='tempest-TestVolumeBootPatternV346-425599745-project-member', projectid='18d5cb6ddda14738b70c2460eb02dc4c', projectname='tempest-TestVolumeBootPatternV346-425599745'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978054.7828944) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:20:54.786268 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:20:54.787993 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:20:54.789237 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:20:54.789616 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:20:54.791106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:20:54.791700 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:20:54.792007 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:20:54.792192 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:20:54.792359 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:20:54.792600 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:20:54.792797 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:20:54.793050 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:20:54.793249 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:20:54.793461 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:20:54.793662 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:20:54.793812 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:20:54.812765 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:20:54.813302 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:20:54.813727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:54.814316 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:54.814705 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:20:54.830517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:54.831055 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:20:54.831598 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:54.831825 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:20:54.832139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:20:54.832951 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:20:54.852732 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:20:54.852732 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:54.856874 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:20:54.856874 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:54.869243 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f] added
May 28 14:20:54.869243 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:20:54.869243 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:54.869243 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:54.869243 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:54.869243 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:54.869243 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:54.869243 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:20:54.869243 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:20:54.869732 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:20:54.872150 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f] added
May 28 14:20:54.872150 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:20:54.872150 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:54.872150 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:54.872150 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:20:54.872150 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:20:54.872150 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:54.872374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:20:54.872642 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:20:54.872642 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:20:54.899575 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:20:54.970484 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:54.975973 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:55.074767 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Updated VIF entry in instance network info cache for port 5ccc8779-f760-4aed-a816-816570d17e8f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:20:55.075315 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Updating instance_info_cache with network_info: [{"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:20:55.591967 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b1d5ad76-c65c-41a1-9bab-66b0193a81ba req-a9c8fe10-ccc5-4d32-a323-1a0cb4c954b6 service nova] Releasing lock "refresh_cache-ad03deb0-8239-40a6-a767-977c60aa5ef5" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:20:55.870018 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:20:55.872946 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:20:55.882641 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:20:55.882641 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:20:55.889228 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:20:55.889228 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:55.903474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:55.911272 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.924791 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.934540 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:55.935336 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:55.967697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.50.100,3260]
May 28 14:20:55.967697 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.50.100,3260] successful.
May 28 14:20:55.967697 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:55.982904 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:55.991988 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.40.100,3260]
May 28 14:20:55.991988 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.40.100,3260] successful.
May 28 14:20:55.991988 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.004724 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] HCTL ('15', '-', '-', 0) found on session 189 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:20:56.004724 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:20:56.009064 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:20:56.021720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 189 and hctl ['15', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:20:56.040919 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:56.040919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:20:56.041964 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] HCTL ('16', '-', '-', 0) found on session 190 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:20:56.042195 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:20:56.066208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 190 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:56.066208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:20:57.023061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 189 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:20:57.023061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:20:57.176114 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:57.242183 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:57.709722 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:57.849633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Found WWN 330000000556d5875 for multipath device dm-10 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:20:57.849893 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:20:57.850015 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000556d5875', 'path': '/dev/dm-10', 'multipath_id': '330000000556d5875'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:20:57.850144 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000556d5875', 'path': '/dev/dm-10', 'multipath_id': '330000000556d5875'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:20:57.989374 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] opening encrypted volume /dev/dm-9 {{(pid=98269) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 14:20:58.355505 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-935027716',display_name='tempest-TestVolumeBootPatternV346-server-935027716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-935027716',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58ttUAiDmV/Kknz0CnjJ8vOzuAdWfpyJDfyQUUErkzlOzHyceuEuYwxd4swPXzJfrDgAVEHTqkUZsnA0LjJKFNofDaXBYRQv7iRyvmipXoSdVFSN72/WldIZ8/6kzl5Q==',key_name='tempest-keypair-713122902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-nyhhlxjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=99929164-66e4-49d4-9241-c61f6e2cc985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:20:58.356018 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:20:58.356270 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:72:f1,bridge_name='br-int',has_traffic_filtering=True,id=10860281-714d-496c-8291-f49e6d56579f,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10860281-71') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:20:58.363490 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lazy-loading 'pci_devices' on Instance uuid 99929164-66e4-49d4-9241-c61f6e2cc985 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:20:58.867136 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] End _get_guest_xml xml=<domain type="qemu">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <uuid>99929164-66e4-49d4-9241-c61f6e2cc985</uuid>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <name>instance-00000049</name>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPatternV346-server-935027716</nova:name>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:20:54</nova:creationTime>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:user uuid="117f5a19409d45e9be5e969913c67263">tempest-TestVolumeBootPatternV346-425599745-project-member</nova:user>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:project uuid="18d5cb6ddda14738b70c2460eb02dc4c">tempest-TestVolumeBootPatternV346-425599745</nova:project>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         <nova:port uuid="10860281-714d-496c-8291-f49e6d56579f">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <system>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <entry name="serial">99929164-66e4-49d4-9241-c61f6e2cc985</entry>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <entry name="uuid">99929164-66e4-49d4-9241-c61f6e2cc985</entry>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </system>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <os>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   </os>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <features>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   </features>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   <devices>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985/disk.config"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </disk>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <alias name="ua-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-10"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <serial>13a32d7b-7505-42a9-bc59-f9d2ee13dd9f</serial>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </disk>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:b5:72:f1"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <target dev="tap10860281-71"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </interface>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985/console.log" append="off"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </serial>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <video>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </video>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </rng>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:   </devices>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]: </domain>
May 28 14:20:58.867136 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Preparing to wait for external event network-vif-plugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-935027716',display_name='tempest-TestVolumeBootPatternV346-server-935027716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-935027716',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58ttUAiDmV/Kknz0CnjJ8vOzuAdWfpyJDfyQUUErkzlOzHyceuEuYwxd4swPXzJfrDgAVEHTqkUZsnA0LjJKFNofDaXBYRQv7iRyvmipXoSdVFSN72/WldIZ8/6kzl5Q==',key_name='tempest-keypair-713122902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-nyhhlxjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=99929164-66e4-49d4-9241-c61f6e2cc985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:72:f1,bridge_name='br-int',has_traffic_filtering=True,id=10860281-714d-496c-8291-f49e6d56579f,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10860281-71') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:20:58.870518 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:72:f1,bridge_name='br-int',has_traffic_filtering=True,id=10860281-714d-496c-8291-f49e6d56579f,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10860281-71') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:20:58.870839 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:58.870839 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:58.870985 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:20:58.871695 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:58.871837 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2b659c0-6211-5757-8442-8056e01b1af0', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:58.874615 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:58.875359 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:58.882697 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:58.882900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10860281-71, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:58.883206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10860281-71, col_values=(('qos', UUID('814ec1b0-8978-4a12-bd3e-165fbb541f67')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:58.883353 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10860281-71, col_values=(('external_ids', {'iface-id': '10860281-714d-496c-8291-f49e6d56579f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:72:f1', 'vm-uuid': '99929164-66e4-49d4-9241-c61f6e2cc985'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:20:58.886241 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:58.887370 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:20:58.890352 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:20:58.891320 np0000001643 nova-compute[98269]: INFO os_vif [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:72:f1,bridge_name='br-int',has_traffic_filtering=True,id=10860281-714d-496c-8291-f49e6d56579f,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10860281-71')
May 28 14:20:59.972407 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:00.112127 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:21:00.408312 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:21:00.408513 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:21:00.408614 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No VIF found with MAC fa:16:3e:b5:72:f1, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:21:00.409051 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Using config drive
May 28 14:21:00.614155 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Attempting to attach volume 4af3e945-4f5f-4004-9b63-d7c7297b6033 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:21:00.615580 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:21:00.615580 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:21:00.615580 np0000001643 nova-compute[98269]:   <alias name="ua-4af3e945-4f5f-4004-9b63-d7c7297b6033"/>
May 28 14:21:00.615580 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 14:21:00.615580 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:21:00.615580 np0000001643 nova-compute[98269]:   <serial>4af3e945-4f5f-4004-9b63-d7c7297b6033</serial>
May 28 14:21:00.615580 np0000001643 nova-compute[98269]: </disk>
May 28 14:21:00.615580 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:21:00.914517 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:01.043341 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Creating config drive at /opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985/disk.config
May 28 14:21:01.047710 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwiutr5el {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:01.102271 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwiutr5el" returned: 0 in 0.054s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:01.517211 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:01.544481 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:01.548406 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:01.657314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:01.691018 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:01.691989 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:01.720880 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-915c75df-d5cb-457d-8841-a717a53763e1 req-8713d0b9-c924-4e29-b506-e7b90abbf032 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-vif-plugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:01.721166 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-915c75df-d5cb-457d-8841-a717a53763e1 req-8713d0b9-c924-4e29-b506-e7b90abbf032 service nova] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:01.721370 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-915c75df-d5cb-457d-8841-a717a53763e1 req-8713d0b9-c924-4e29-b506-e7b90abbf032 service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:01.721543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-915c75df-d5cb-457d-8841-a717a53763e1 req-8713d0b9-c924-4e29-b506-e7b90abbf032 service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:01.721610 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-915c75df-d5cb-457d-8841-a717a53763e1 req-8713d0b9-c924-4e29-b506-e7b90abbf032 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Processing event network-vif-plugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:21:02.189625 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005128030002197193 future=<Future at 0x71a780547f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:02.190020 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Emitting event <LifecycleEvent: 1779978047.1889772, 02b6505e-e619-44c7-9c9d-2c247851bbb7 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:02.190167 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:02.190282 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] VM Stopped (Lifecycle Event)
May 28 14:21:02.233855 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978062.2335157, 99929164-66e4-49d4-9241-c61f6e2cc985 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:02.234270 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:21:02.234428 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] VM Started (Lifecycle Event)
May 28 14:21:02.238829 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:21:02.240800 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Instance spawned successfully.
May 28 14:21:02.241051 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:21:02.268466 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:21:02.268631 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:21:02.268715 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:21:02.268812 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:4c:76:0d, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:21:02.692555 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 02b6505e-e619-44c7-9c9d-2c247851bbb7] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:02.736768 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:02.738785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:21:02.749880 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:02.750012 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:02.750241 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:02.750462 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:02.750670 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:02.750874 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:03.241048 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:21:03.242199 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978063.2417982, 99929164-66e4-49d4-9241-c61f6e2cc985 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:03.242483 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] VM Paused (Lifecycle Event)
May 28 14:21:03.255768 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Took 8.72 seconds to spawn the instance on the hypervisor.
May 28 14:21:03.255921 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:03.745026 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:03.747175 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978063.746958, 99929164-66e4-49d4-9241-c61f6e2cc985 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:03.747343 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] VM Resumed (Lifecycle Event)
May 28 14:21:03.767068 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Took 16.02 seconds to build instance.
May 28 14:21:03.797562 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9ccdf728-5ff6-412c-95de-b3399ebc1f82 req-19f2fab6-a7eb-4b0a-93dc-25de90c37f15 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-vif-plugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:03.797727 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9ccdf728-5ff6-412c-95de-b3399ebc1f82 req-19f2fab6-a7eb-4b0a-93dc-25de90c37f15 service nova] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:03.797893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9ccdf728-5ff6-412c-95de-b3399ebc1f82 req-19f2fab6-a7eb-4b0a-93dc-25de90c37f15 service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:03.798016 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9ccdf728-5ff6-412c-95de-b3399ebc1f82 req-19f2fab6-a7eb-4b0a-93dc-25de90c37f15 service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:03.798129 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9ccdf728-5ff6-412c-95de-b3399ebc1f82 req-19f2fab6-a7eb-4b0a-93dc-25de90c37f15 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] No waiting events found dispatching network-vif-plugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:03.798266 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-9ccdf728-5ff6-412c-95de-b3399ebc1f82 req-19f2fab6-a7eb-4b0a-93dc-25de90c37f15 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received unexpected event network-vif-plugged-10860281-714d-496c-8291-f49e6d56579f for instance with vm_state active and task_state None.
May 28 14:21:03.836425 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0acc1bdc-e9d2-4e5e-9433-91def992f931 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.810s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:03.886722 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:04.249883 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:04.251972 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:21:04.268987 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.532s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:04.369877 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:04.370084 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:04.872640 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Detaching volume 4af3e945-4f5f-4004-9b63-d7c7297b6033
May 28 14:21:04.945942 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Attempting to driver detach volume 4af3e945-4f5f-4004-9b63-d7c7297b6033 from mountpoint /dev/vdb
May 28 14:21:04.974462 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:04.983556 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e', 'attached_at': '', 'detached_at': '', 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'serial': '4af3e945-4f5f-4004-9b63-d7c7297b6033'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:21:04.989979 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-4af3e945-4f5f-4004-9b63-d7c7297b6033 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:21:04.991374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-4af3e945-4f5f-4004-9b63-d7c7297b6033 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:21:04.991374 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Attempting to detach device vdb from instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:21:04.991645 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:21:04.991645 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:21:04.991645 np0000001643 nova-compute[98269]:   <alias name="ua-4af3e945-4f5f-4004-9b63-d7c7297b6033"/>
May 28 14:21:04.991645 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 14:21:04.991645 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:21:04.991645 np0000001643 nova-compute[98269]:   <serial>4af3e945-4f5f-4004-9b63-d7c7297b6033</serial>
May 28 14:21:04.991645 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:21:04.991645 np0000001643 nova-compute[98269]: </disk>
May 28 14:21:04.991645 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:21:04.997735 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e from the persistent domain config.
May 28 14:21:04.998183 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] (1/8): Attempting to detach device vdb with device alias ua-4af3e945-4f5f-4004-9b63-d7c7297b6033 from instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:21:04.998183 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:21:04.998183 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:21:04.998183 np0000001643 nova-compute[98269]:   <alias name="ua-4af3e945-4f5f-4004-9b63-d7c7297b6033"/>
May 28 14:21:04.998183 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 14:21:04.998183 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:21:04.998183 np0000001643 nova-compute[98269]:   <serial>4af3e945-4f5f-4004-9b63-d7c7297b6033</serial>
May 28 14:21:04.998183 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:21:04.998183 np0000001643 nova-compute[98269]: </disk>
May 28 14:21:04.998183 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:21:05.507727 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779978065.5072048, 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e => ua-4af3e945-4f5f-4004-9b63-d7c7297b6033> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:21:05.509248 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4af3e945-4f5f-4004-9b63-d7c7297b6033 for instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:21:05.512990 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e from the live domain config.
May 28 14:21:05.515781 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:21:05.516039 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:21:05.516256 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:21:05.516991 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x71a7781a29c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e', 'attached_at': '', 'detached_at': '', 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'serial': '4af3e945-4f5f-4004-9b63-d7c7297b6033'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:21:05.517150 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] closing encrypted volume /dev/dm-13 {{(pid=98269) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 14:21:05.549712 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:21:05.550003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:21:05.550214 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:21:05.550636 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:21:05.550980 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4af3e945-4f5f-4004-9b63-d7c7297b6033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:21:05.551111 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753e2191-e013-42f4-9bd1-36fa55f93925 (non-flash)
May 28 14:21:05.587236 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033 (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753e2191-e013-42f4-9bd1-36fa55f93925 (non-flash)
May 28 14:21:05.587626 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:21:05.588122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-753e2191-e013-42f4-9bd1-36fa55f93925', '191')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:21:05.588122 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', '187')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:21:05.589536 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033', '188')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:21:05.590912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781522a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'): ({'sdi'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:21:05.591183 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Removing multipathed devices sdi, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:21:05.591784 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flush multipath device 33000000042e4a820 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:21:05.635393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:21:05.692859 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:21:05.733159 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:21:05.733356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:21:05.734975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:21:05.746841 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:21:05.747056 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:21:05.758898 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:05.792849 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.40.100,3260]
May 28 14:21:05.792849 np0000001643 nova-compute[98269]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.40.100,3260] successful.
May 28 14:21:05.792849 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:05.817787 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:05.829166 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:05.863610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.50.100,3260]
May 28 14:21:05.863610 np0000001643 nova-compute[98269]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-4af3e945-4f5f-4004-9b63-d7c7297b6033, portal: 192.168.50.100,3260] successful.
May 28 14:21:05.863610 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:05.865712 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-changed-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:05.865840 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Refreshing instance network info cache due to event network-changed-10860281-714d-496c-8291-f49e6d56579f. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:21:05.866032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] Acquiring lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:05.868417 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] Acquired lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:05.871467 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Refreshing network info cache for port 10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:21:05.882924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:05.883964 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:21:05.884118 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== disconnect_volume: return (334ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:21:05.884286 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:21:06.375125 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:06.445861 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:21:06.723243 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:06.856997 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Updated VIF entry in instance network info cache for port 10860281-714d-496c-8291-f49e6d56579f. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:21:06.857269 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Updating instance_info_cache with network_info: [{"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:07.359296 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2bd6301e-9c14-4aed-81d3-c3c4c8efd428 req-f1e3b96f-f706-47c2-b4ae-bc0723e54844 service nova] Releasing lock "refresh_cache-99929164-66e4-49d4-9241-c61f6e2cc985" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:21:07.451147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-287c5790-d617-4de4-be42-f85d1b6a4caa tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.081s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:07.683745 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:07.683998 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:07.684272 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:07.684641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:07.684641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:07.688837 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Terminating instance
May 28 14:21:08.197472 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:21:08.214264 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.216511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.232743 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.235266 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.256507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.257615 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.380377 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-840f7540-bf3d-4062-be83-c9cb80843cdd req-fdfa86af-52d7-4a0f-9e4a-23c04a026f3a service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-vif-unplugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:08.380584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-840f7540-bf3d-4062-be83-c9cb80843cdd req-fdfa86af-52d7-4a0f-9e4a-23c04a026f3a service nova] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:08.380793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-840f7540-bf3d-4062-be83-c9cb80843cdd req-fdfa86af-52d7-4a0f-9e4a-23c04a026f3a service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:08.383546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-840f7540-bf3d-4062-be83-c9cb80843cdd req-fdfa86af-52d7-4a0f-9e4a-23c04a026f3a service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:08.383546 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-840f7540-bf3d-4062-be83-c9cb80843cdd req-fdfa86af-52d7-4a0f-9e4a-23c04a026f3a service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] No waiting events found dispatching network-vif-unplugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:08.383546 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-840f7540-bf3d-4062-be83-c9cb80843cdd req-fdfa86af-52d7-4a0f-9e4a-23c04a026f3a service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-vif-unplugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:21:08.501387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.508026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:08.535545 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999667013999897 future=<Future at 0x71a78056f140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:08.535545 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999339337000038 future=<Future at 0x71a78056f140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:08.535545 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999163772999964 future=<Future at 0x71a78056f140 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:08.537834 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Instance destroyed successfully.
May 28 14:21:08.538355 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'resources' on Instance uuid 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:21:08.888431 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:09.040881 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1449946465',display_name='tempest-TestEncryptedCinderVolumes-server-1449946465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1449946465',id=71,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Dl2W27PjwKqBRcL2OG+ApuKgTjQLRQB1V+C00+gx+Vxip15UwM4EHAd5eIL3oKmVLda7g9gSwwoJrY/1SLLkvdLll7JU2d85vo4G5VSKij8A+/16LsGjlSaAuVpXFaA==',key_name='tempest-keypair-483978194',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:20:18Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-i16x80x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:21:09.041098 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "address": "fa:16:3e:4c:76:0d", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3b0bb9-52", "ovs_interfaceid": "df3b0bb9-525e-4a62-a2fb-fb0a7ad28760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:21:09.041627 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:76:0d,bridge_name='br-int',has_traffic_filtering=True,id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3b0bb9-52') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:21:09.041903 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:76:0d,bridge_name='br-int',has_traffic_filtering=True,id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3b0bb9-52') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:21:09.043219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:09.044112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf3b0bb9-52, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:09.045197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:09.045197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:09.046033 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:09.046772 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:09.046772 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d149f079-4b8f-434c-a150-18223bc94123) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:09.047493 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:09.047493 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:09.048211 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:09.049718 np0000001643 nova-compute[98269]: INFO os_vif [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:76:0d,bridge_name='br-int',has_traffic_filtering=True,id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3b0bb9-52')
May 28 14:21:09.050111 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Deleting instance files /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e_del
May 28 14:21:09.050872 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Deletion of /opt/stack/data/nova/instances/1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e_del complete
May 28 14:21:09.556235 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 14:21:09.556823 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:21:09.557108 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:21:09.557225 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:21:09.557473 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:09.650797 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:09.976116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:10.156270 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4d9dcc9a-0e74-47b1-b7bc-907dc5f1e4d5 req-e31020f1-d3b5-44c5-8a46-992060cc5010 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-vif-deleted-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:10.156508 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-4d9dcc9a-0e74-47b1-b7bc-907dc5f1e4d5 req-e31020f1-d3b5-44c5-8a46-992060cc5010 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Neutron deleted interface df3b0bb9-525e-4a62-a2fb-fb0a7ad28760; detaching it from the instance and deleting it from the info cache
May 28 14:21:10.158290 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4d9dcc9a-0e74-47b1-b7bc-907dc5f1e4d5 req-e31020f1-d3b5-44c5-8a46-992060cc5010 service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Detach interface failed, port_id=df3b0bb9-525e-4a62-a2fb-fb0a7ad28760, reason: Instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:21:10.446904 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-80258af2-a31c-4eaa-903d-738a59c4a258 req-cd7bf3c4-e278-4ba7-8a31-1082df9d65cb service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-vif-unplugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:10.447126 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80258af2-a31c-4eaa-903d-738a59c4a258 req-cd7bf3c4-e278-4ba7-8a31-1082df9d65cb service nova] Acquiring lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:10.447326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80258af2-a31c-4eaa-903d-738a59c4a258 req-cd7bf3c4-e278-4ba7-8a31-1082df9d65cb service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:10.447621 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-80258af2-a31c-4eaa-903d-738a59c4a258 req-cd7bf3c4-e278-4ba7-8a31-1082df9d65cb service nova] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:10.448880 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-80258af2-a31c-4eaa-903d-738a59c4a258 req-cd7bf3c4-e278-4ba7-8a31-1082df9d65cb service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] No waiting events found dispatching network-vif-unplugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:10.451352 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-80258af2-a31c-4eaa-903d-738a59c4a258 req-cd7bf3c4-e278-4ba7-8a31-1082df9d65cb service nova] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Received event network-vif-unplugged-df3b0bb9-525e-4a62-a2fb-fb0a7ad28760 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:21:10.605185 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:11.107336 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Took 1.55 seconds to deallocate network for instance.
May 28 14:21:11.612706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:11.613320 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:11.895633 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:21:11.895898 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:21:12.398614 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:21:12.905858 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.293s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:12.949647 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deleted allocations for instance 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e
May 28 14:21:13.958302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-be0a0321-2808-4540-beeb-b3d0093d4725 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.274s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:14.050029 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:14.979562 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:18.185759 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:18.186247 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:18.688339 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:21:19.049292 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:19.237114 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:19.237619 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:19.240514 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:21:19.240678 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Claim successful on node np0000001643
May 28 14:21:19.981939 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:20.544542 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:21:20.544928 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:21:21.047763 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:21:21.555459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.318s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:21.555926 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:21:22.060604 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:21:22.061616 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:21:22.062612 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:22.062612 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:22.176560 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '039853f7e499423384aa13ada9b39d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ea6d8cf0d14c40ad9163f647b3d065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:21:22.564385 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:21:22.628487 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Successfully created port: 6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:21:23.070884 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:21:23.082579 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Successfully updated port: 6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:21:23.135042 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-changed-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:23.135119 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Refreshing instance network info cache due to event network-changed-6ca52656-0417-4c07-901f-b10823a33b3a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:21:23.135489 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] Acquiring lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:23.135489 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] Acquired lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:23.135876 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Refreshing network info cache for port 6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:21:23.535194 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00046329699989655637 future=<Future at 0x71a78056f140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:23.535600 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Emitting event <LifecycleEvent: 1779978068.5345693, 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:23.535708 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:23.535919 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] VM Stopped (Lifecycle Event)
May 28 14:21:23.585655 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:23.638091 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:23.696474 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:21:23.845676 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:24.038535 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bf6a7e4d-c882-4d85-b023-2f775a0d5fa7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 1fa1ad14-0188-47c8-8450-6e8f6f2dcd6e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:24.053293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:24.079840 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:21:24.080893 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:21:24.081425 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Creating image(s)
May 28 14:21:24.082385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:24.082385 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:24.083353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:24.084073 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:21:24.088981 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:21:24.090227 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:24.195615 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.105s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:24.196232 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:24.196740 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:24.197283 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:21:24.200643 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:21:24.201016 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:24.289433 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:24.289855 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:24.351471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-84741254-d787-4650-a7dd-cb50e3725d94 req-f9d66b7f-fd28-4ab3-bfe7-fec862e5cd8d service nova] Releasing lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:21:24.351471 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:24.351471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:21:24.351627 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk 1073741824" returned: 0 in 0.062s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:24.352125 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:24.352272 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:24.439303 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:24.439731 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:21:24.439978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:24.537168 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:24.537684 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Cannot resize image /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:21:24.538369 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:21:24.538614 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Ensure instance console log exists: /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:21:24.538927 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:24.539190 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:24.539400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:24.934359 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:21:24.981936 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:25.079937 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:25.221811 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:25.726218 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:21:25.726218 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance network_info: |[{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:21:25.727693 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Start _get_guest_xml network_info=[{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:21:25.732334 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:21:25.735072 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1738752461', uuid='271dc0f9-a1e8-43c8-b2c1-db22f93ac69c'), owner=OwnerMeta(userid='039853f7e499423384aa13ada9b39d22', username='tempest-TestEncryptedCinderVolumes-1171403786-project-member', projectid='50ea6d8cf0d14c40ad9163f647b3d065', projectname='tempest-TestEncryptedCinderVolumes-1171403786'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978085.7342825) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:21:25.736814 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:21:25.737031 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:21:25.738151 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:21:25.738786 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:21:25.739814 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:21:25.739882 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:21:25.740054 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:21:25.740362 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:21:25.740362 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:21:25.740471 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:21:25.740945 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:21:25.740945 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:21:25.741015 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:21:25.741160 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:21:25.741676 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:21:25.741676 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:21:25.754267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:21:25.754267 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:21:25.754908 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:21:25.755842 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'pci_devices' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:21:26.260402 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] End _get_guest_xml xml=<domain type="qemu">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <uuid>271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</uuid>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <name>instance-0000004a</name>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1738752461</nova:name>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:21:25</nova:creationTime>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:user uuid="039853f7e499423384aa13ada9b39d22">tempest-TestEncryptedCinderVolumes-1171403786-project-member</nova:user>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:project uuid="50ea6d8cf0d14c40ad9163f647b3d065">tempest-TestEncryptedCinderVolumes-1171403786</nova:project>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         <nova:port uuid="6ca52656-0417-4c07-901f-b10823a33b3a">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <system>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <entry name="serial">271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</entry>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <entry name="uuid">271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</entry>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </system>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <os>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   </os>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <features>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   </features>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   <devices>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </disk>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </disk>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:9f:fe:f6"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <target dev="tap6ca52656-04"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </interface>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/console.log" append="off"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </serial>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <video>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </video>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </rng>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:   </devices>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]: </domain>
May 28 14:21:26.260402 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:21:26.260402 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Preparing to wait for external event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0ca7d7e-0dea-58bb-904f-1584a02e4500', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ca52656-04, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ca52656-04, col_values=(('qos', UUID('fdb356c6-9de6-49e1-af3f-e24d2379a675')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ca52656-04, col_values=(('external_ids', {'iface-id': '6ca52656-0417-4c07-901f-b10823a33b3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:fe:f6', 'vm-uuid': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:26.275128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:26.278793 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:26.281074 np0000001643 nova-compute[98269]: INFO os_vif [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04')
May 28 14:21:27.802254 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:21:27.802663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:21:27.802663 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:9f:fe:f6, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:21:27.802971 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Using config drive
May 28 14:21:28.310640 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:28.431393 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Creating config drive at /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config
May 28 14:21:28.435133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp25nohm68 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:28.489824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp25nohm68" returned: 0 in 0.054s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:28.884986 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:28.905358 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:29.005542 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:29.076991 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-21be9870-3b31-4fd2-abf4-9a82831c4aeb req-3b22a9f9-6fed-44e3-8632-7608b99f89dc service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:29.077277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-21be9870-3b31-4fd2-abf4-9a82831c4aeb req-3b22a9f9-6fed-44e3-8632-7608b99f89dc service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:29.077497 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-21be9870-3b31-4fd2-abf4-9a82831c4aeb req-3b22a9f9-6fed-44e3-8632-7608b99f89dc service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:29.077645 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-21be9870-3b31-4fd2-abf4-9a82831c4aeb req-3b22a9f9-6fed-44e3-8632-7608b99f89dc service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:29.077789 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-21be9870-3b31-4fd2-abf4-9a82831c4aeb req-3b22a9f9-6fed-44e3-8632-7608b99f89dc service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Processing event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:21:29.241197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:29.243732 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:29.247789 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:29.248261 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:29.264532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:29.629664 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978089.62923, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:29.630215 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:21:29.630436 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Started (Lifecycle Event)
May 28 14:21:29.632632 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:21:29.635173 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance spawned successfully.
May 28 14:21:29.636256 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:21:29.990176 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:30.023361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:30.023600 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:30.023802 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:30.023940 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:30.024053 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:30.027666 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Terminating instance
May 28 14:21:30.135007 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:30.136870 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:21:30.143854 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:30.143970 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:30.144404 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:30.144524 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:30.144785 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:30.147833 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:21:30.531896 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:21:30.551966 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:30.570544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:30.640199 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:21:30.640466 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978090.640284, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:30.640585 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Paused (Lifecycle Event)
May 28 14:21:30.650157 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Took 6.57 seconds to spawn the instance on the hypervisor.
May 28 14:21:30.650157 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:30.712696 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ac43f55d-5b23-4237-b3e9-a38b8e813ad9 req-ebdd3235-ba74-4386-88df-21792ff295e2 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-vif-unplugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:30.712888 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac43f55d-5b23-4237-b3e9-a38b8e813ad9 req-ebdd3235-ba74-4386-88df-21792ff295e2 service nova] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:30.713420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac43f55d-5b23-4237-b3e9-a38b8e813ad9 req-ebdd3235-ba74-4386-88df-21792ff295e2 service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:30.713754 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ac43f55d-5b23-4237-b3e9-a38b8e813ad9 req-ebdd3235-ba74-4386-88df-21792ff295e2 service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:30.713973 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ac43f55d-5b23-4237-b3e9-a38b8e813ad9 req-ebdd3235-ba74-4386-88df-21792ff295e2 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] No waiting events found dispatching network-vif-unplugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:30.714160 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ac43f55d-5b23-4237-b3e9-a38b8e813ad9 req-ebdd3235-ba74-4386-88df-21792ff295e2 service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-vif-unplugged-5ccc8779-f760-4aed-a816-816570d17e8f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:21:30.718336 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:30.724465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:30.851472 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Instance destroyed successfully.
May 28 14:21:30.851472 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid ad03deb0-8239-40a6-a767-977c60aa5ef5 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:21:31.145357 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:31.148969 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978091.1486998, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:31.149114 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Resumed (Lifecycle Event)
May 28 14:21:31.164495 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3701abde-ac1b-4161-8d18-3d4d811deb15 req-2cec128d-ecc9-419e-b8bb-8a72d69db63e service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:31.164668 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3701abde-ac1b-4161-8d18-3d4d811deb15 req-2cec128d-ecc9-419e-b8bb-8a72d69db63e service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:31.164823 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3701abde-ac1b-4161-8d18-3d4d811deb15 req-2cec128d-ecc9-419e-b8bb-8a72d69db63e service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:31.164929 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3701abde-ac1b-4161-8d18-3d4d811deb15 req-2cec128d-ecc9-419e-b8bb-8a72d69db63e service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:31.165045 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3701abde-ac1b-4161-8d18-3d4d811deb15 req-2cec128d-ecc9-419e-b8bb-8a72d69db63e service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:31.165174 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-3701abde-ac1b-4161-8d18-3d4d811deb15 req-2cec128d-ecc9-419e-b8bb-8a72d69db63e service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state active and task_state None.
May 28 14:21:31.168354 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Took 11.98 seconds to build instance.
May 28 14:21:31.272999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:31.352979 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-905069880',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-905069880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-image-snapshot-server-905069880',id=72,image_ref='20c0c9f7-e62c-4b11-ab10-655eabc3cfce',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxZGnAF7Zs7ay9IHa2qOI4WYGrRecsja8hSvGNj8Z3ptD1jQ1MnZjdw4/rQwFIxWXWHs5G51RPUi9UJDGum/ETzLqdKxpm6oPVL2ugXLpF7rb/noZMF3+50gYeb9gYBcQ==',key_name='tempest-keypair-2084678533',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:20:51Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-yb4jc4d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1916664954',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=ad03deb0-8239-40a6-a767-977c60aa5ef5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:21:31.353201 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "5ccc8779-f760-4aed-a816-816570d17e8f", "address": "fa:16:3e:77:39:d9", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc8779-f7", "ovs_interfaceid": "5ccc8779-f760-4aed-a816-816570d17e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:21:31.353890 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccc8779-f760-4aed-a816-816570d17e8f,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc8779-f7') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:21:31.354119 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccc8779-f760-4aed-a816-816570d17e8f,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc8779-f7') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:21:31.355443 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:31.355795 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccc8779-f7, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:31.357179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:31.358438 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:31.359024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:31.359250 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=696f7565-a07c-4c19-af70-55f6660adf4a) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:31.360882 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:31.362466 np0000001643 nova-compute[98269]: INFO os_vif [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccc8779-f760-4aed-a816-816570d17e8f,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc8779-f7')
May 28 14:21:31.363748 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:21:31.364060 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:21:31.364260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:21:31.364733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:21:31.365056 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81e3bdd9-bd48-4a90-909a-1524da9ff44a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:21:31.365239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-543e607e-7955-453f-b3be-43e7be0c3ea4 (non-flash)
May 28 14:21:31.394242 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-543e607e-7955-453f-b3be-43e7be0c3ea4 (non-flash)
May 28 14:21:31.394671 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-543e607e-7955-453f-b3be-43e7be0c3ea4', '192')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:21:31.394671 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', '185')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:21:31.395872 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a', '186')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:21:31.396845 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c15b600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:21:31.397072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:21:31.397698 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 3300000006a502339 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:21:31.452373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:21:31.497232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:21:31.541914 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:21:31.542102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:21:31.543746 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:21:31.556231 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:21:31.556549 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:21:31.569788 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:31.607857 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.40.100,3260]
May 28 14:21:31.607857 np0000001643 nova-compute[98269]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.40.100,3260] successful.
May 28 14:21:31.607857 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:31.625460 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:31.639701 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:31.655480 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:31.657460 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:21:31.669367 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-8d180cd7-b89f-4634-aa10-8e59863db018 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.483s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:31.679474 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.50.100,3260]
May 28 14:21:31.679474 np0000001643 nova-compute[98269]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-81e3bdd9-bd48-4a90-909a-1524da9ff44a, portal: 192.168.50.100,3260] successful.
May 28 14:21:31.679474 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:31.698479 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:31.698767 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:21:31.698928 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (334ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:21:31.699084 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:21:31.699715 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Deleting instance files /opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5_del
May 28 14:21:31.700496 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Deletion of /opt/stack/data/nova/instances/ad03deb0-8239-40a6-a767-977c60aa5ef5_del complete
May 28 14:21:32.164236 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999688313000206 future=<Future at 0x71a78056e810 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:32.164780 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999110485000074 future=<Future at 0x71a78056e810 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:32.164862 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998987737999869 future=<Future at 0x71a78056e810 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:32.207601 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Took 1.68 seconds to destroy the instance on the hypervisor.
May 28 14:21:32.208339 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:21:32.208597 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:21:32.208765 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:21:32.209023 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:32.276235 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:32.347272 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-changed-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:32.347642 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Refreshing instance network info cache due to event network-changed-6ca52656-0417-4c07-901f-b10823a33b3a. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:21:32.347891 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] Acquiring lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:32.348118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] Acquired lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:32.348256 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Refreshing network info cache for port 6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:21:32.792549 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-vif-unplugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:32.793978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] Acquiring lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:32.794360 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:32.795705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:32.795705 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] No waiting events found dispatching network-vif-unplugged-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:32.795705 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-vif-unplugged-5ccc8779-f760-4aed-a816-816570d17e8f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:21:32.795705 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Received event network-vif-deleted-5ccc8779-f760-4aed-a816-816570d17e8f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:32.795705 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Neutron deleted interface 5ccc8779-f760-4aed-a816-816570d17e8f; detaching it from the instance and deleting it from the info cache
May 28 14:21:32.796855 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-07f77cfb-9139-45d4-876e-9375ae17496e req-a409b1f9-2566-45af-b66d-8c55fcecdecf service nova] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Detach interface failed, port_id=5ccc8779-f760-4aed-a816-816570d17e8f, reason: Instance ad03deb0-8239-40a6-a767-977c60aa5ef5 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:21:32.850518 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:33.112091 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:33.194471 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:33.243263 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updated VIF entry in instance network info cache for port 6ca52656-0417-4c07-901f-b10823a33b3a. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:21:33.243739 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:33.699752 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Took 1.49 seconds to deallocate network for instance.
May 28 14:21:33.747699 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1fb14b1e-e662-4776-9515-8dfe706c9537 req-aa37a910-9df6-4473-a61f-c29946f9b8ba service nova] Releasing lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:21:34.247952 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:21:34.252058 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Deleting volume: 81e3bdd9-bd48-4a90-909a-1524da9ff44a {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:21:34.794854 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:34.795420 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:34.991854 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:35.058440 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:21:35.058720 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:21:35.561470 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:21:35.828809 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:36.067911 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.273s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:36.119792 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance ad03deb0-8239-40a6-a767-977c60aa5ef5
May 28 14:21:36.332957 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:36.333174 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:36.333281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:36.333385 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:21:36.361100 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:37.128321 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-9ac4b160-babb-4b5f-b37e-a7555841ec86 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "ad03deb0-8239-40a6-a767-977c60aa5ef5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.105s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:37.355555 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:21:37.357549 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:21:37.359606 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:37.450524 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:37.451024 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:37.542046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:37.547621 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:21:37.549568 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:21:37.551248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:37.607887 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:21:37.608501 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12554MB free_disk=72.71397018432617GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:21:37.608864 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:37.609055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:38.669875 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 563740fa-6c02-44e3-8d86-46d77ca4060d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:21:38.670290 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 20b5dfd0-1a53-4169-99be-7859b4ccfa21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:21:38.670290 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 99929164-66e4-49d4-9241-c61f6e2cc985 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:21:38.670290 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:21:38.670424 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:21:38.670562 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:21:37 up 48 min,  2 users,  load average: 4.94, 4.82, 4.51\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1', 'io_workload': '0', 'num_proj_18d5cb6ddda14738b70c2460eb02dc4c': '2', 'num_proj_50ea6d8cf0d14c40ad9163f647b3d065': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:21:38.869226 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:21:38.869516 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:21:39.372660 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:21:39.378437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:39.378715 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:39.378965 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:39.379172 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:39.379341 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:39.384704 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Terminating instance
May 28 14:21:39.887093 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:21:39.887536 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.278s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:39.887592 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:21:39.888676 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:21:39.908336 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:39.924894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:39.928793 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:39.952129 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:39.993007 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:40.058915 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-daa139ee-a2ac-48ca-b462-d10324256ae0 req-657a857f-9d5c-4721-8c3d-4f12a2e64ebf service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-vif-unplugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:40.059886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-daa139ee-a2ac-48ca-b462-d10324256ae0 req-657a857f-9d5c-4721-8c3d-4f12a2e64ebf service nova] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:40.059886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-daa139ee-a2ac-48ca-b462-d10324256ae0 req-657a857f-9d5c-4721-8c3d-4f12a2e64ebf service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:40.059886 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-daa139ee-a2ac-48ca-b462-d10324256ae0 req-657a857f-9d5c-4721-8c3d-4f12a2e64ebf service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:40.059886 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-daa139ee-a2ac-48ca-b462-d10324256ae0 req-657a857f-9d5c-4721-8c3d-4f12a2e64ebf service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] No waiting events found dispatching network-vif-unplugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:40.059886 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-daa139ee-a2ac-48ca-b462-d10324256ae0 req-657a857f-9d5c-4721-8c3d-4f12a2e64ebf service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-vif-unplugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:21:40.227687 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999679226999888 future=<Future at 0x71a75c2e37a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:40.228461 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Instance destroyed successfully.
May 28 14:21:40.228785 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid 563740fa-6c02-44e3-8d86-46d77ca4060d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:21:40.731038 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1332459080',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1332459080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-volume-backed-server-1332459080',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF77g2fWASCrmEfslyDdebSqKeKtp2IDCP37SVXO2fzo2/UZQPAAiPsAjretgUK+FMJrR49XQswrWq0lIrYYTmWsE/DMB01ietMZHgp6QLY3DF/4v1hvMefJf+90OqqNMw==',key_name='tempest-keypair-275380116',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:19:50Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-pnb2emxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:19:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=563740fa-6c02-44e3-8d86-46d77ca4060d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:21:40.731288 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "address": "fa:16:3e:6d:b3:6e", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43b9136-29", "ovs_interfaceid": "f43b9136-291f-43be-8c7b-4f8bbea45ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:21:40.731794 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b3:6e,bridge_name='br-int',has_traffic_filtering=True,id=f43b9136-291f-43be-8c7b-4f8bbea45ad2,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43b9136-29') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:21:40.732199 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b3:6e,bridge_name='br-int',has_traffic_filtering=True,id=f43b9136-291f-43be-8c7b-4f8bbea45ad2,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43b9136-29') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:21:40.733500 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:40.733689 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf43b9136-29, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:40.734861 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:40.736124 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:40.737488 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:40.737667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76454f73-eaf3-4a40-9be9-21e7c633352d) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:21:40.738309 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:40.739132 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:21:40.740152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:40.742306 np0000001643 nova-compute[98269]: INFO os_vif [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b3:6e,bridge_name='br-int',has_traffic_filtering=True,id=f43b9136-291f-43be-8c7b-4f8bbea45ad2,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43b9136-29')
May 28 14:21:40.743733 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:21:40.744067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:21:40.744244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:21:40.885898 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:40.886155 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:40.886412 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:40.886670 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:40.886876 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:40.887024 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:21:40.887235 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.94 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:21:42.118302 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd6bb815-b37a-4483-9102-994b57ec1404 req-f886d6f0-a0e4-4024-9a10-cb4603d7c534 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-vif-unplugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:42.118675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd6bb815-b37a-4483-9102-994b57ec1404 req-f886d6f0-a0e4-4024-9a10-cb4603d7c534 service nova] Acquiring lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:42.118675 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd6bb815-b37a-4483-9102-994b57ec1404 req-f886d6f0-a0e4-4024-9a10-cb4603d7c534 service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:42.118733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-dd6bb815-b37a-4483-9102-994b57ec1404 req-f886d6f0-a0e4-4024-9a10-cb4603d7c534 service nova] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:42.121268 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd6bb815-b37a-4483-9102-994b57ec1404 req-f886d6f0-a0e4-4024-9a10-cb4603d7c534 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] No waiting events found dispatching network-vif-unplugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:21:42.121268 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-dd6bb815-b37a-4483-9102-994b57ec1404 req-f886d6f0-a0e4-4024-9a10-cb4603d7c534 service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-vif-unplugged-f43b9136-291f-43be-8c7b-4f8bbea45ad2 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:21:42.298621 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.554s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:21:42.298987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:21:42.299134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:21:42.324819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:42.324819 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:42.324819 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:42.324819 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:42.324819 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:42.324819 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:42.324819 np0000001643 nova-compute[98269]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:21:42.324819 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:21:42.325088 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:42.325088 np0000001643 nova-compute[98269]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2 (non-flash)
May 28 14:21:42.325088 np0000001643 nova-compute[98269]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:42.325088 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:42.325088 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:42.325088 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:42.325088 np0000001643 nova-compute[98269]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:21:42.325088 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:21:42.325313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634', '193')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:21:42.325313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '179')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:21:42.326373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2', '180')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:21:42.327300 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778117740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:21:42.327541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:21:42.327782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 330000000da5e95b4 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:21:42.383839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:21:42.429066 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:21:42.479933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:21:42.479933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:21:42.481006 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:21:42.493378 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:21:42.493378 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:21:42.509676 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:42.546196 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.40.100,3260]
May 28 14:21:42.546196 np0000001643 nova-compute[98269]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.40.100,3260] successful.
May 28 14:21:42.546196 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:42.564201 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:42.577771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:42.610805 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.50.100,3260]
May 28 14:21:42.610805 np0000001643 nova-compute[98269]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-a0387be8-fecf-4d90-aea2-b4297f1ff5a2, portal: 192.168.50.100,3260] successful.
May 28 14:21:42.610805 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:42.632177 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:42.632639 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:21:42.632825 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (1888ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:21:42.632992 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:21:42.633871 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Deleting instance files /opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d_del
May 28 14:21:42.633966 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Deletion of /opt/stack/data/nova/instances/563740fa-6c02-44e3-8d86-46d77ca4060d_del complete
May 28 14:21:43.141426 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Took 3.25 seconds to destroy the instance on the hypervisor.
May 28 14:21:43.142057 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:21:43.142407 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:21:43.142553 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:21:43.142833 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:43.207779 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:43.678860 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37a024f5-a35e-4fff-a997-e08ed0993267 req-1d4dd1f4-5dd0-4c10-a7da-72a28e5ef13f service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Received event network-vif-deleted-f43b9136-291f-43be-8c7b-4f8bbea45ad2 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:43.679061 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-37a024f5-a35e-4fff-a997-e08ed0993267 req-1d4dd1f4-5dd0-4c10-a7da-72a28e5ef13f service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Neutron deleted interface f43b9136-291f-43be-8c7b-4f8bbea45ad2; detaching it from the instance and deleting it from the info cache
May 28 14:21:43.681242 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-37a024f5-a35e-4fff-a997-e08ed0993267 req-1d4dd1f4-5dd0-4c10-a7da-72a28e5ef13f service nova] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Detach interface failed, port_id=f43b9136-291f-43be-8c7b-4f8bbea45ad2, reason: Instance 563740fa-6c02-44e3-8d86-46d77ca4060d could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:21:44.137844 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:44.639168 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Took 1.50 seconds to deallocate network for instance.
May 28 14:21:44.827624 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:44.827775 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:21:44.994671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:45.185726 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:21:45.187591 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Deleting volume: a0387be8-fecf-4d90-aea2-b4297f1ff5a2 {{(pid=98269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 14:21:45.733968 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:45.734443 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:45.739423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:45.944130 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:21:45.944261 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:21:46.446826 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:21:46.955209 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.221s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:47.001763 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance 563740fa-6c02-44e3-8d86-46d77ca4060d
May 28 14:21:47.164468 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0005453059998217213 future=<Future at 0x71a78056e810 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:47.165047 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Emitting event <LifecycleEvent: 1779978092.1637938, ad03deb0-8239-40a6-a767-977c60aa5ef5 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:47.165743 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:47.165972 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] VM Stopped (Lifecycle Event)
May 28 14:21:47.166086 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.061238759999924 future=<Future at 0x71a75c2e37a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:47.167786 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=8.059545006999997 future=<Future at 0x71a75c2e37a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:47.671583 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: ad03deb0-8239-40a6-a767-977c60aa5ef5] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:47.823222 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:21:47.823568 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:21:48.010294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19a1b5be-6d38-4754-8a88-775777d89f42 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "563740fa-6c02-44e3-8d86-46d77ca4060d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.631s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:48.171113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:48.171283 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:48.673379 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:21:49.228867 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:49.229257 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:49.231838 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:21:49.232484 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Claim successful on node np0000001643
May 28 14:21:49.996674 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:50.451152 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:21:50.451766 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:21:50.740867 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:50.953803 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:21:51.459632 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.230s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:51.460070 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:21:51.965338 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:21:51.965990 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:21:51.966331 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:51.966604 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:52.029579 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '117f5a19409d45e9be5e969913c67263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5cb6ddda14738b70c2460eb02dc4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:21:52.468826 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:21:52.612490 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Successfully created port: 5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:21:52.986080 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:21:53.057073 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:53.057286 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:53.110801 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Successfully updated port: 5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:21:53.216918 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-changed-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:53.217041 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Refreshing instance network info cache due to event network-changed-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:21:53.217182 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] Acquiring lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:53.217282 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] Acquired lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:53.217388 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Refreshing network info cache for port 5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:21:53.492264 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Booting with volume 6d67546a-f26e-402b-8f88-47bffd513e16 at /dev/vda
May 28 14:21:53.538461 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:21:53.549833 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:21:53.559225 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:21:53.573427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:53.614482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:53.620461 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:21:53.620461 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:21:53.629566 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:21:53.630762 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb', 'fe80::fc16:3eff:feb5:72f1', 'fe80::fc16:3eff:fe9f:fef6', 'fe80::9422:aaff:fe91:e13f'] 
May 28 14:21:53.630885 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:21:53.631026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:21:53.631348 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:21:53.631638 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Updating existing volume attachment record: dea1f9ef-4303-44e2-93d2-fa6a9f12a062 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:21:53.720767 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:53.802221 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:21:53.946662 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:54.102860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:54.103081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:54.107572 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:21:54.107763 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Claim successful on node np0000001643
May 28 14:21:54.448712 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5602a766-7e36-43b6-adbf-c61f020dfb1b req-63cded20-efa1-4cbd-a03c-8e8899abb3ed service nova] Releasing lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:21:54.449144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquired lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:54.449349 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:21:54.999907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:55.009274 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:21:55.155843 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:55.228944 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0012155129998063785 future=<Future at 0x71a75c2e37a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:55.232310 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Emitting event <LifecycleEvent: 1779978100.2272475, 563740fa-6c02-44e3-8d86-46d77ca4060d => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:21:55.232708 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:21:55.233140 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] VM Stopped (Lifecycle Event)
May 28 14:21:55.302532 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Updating instance_info_cache with network_info: [{"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:55.373387 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:21:55.373609 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:21:55.723122 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:21:55.724253 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:21:55.724555 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Creating image(s)
May 28 14:21:55.724920 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:21:55.725091 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Ensure instance console log exists: /opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:21:55.725353 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:21:55.725555 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:21:55.725713 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:55.736340 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 563740fa-6c02-44e3-8d86-46d77ca4060d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:21:55.741894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:21:55.804252 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Releasing lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:21:55.804646 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Instance network_info: |[{"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:21:55.805395 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Start _get_guest_xml network_info=[{"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'dea1f9ef-4303-44e2-93d2-fa6a9f12a062', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5aefef2c-79e8-4a63-88e1-11aeb4f7023d', 'attached_at': '', 'detached_at': '', 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'serial': '6d67546a-f26e-402b-8f88-47bffd513e16'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:21:55.807482 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:21:55.808417 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1352384900', uuid='5aefef2c-79e8-4a63-88e1-11aeb4f7023d'), owner=OwnerMeta(userid='117f5a19409d45e9be5e969913c67263', username='tempest-TestVolumeBootPatternV346-425599745-project-member', projectid='18d5cb6ddda14738b70c2460eb02dc4c', projectname='tempest-TestVolumeBootPatternV346-425599745'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978115.808147) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:21:55.809338 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:21:55.809675 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:21:55.810648 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:21:55.810909 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:21:55.811982 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:21:55.812377 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:21:55.812648 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:21:55.812861 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:21:55.813076 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:21:55.813279 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:21:55.813459 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:21:55.813735 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:21:55.813942 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:21:55.814169 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:21:55.814334 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:21:55.814581 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:21:55.828171 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:21:55.828651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:21:55.828869 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:21:55.829290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:21:55.829605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:21:55.840244 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:21:55.840816 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:21:55.841277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:21:55.841505 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:21:55.842128 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:21:55.842376 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:21:55.852976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:21:55.852976 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:55.857883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:21:55.857883 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16] added
May 28 14:21:55.866779 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:21:55.866779 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:21:55.866779 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:21:55.870563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16] added
May 28 14:21:55.870563 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:21:55.870563 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:21:55.870563 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:21:55.870563 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:21:55.870563 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:21:55.870563 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:55.870760 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:21:55.871112 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:21:55.871262 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:21:55.876620 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:21:56.384521 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.281s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:21:56.384977 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:21:56.866514 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:21:56.871695 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:21:56.878574 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:21:56.878574 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:21:56.885003 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:21:56.885003 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:56.889581 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:21:56.889778 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:21:56.890024 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:56.890701 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:56.894860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:56.900782 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:56.909866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.909866 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.909866 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.909866 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.909866 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:21:56.910063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.910063 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.910063 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.910063 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.910063 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:21:56.914999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.914999 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.914999 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.914999 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.914999 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:21:56.915163 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.915163 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.915163 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.915163 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.915163 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:21:56.954725 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.40.100,3260]
May 28 14:21:56.954725 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.40.100,3260] successful.
May 28 14:21:56.954725 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:56.965772 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:21:56.967290 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:56.973324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.50.100,3260]
May 28 14:21:56.973324 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.50.100,3260] successful.
May 28 14:21:56.973324 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:56.982068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.982068 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.982068 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.982068 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.982068 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:56.982068 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:56.982068 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:21:56.982380 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.982380 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:56.982380 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.982380 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:56.982380 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:56.982380 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:56.982380 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:21:56.982664 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:21:56.982860 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:21:56.984125 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] HCTL ('7', '-', '-', 0) found on session 194 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:21:56.984321 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:21:56.985090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:21:57.001950 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 194 and hctl ['7', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:21:57.007023 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:57.007023 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:57.007023 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:57.007023 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:57.007023 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:57.007023 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:57.007023 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:21:57.007255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:57.007255 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:21:57.007255 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:57.007255 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:21:57.007255 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:57.007255 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:21:57.007255 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:21:57.007493 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:21:57.007571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:21:57.009242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] HCTL ('8', '-', '-', 0) found on session 195 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:21:57.009242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:21:57.022997 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 195 and hctl ['8', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:21:57.395418 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:21:57.523933 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Successfully created port: ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:21:57.899100 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:21:57.997352 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 194 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:21:57.997531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:21:58.001257 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Successfully updated port: ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:21:58.022136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Searching for a device in session 195 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:21:58.022250 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:21:58.049237 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-changed-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:21:58.049763 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Refreshing instance network info cache due to event network-changed-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:21:58.049909 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] Acquiring lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:58.049996 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] Acquired lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:58.050117 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Refreshing network info cache for port ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:21:58.403674 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Booting with volume 65e3082c-e702-49e2-89fe-709beaf49e42 at /dev/vda
May 28 14:21:58.440227 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:21:58.452073 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:21:58.474044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:21:58.504902 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:21:58.518909 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:21:58.519164 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:21:58.527987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:21:58.528995 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb', 'fe80::fc16:3eff:feb5:72f1', 'fe80::fc16:3eff:fe9f:fef6', 'fe80::9422:aaff:fe91:e13f'] 
May 28 14:21:58.529136 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:21:58.529242 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:21:58.529495 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:21:58.529689 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Updating existing volume attachment record: 738e3902-fd6f-4a23-894f-06510cd0b1c4 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:21:58.552223 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:58.617964 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:21:58.746409 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:21:58.842378 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:21:59.248706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f88e06f9-63db-4842-bbca-e944ea09ed2f req-e5feb142-6c0d-48b7-80cf-9b625fdc3ab7 service nova] Releasing lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:21:59.249212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:21:59.249417 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:21:59.807894 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:21:59.857431 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Found WWN 3300000007985665a for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:21:59.857815 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:21:59.857988 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '3300000007985665a', 'path': '/dev/dm-0', 'multipath_id': '3300000007985665a'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:21:59.858169 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007985665a', 'path': '/dev/dm-0', 'multipath_id': '3300000007985665a'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:21:59.943293 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:21:59.999008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:00.066952 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Updating instance_info_cache with network_info: [{"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:00.365268 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1352384900',display_name='tempest-TestVolumeBootPatternV346-server-1352384900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-1352384900',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRymvWZhZVj+0Hp9E62siqYyiPokqb5f5KVBZnGE3dW56nfScnms2AdsFlI2JKWMKAa02ANKDwd2bOKaZbceZcZwFfxYWDpdIi63qjHXylFffZjXBEO+Ky4DZCVMe56Lw==',key_name='tempest-keypair-1084749110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-8w0w6xi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=5aefef2c-79e8-4a63-88e1-11aeb4f7023d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:22:00.365491 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:00.365986 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:18,bridge_name='br-int',has_traffic_filtering=True,id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5643af4d-48') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:00.366626 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aefef2c-79e8-4a63-88e1-11aeb4f7023d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:00.568953 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:22:00.569142 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Instance network_info: |[{"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:22:00.629082 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:22:00.630094 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:22:00.630580 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Creating image(s)
May 28 14:22:00.630856 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:22:00.631020 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Ensure instance console log exists: /opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:22:00.631267 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:00.631408 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:00.631565 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:00.632028 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Start _get_guest_xml network_info=[{"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '738e3902-fd6f-4a23-894f-06510cd0b1c4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '72383293-d922-490c-a7c2-11ed2b3e3e88', 'attached_at': '', 'detached_at': '', 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'serial': '65e3082c-e702-49e2-89fe-709beaf49e42'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:22:00.634129 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:22:00.635202 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1205806636', uuid='72383293-d922-490c-a7c2-11ed2b3e3e88'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978120.6348808) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:22:00.636262 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:22:00.636608 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:22:00.637952 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:22:00.638280 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:22:00.639008 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:22:00.639287 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:22:00.639454 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:22:00.639575 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:22:00.639747 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:22:00.639829 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:22:00.639920 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:22:00.640054 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:22:00.640147 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:22:00.640281 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:22:00.640381 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:22:00.640538 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:22:00.650604 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:22:00.650917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:00.651045 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:00.743081 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:00.869529 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] End _get_guest_xml xml=<domain type="qemu">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <uuid>5aefef2c-79e8-4a63-88e1-11aeb4f7023d</uuid>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <name>instance-0000004b</name>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1352384900</nova:name>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:21:55</nova:creationTime>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:user uuid="117f5a19409d45e9be5e969913c67263">tempest-TestVolumeBootPatternV346-425599745-project-member</nova:user>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:project uuid="18d5cb6ddda14738b70c2460eb02dc4c">tempest-TestVolumeBootPatternV346-425599745</nova:project>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         <nova:port uuid="5643af4d-48d5-4fa4-a3a9-f16cdf15b89b">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <system>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <entry name="serial">5aefef2c-79e8-4a63-88e1-11aeb4f7023d</entry>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <entry name="uuid">5aefef2c-79e8-4a63-88e1-11aeb4f7023d</entry>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </system>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <os>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   </os>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <features>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   </features>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   <devices>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d/disk.config"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </disk>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <alias name="ua-6d67546a-f26e-402b-8f88-47bffd513e16"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <serial>6d67546a-f26e-402b-8f88-47bffd513e16</serial>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </disk>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:e1:1a:18"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <target dev="tap5643af4d-48"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </interface>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d/console.log" append="off"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </serial>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <video>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </video>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </rng>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:   </devices>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]: </domain>
May 28 14:22:00.869529 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Preparing to wait for external event network-vif-plugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1352384900',display_name='tempest-TestVolumeBootPatternV346-server-1352384900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-1352384900',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRymvWZhZVj+0Hp9E62siqYyiPokqb5f5KVBZnGE3dW56nfScnms2AdsFlI2JKWMKAa02ANKDwd2bOKaZbceZcZwFfxYWDpdIi63qjHXylFffZjXBEO+Ky4DZCVMe56Lw==',key_name='tempest-keypair-1084749110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-8w0w6xi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=5aefef2c-79e8-4a63-88e1-11aeb4f7023d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:18,bridge_name='br-int',has_traffic_filtering=True,id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5643af4d-48') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:00.871808 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:18,bridge_name='br-int',has_traffic_filtering=True,id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5643af4d-48') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:22:00.872295 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:00.872295 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:00.872295 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:22:00.872766 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:00.872883 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc845fea-3a87-57ec-8b9a-a9b1f3b51d65', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:00.873812 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:00.874774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:00.876517 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:00.876626 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5643af4d-48, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:00.876884 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5643af4d-48, col_values=(('qos', UUID('c755e4d7-5392-4915-bf6c-66a98b25aa87')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:00.877013 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5643af4d-48, col_values=(('external_ids', {'iface-id': '5643af4d-48d5-4fa4-a3a9-f16cdf15b89b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:1a:18', 'vm-uuid': '5aefef2c-79e8-4a63-88e1-11aeb4f7023d'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:00.878681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:00.882901 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:00.883357 np0000001643 nova-compute[98269]: INFO os_vif [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1a:18,bridge_name='br-int',has_traffic_filtering=True,id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5643af4d-48')
May 28 14:22:02.104221 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.453s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:02.104596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:22:02.116989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:02.117633 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:02.118019 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:02.118241 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:22:02.118594 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:02.118784 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:22:02.129387 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:22:02.129387 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:02.133693 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:22:02.133693 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:02.141106 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42] added
May 28 14:22:02.141106 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:22:02.141106 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:02.141106 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:02.141106 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:02.141106 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:02.141106 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:02.141349 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:22:02.141494 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:22:02.141644 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:22:02.143547 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42] added
May 28 14:22:02.143547 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:22:02.143547 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:02.143547 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:02.143547 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:02.143547 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:02.143547 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:02.143734 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:22:02.143863 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:22:02.143990 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:22:02.398322 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:02.398492 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:02.398561 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] No VIF found with MAC fa:16:3e:e1:1a:18, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:22:02.398939 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Using config drive
May 28 14:22:02.903814 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:03.019295 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Creating config drive at /opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d/disk.config
May 28 14:22:03.023361 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoqsdydcf {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:03.142767 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:22:03.146122 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:22:03.157028 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:22:03.157028 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:22:03.162628 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:22:03.162628 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.165960 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoqsdydcf" returned: 0 in 0.142s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:03.171438 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.176886 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.191172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.191172 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.191172 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.191172 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.191172 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.191172 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.191172 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.191172 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:03.191512 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.191512 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.191512 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.191512 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.191512 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.191512 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.191512 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.191512 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:03.197845 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.197845 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.197845 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.197845 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.197845 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.197845 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.197845 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.197845 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:03.198131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.198131 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.198131 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.198131 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.198131 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.198131 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.198131 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.198131 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:03.240172 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260]
May 28 14:22:03.240172 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260] successful.
May 28 14:22:03.240172 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.249763 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260]
May 28 14:22:03.249763 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260] successful.
May 28 14:22:03.249763 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.255084 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.264015 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.275340 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.275750 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:03.276020 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:03.276096 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:22:03.277208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('10', '-', '-', 0) found on session 197 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:22:03.277415 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.285071 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:03.285301 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:03.285553 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:03.285625 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:22:03.286429 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('13', '-', '-', 0) found on session 198 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:22:03.286561 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:22:03.295605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 197 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:03.295825 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:22:03.303506 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 198 and hctl ['13', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:03.628402 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:03.650545 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:03.744811 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:03.780646 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:03.790640 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-70f6f35d-e758-4a98-b169-02971d8186d1 req-39fb334d-803e-48d7-bded-1d34b1678432 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-vif-plugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:03.790876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70f6f35d-e758-4a98-b169-02971d8186d1 req-39fb334d-803e-48d7-bded-1d34b1678432 service nova] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:03.791051 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70f6f35d-e758-4a98-b169-02971d8186d1 req-39fb334d-803e-48d7-bded-1d34b1678432 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:03.791175 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-70f6f35d-e758-4a98-b169-02971d8186d1 req-39fb334d-803e-48d7-bded-1d34b1678432 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:03.791286 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-70f6f35d-e758-4a98-b169-02971d8186d1 req-39fb334d-803e-48d7-bded-1d34b1678432 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Processing event network-vif-plugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:22:04.302173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 198 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:04.302608 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:22:04.333250 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:22:04.334385 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978124.3339205, 5aefef2c-79e8-4a63-88e1-11aeb4f7023d => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:04.334632 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] VM Started (Lifecycle Event)
May 28 14:22:04.335740 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:22:04.339000 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Instance spawned successfully.
May 28 14:22:04.339412 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:22:04.838103 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:04.840244 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:22:04.845621 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:04.845761 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:04.846075 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:04.846402 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:04.846607 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:04.846871 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:05.000958 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:05.136559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 33000000089d82104 for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:22:05.136745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:05.136946 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (4486ms) {'type': 'block', 'scsi_wwn': '33000000089d82104', 'path': '/dev/dm-3', 'multipath_id': '33000000089d82104'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:05.137161 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000089d82104', 'path': '/dev/dm-3', 'multipath_id': '33000000089d82104'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:22:05.344010 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:22:05.344382 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978125.344025, 5aefef2c-79e8-4a63-88e1-11aeb4f7023d => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:05.344382 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] VM Paused (Lifecycle Event)
May 28 14:22:05.351291 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Took 9.63 seconds to spawn the instance on the hypervisor.
May 28 14:22:05.351495 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:05.642263 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205806636',display_name='tempest-TestVolumeBootPattern-server-1205806636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1205806636',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-wswdh26a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:21:58Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=72383293-d922-490c-a7c2-11ed2b3e3e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:22:05.642574 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:05.643004 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9d:e1,bridge_name='br-int',has_traffic_filtering=True,id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad40a33e-ce') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:05.643550 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid 72383293-d922-490c-a7c2-11ed2b3e3e88 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:05.845088 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5474bbef-9a0b-40a2-9699-977e9dca3132 req-93dc2984-3269-453d-9c65-fbd12b1c8be6 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-vif-plugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:05.845088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5474bbef-9a0b-40a2-9699-977e9dca3132 req-93dc2984-3269-453d-9c65-fbd12b1c8be6 service nova] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:05.845088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5474bbef-9a0b-40a2-9699-977e9dca3132 req-93dc2984-3269-453d-9c65-fbd12b1c8be6 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:05.845327 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5474bbef-9a0b-40a2-9699-977e9dca3132 req-93dc2984-3269-453d-9c65-fbd12b1c8be6 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:05.845327 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5474bbef-9a0b-40a2-9699-977e9dca3132 req-93dc2984-3269-453d-9c65-fbd12b1c8be6 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] No waiting events found dispatching network-vif-plugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:05.845966 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-5474bbef-9a0b-40a2-9699-977e9dca3132 req-93dc2984-3269-453d-9c65-fbd12b1c8be6 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received unexpected event network-vif-plugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b for instance with vm_state active and task_state None.
May 28 14:22:05.845966 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:05.848175 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978125.8480203, 5aefef2c-79e8-4a63-88e1-11aeb4f7023d => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:05.848300 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] VM Resumed (Lifecycle Event)
May 28 14:22:05.860479 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Took 16.68 seconds to build instance.
May 28 14:22:05.879584 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.146101 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] End _get_guest_xml xml=<domain type="qemu">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <uuid>72383293-d922-490c-a7c2-11ed2b3e3e88</uuid>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <name>instance-0000004c</name>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-1205806636</nova:name>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:22:00</nova:creationTime>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         <nova:port uuid="ad40a33e-ce30-4200-ae0a-3a1c6cf305b8">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <system>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <entry name="serial">72383293-d922-490c-a7c2-11ed2b3e3e88</entry>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <entry name="uuid">72383293-d922-490c-a7c2-11ed2b3e3e88</entry>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </system>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <os>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   </os>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <features>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   </features>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   <devices>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88/disk.config"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </disk>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <alias name="ua-65e3082c-e702-49e2-89fe-709beaf49e42"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-3"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <serial>65e3082c-e702-49e2-89fe-709beaf49e42</serial>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </disk>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:0c:9d:e1"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <target dev="tapad40a33e-ce"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </interface>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88/console.log" append="off"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </serial>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <video>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </video>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </rng>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:   </devices>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]: </domain>
May 28 14:22:06.146101 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Preparing to wait for external event network-vif-plugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205806636',display_name='tempest-TestVolumeBootPattern-server-1205806636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1205806636',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-wswdh26a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:21:58Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=72383293-d922-490c-a7c2-11ed2b3e3e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9d:e1,bridge_name='br-int',has_traffic_filtering=True,id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad40a33e-ce') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:06.149046 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9d:e1,bridge_name='br-int',has_traffic_filtering=True,id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad40a33e-ce') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:22:06.150509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.150509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:06.150509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:22:06.151491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.151491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5b09079-c669-57b3-8d86-1e319a051708', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:06.151812 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.152661 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:06.153465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.155706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.155706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad40a33e-ce, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:06.155706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad40a33e-ce, col_values=(('qos', UUID('a26c2cfe-a52b-4267-bff2-ab1cbe426eac')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:06.155706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad40a33e-ce, col_values=(('external_ids', {'iface-id': 'ad40a33e-ce30-4200-ae0a-3a1c6cf305b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:9d:e1', 'vm-uuid': '72383293-d922-490c-a7c2-11ed2b3e3e88'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:06.155996 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.157042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:06.161562 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:06.161814 np0000001643 nova-compute[98269]: INFO os_vif [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9d:e1,bridge_name='br-int',has_traffic_filtering=True,id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad40a33e-ce')
May 28 14:22:06.351283 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:06.358929 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:22:06.361340 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-e6b2a19b-c720-4c62-a5e7-4cb6afcdf6ab tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.190s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:07.124245 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-changed-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:07.124245 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Refreshing instance network info cache due to event network-changed-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:22:07.124245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] Acquiring lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:22:07.124245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] Acquired lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:22:07.124245 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Refreshing network info cache for port 5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:22:07.628542 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:07.675951 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:07.676261 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:07.676438 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:0c:9d:e1, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:22:07.676872 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Using config drive
May 28 14:22:07.948852 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:08.103567 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Updated VIF entry in instance network info cache for port 5643af4d-48d5-4fa4-a3a9-f16cdf15b89b. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:22:08.103803 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Updating instance_info_cache with network_info: [{"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:08.182647 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:08.295003 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Creating config drive at /opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88/disk.config
May 28 14:22:08.297974 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphetsogsw {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:08.355775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphetsogsw" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:08.607120 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-85cb1849-fde8-4961-8df5-5d6abb1bc756 req-5cbd06b0-d8ca-4710-b801-99ff6c36c280 service nova] Releasing lock "refresh_cache-5aefef2c-79e8-4a63-88e1-11aeb4f7023d" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:22:08.811495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:08.844247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:08.848464 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:08.940144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:09.021945 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ba9e12a0-87ca-450d-895e-15776596ac3b req-003a8c70-4bd6-4b05-a095-d4551ce4341e service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-vif-plugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:09.022434 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ba9e12a0-87ca-450d-895e-15776596ac3b req-003a8c70-4bd6-4b05-a095-d4551ce4341e service nova] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:09.028055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ba9e12a0-87ca-450d-895e-15776596ac3b req-003a8c70-4bd6-4b05-a095-d4551ce4341e service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:09.028055 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ba9e12a0-87ca-450d-895e-15776596ac3b req-003a8c70-4bd6-4b05-a095-d4551ce4341e service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:09.028055 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ba9e12a0-87ca-450d-895e-15776596ac3b req-003a8c70-4bd6-4b05-a095-d4551ce4341e service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Processing event network-vif-plugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:22:09.073356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:09.073356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:09.170758 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:09.172167 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:09.175690 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:09.191667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:09.192909 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:09.563934 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978129.5635471, 72383293-d922-490c-a7c2-11ed2b3e3e88 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:09.564479 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:22:09.564685 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] VM Started (Lifecycle Event)
May 28 14:22:09.568333 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:22:09.570057 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Instance spawned successfully.
May 28 14:22:09.572975 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:22:09.578268 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:10.002265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:10.067048 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:10.069076 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:22:10.077829 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:10.077982 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:10.078201 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:10.078388 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:10.078668 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:10.078871 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:22:10.571123 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:22:10.571429 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978130.5712214, 72383293-d922-490c-a7c2-11ed2b3e3e88 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:10.571562 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] VM Paused (Lifecycle Event)
May 28 14:22:10.583990 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Took 9.95 seconds to spawn the instance on the hypervisor.
May 28 14:22:10.584458 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:10.590047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:11.074721 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:11.079693 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978131.0781262, 72383293-d922-490c-a7c2-11ed2b3e3e88 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:11.079693 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] VM Resumed (Lifecycle Event)
May 28 14:22:11.085185 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b16ed92d-a17f-46ca-be83-f423c37eddf4 req-aef4d7d1-4625-4c9d-894b-ccb0440e88b9 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-vif-plugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:11.085868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b16ed92d-a17f-46ca-be83-f423c37eddf4 req-aef4d7d1-4625-4c9d-894b-ccb0440e88b9 service nova] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:11.085868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b16ed92d-a17f-46ca-be83-f423c37eddf4 req-aef4d7d1-4625-4c9d-894b-ccb0440e88b9 service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:11.085868 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b16ed92d-a17f-46ca-be83-f423c37eddf4 req-aef4d7d1-4625-4c9d-894b-ccb0440e88b9 service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:11.086004 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b16ed92d-a17f-46ca-be83-f423c37eddf4 req-aef4d7d1-4625-4c9d-894b-ccb0440e88b9 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] No waiting events found dispatching network-vif-plugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:11.086036 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-b16ed92d-a17f-46ca-be83-f423c37eddf4 req-aef4d7d1-4625-4c9d-894b-ccb0440e88b9 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received unexpected event network-vif-plugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 for instance with vm_state active and task_state None.
May 28 14:22:11.098231 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Took 17.03 seconds to build instance.
May 28 14:22:11.158138 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:11.581567 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:11.587201 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:22:11.600072 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.543s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:11.701483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:11.701799 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:11.701799 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Attaching volume 2dde8977-3910-4623-b762-d53bfec25ee3 to /dev/vdb
May 28 14:22:11.755843 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:11.769100 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:22:11.797593 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:11.851926 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:22:11.852309 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:22:11.862869 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:22:11.864620 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb', 'fe80::fc16:3eff:feb5:72f1', 'fe80::fc16:3eff:fe9f:fef6', 'fe80::9422:aaff:fe91:e13f', 'fe80::fc16:3eff:fee1:1a18', 'fe80::fc16:3eff:fe0c:9de1', 'fe80::8097:21ff:fe89:3b01'] 
May 28 14:22:11.865086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:22:11.865331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:22:11.865822 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:11.866383 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating existing volume attachment record: 83e120e2-1566-4e08-87e9-ed88c34839bc {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:22:12.463935 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c', 'attached_at': '', 'detached_at': '', 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'serial': '2dde8977-3910-4623-b762-d53bfec25ee3'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:22:12.466899 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:22:12.467300 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:12.467600 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:12.468073 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:12.468406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:22:12.484221 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:12.484989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:12.486575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:12.486926 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:22:12.487486 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:12.487658 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:22:12.502806 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:22:12.502806 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:12.508907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:22:12.508907 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:12.515126 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3] added
May 28 14:22:12.515126 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:22:12.515126 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:12.515126 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:12.515126 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:12.515126 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:12.515126 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:12.515337 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:22:12.515539 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:22:12.515807 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:22:12.521034 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3] added
May 28 14:22:12.521034 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:22:12.521034 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:12.521034 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:12.521034 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:12.521034 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:12.521034 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:12.521228 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:22:12.521406 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:22:12.521629 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:22:12.708970 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-changed-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:12.709382 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Refreshing instance network info cache due to event network-changed-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:22:12.709683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] Acquiring lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:22:12.710245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] Acquired lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:22:12.710436 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Refreshing network info cache for port ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:22:13.215579 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:13.517585 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:13.519041 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:22:13.522031 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:22:13.531871 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:22:13.531871 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:22:13.537805 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:22:13.537805 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.546559 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.550953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.562347 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.562768 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.575075 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:13.617462 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260]
May 28 14:22:13.617462 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260] successful.
May 28 14:22:13.617462 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.624700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260]
May 28 14:22:13.624700 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260] successful.
May 28 14:22:13.624700 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.631284 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.640548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.655885 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.656814 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:13.656814 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:22:13.657952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('14', '-', '-', 0) found on session 199 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:22:13.658149 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.666252 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:13.666704 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:13.667210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:13.667210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:22:13.670168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('17', '-', '-', 0) found on session 200 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:22:13.670469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:22:13.684075 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 199 and hctl ['14', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:13.692365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 200 and hctl ['17', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:13.706985 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Updated VIF entry in instance network info cache for port ad40a33e-ce30-4200-ae0a-3a1c6cf305b8. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:22:13.708603 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Updating instance_info_cache with network_info: [{"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:14.210473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-32c6d560-6c6d-42ea-8ee1-17231d336b2b req-633c95c7-f394-488a-8cd0-4cac8e42cdd3 service nova] Releasing lock "refresh_cache-72383293-d922-490c-a7c2-11ed2b3e3e88" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:22:14.684744 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 199 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:14.685175 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:22:14.694754 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 200 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:14.694754 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:22:15.003258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:15.488987 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:22:16.159039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:16.505054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found WWN 3300000002cd95d19 for multipath device dm-9 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:22:16.505268 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:16.506111 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '3300000002cd95d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000002cd95d19'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:16.506239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cd95d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000002cd95d19'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:22:16.508038 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:22:16.508257 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:22:16.508412 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:22:16.524897 np0000001643 nova-compute[98269]: WARNING os_brick.encryptors.luks [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 14:22:16.525175 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:22:16.525308 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:22:16.525424 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:22:16.525987 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x71a780547b60>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c', 'attached_at': '', 'detached_at': '', 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'serial': '2dde8977-3910-4623-b762-d53bfec25ee3'} {{(pid=98269) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 14:22:16.526112 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors.luks [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] formatting encrypted volume /dev/dm-9 {{(pid=98269) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 14:22:20.005362 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:20.451653 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:22:20.451653 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:22:20.451653 np0000001643 nova-compute[98269]:     <volume>2dde8977-3910-4623-b762-d53bfec25ee3</volume>
May 28 14:22:20.451653 np0000001643 nova-compute[98269]:   </usage>
May 28 14:22:20.451653 np0000001643 nova-compute[98269]: </secret>
May 28 14:22:20.451653 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:22:20.458401 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:20.961764 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Attempting to attach volume 2dde8977-3910-4623-b762-d53bfec25ee3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:22:20.963525 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:   <alias name="ua-2dde8977-3910-4623-b762-d53bfec25ee3"/>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:   <serial>2dde8977-3910-4623-b762-d53bfec25ee3</serial>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="978733cf-ddf1-498f-8563-b1c693562911"/>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]: </disk>
May 28 14:22:20.963525 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:22:21.160859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:23.667467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:23.668875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:23.668875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:23.668875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:9f:fe:f6, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:22:25.007554 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:25.235214 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-3fc4693e-7bf1-45ab-8d50-055b8c55257f tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.533s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:26.162003 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:26.998787 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Stashing vm_state: active {{(pid=98269) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 14:22:27.544539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:27.544930 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:28.053334 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:22:28.053530 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Claim successful on node np0000001643
May 28 14:22:28.559731 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating resource usage from migration aba505c1-5a7c-41db-a46f-12cd35a89127
May 28 14:22:28.855074 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:22:28.855293 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:22:29.358136 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:22:29.864775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.320s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:29.865224 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Migrating
May 28 14:22:29.865224 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:22:30.009051 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:30.380251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:22:30.380400 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:22:30.380631 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:22:30.883071 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:31.163846 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:31.212739 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:31.343956 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:31.847480 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:22:33.364469 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Starting migrate_disk_and_power_off {{(pid=98269) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 14:22:33.388826 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.407152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.412389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.443031 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.644717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-090a722c-b73b-4c90-a422-0c1b77d4f861 req-620ab192-c3d5-40eb-a494-88a2e574e990 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:33.644996 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-090a722c-b73b-4c90-a422-0c1b77d4f861 req-620ab192-c3d5-40eb-a494-88a2e574e990 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:33.645281 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-090a722c-b73b-4c90-a422-0c1b77d4f861 req-620ab192-c3d5-40eb-a494-88a2e574e990 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:33.645943 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-090a722c-b73b-4c90-a422-0c1b77d4f861 req-620ab192-c3d5-40eb-a494-88a2e574e990 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:33.645943 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-090a722c-b73b-4c90-a422-0c1b77d4f861 req-620ab192-c3d5-40eb-a494-88a2e574e990 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:33.645943 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-090a722c-b73b-4c90-a422-0c1b77d4f861 req-620ab192-c3d5-40eb-a494-88a2e574e990 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state active and task_state resize_migrating.
May 28 14:22:33.706886 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.725649 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.733765 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.764478 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99968954499991 future=<Future at 0x71a75c16f830 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:33.765639 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998495738000202 future=<Future at 0x71a75c16f830 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:33.765761 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998343676999866 future=<Future at 0x71a75c16f830 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:33.766965 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance destroyed successfully.
May 28 14:22:33.767951 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:21:30Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:22:33.768141 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:33.768963 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:33.769158 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:22:33.770797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.771232 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ca52656-04, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:33.772691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.773521 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:33.775112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.776217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.776217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdb356c6-9de6-49e1-af3f-e24d2379a675) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:33.776983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.777681 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:33.779364 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:33.781854 np0000001643 nova-compute[98269]: INFO os_vif [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04')
May 28 14:22:33.785784 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:22:33.786256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:33.786498 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:33.786972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:33.787512 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:22:33.787614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:33.853777 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634 (non-flash)
May 28 14:22:33.855156 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '199'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836dbd4b-fa5e-4c9d-8209-78032dcad634', '202')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:22:33.855156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '199')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:33.855921 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '200')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:33.856903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c170860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'): ({'sdl'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:22:33.856903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Removing multipathed devices sdi, sdl {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:22:33.857039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flush multipath device 3300000002cd95d19 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:22:33.903173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:33.951217 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:34.012334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if SCSI volumes sdi, sdl have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:22:34.012581 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] SCSI volumes sdi, sdl have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:22:34.013864 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if device paths {'sdi', 'sdl'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:22:34.042248 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Device paths {'sdi', 'sdl'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:22:34.043190 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:22:34.059101 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:34.100781 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260]
May 28 14:22:34.100781 np0000001643 nova-compute[98269]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260] successful.
May 28 14:22:34.100781 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:34.122156 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:34.133873 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:34.169646 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260]
May 28 14:22:34.169646 np0000001643 nova-compute[98269]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260] successful.
May 28 14:22:34.169646 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:34.196324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:34.197359 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:34.197563 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== disconnect_volume: return (410ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:34.197736 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:22:34.200397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:34.294356 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:34.294942 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:34.388509 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:34.389184 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-9 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:22:34.389904 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_resize/disk /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:34.504892 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "cp -r /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_resize/disk /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk" returned: 0 in 0.115s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:34.505266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_resize/disk.config /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:34.559683 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "cp -r /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_resize/disk.config /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config" returned: 0 in 0.054s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:34.560024 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_resize/disk.info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:34.611516 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "cp -r /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_resize/disk.info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" returned: 0 in 0.051s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:35.011396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:35.702595 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c7ecf80-ae93-4b36-a7d6-d3e7ca6763d6 req-eb1205ba-ac10-49cd-9dbb-d0915327a78e service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:35.703167 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c7ecf80-ae93-4b36-a7d6-d3e7ca6763d6 req-eb1205ba-ac10-49cd-9dbb-d0915327a78e service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:35.703245 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c7ecf80-ae93-4b36-a7d6-d3e7ca6763d6 req-eb1205ba-ac10-49cd-9dbb-d0915327a78e service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:35.703365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c7ecf80-ae93-4b36-a7d6-d3e7ca6763d6 req-eb1205ba-ac10-49cd-9dbb-d0915327a78e service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:35.703492 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c7ecf80-ae93-4b36-a7d6-d3e7ca6763d6 req-eb1205ba-ac10-49cd-9dbb-d0915327a78e service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:35.703640 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6c7ecf80-ae93-4b36-a7d6-d3e7ca6763d6 req-eb1205ba-ac10-49cd-9dbb-d0915327a78e service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state active and task_state resize_migrating.
May 28 14:22:35.741031 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:35.741442 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:35.801881 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Port 6ca52656-0417-4c07-901f-b10823a33b3a binding to destination host np0000001643 is already ACTIVE {{(pid=98269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 14:22:35.827079 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:36.334966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:36.334966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:36.334966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:36.334966 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:22:36.809178 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:22:36.816558 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:36.816763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:36.816835 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:37.370905 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:22:37.372474 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:37.460001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:37.460581 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:37.547966 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:37.548415 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-9 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:22:37.552416 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:22:37.553919 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:22:37.555410 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:22:37.558312 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:22:37.559843 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:37.608671 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:37.609146 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12517MB free_disk=72.6474609375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:22:37.609394 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:37.609740 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:37.829727 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:37.886554 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:22:37.886738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:22:37.886808 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:22:38.388793 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:38.622935 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Applying migration context for instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c as it has an incoming, in-progress migration aba505c1-5a7c-41db-a46f-12cd35a89127. Migration status is post-migrating {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 14:22:38.623927 np0000001643 nova-compute[98269]: INFO nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating resource usage from migration aba505c1-5a7c-41db-a46f-12cd35a89127
May 28 14:22:38.677707 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 20b5dfd0-1a53-4169-99be-7859b4ccfa21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:22:38.677846 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 99929164-66e4-49d4-9241-c61f6e2cc985 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:22:38.677966 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 5aefef2c-79e8-4a63-88e1-11aeb4f7023d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:22:38.678055 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 72383293-d922-490c-a7c2-11ed2b3e3e88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:22:38.678140 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Migration aba505c1-5a7c-41db-a46f-12cd35a89127 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 14:22:38.678220 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:22:38.678398 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:22:38.683469 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:22:37 up 49 min,  2 users,  load average: 3.49, 4.42, 4.38\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_18d5cb6ddda14738b70c2460eb02dc4c': '3', 'io_workload': '0', 'num_task_resize_migrated': '1', 'num_proj_50ea6d8cf0d14c40ad9163f647b3d065': '1', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:22:38.689065 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:38.778215 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:38.832752 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:38.980472 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:22:38.980676 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:22:39.335951 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:22:39.484177 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:22:39.844516 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:39.855130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:22:39.876642 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:39.918218 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:22:39.918620 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:22:39.929067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:22:39.930533 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb', 'fe80::fc16:3eff:feb5:72f1', 'fe80::fc16:3eff:fee1:1a18', 'fe80::fc16:3eff:fe0c:9de1', 'fe80::8097:21ff:fe89:3b01'] 
May 28 14:22:39.930861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:22:39.931088 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:22:39.931457 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:39.990362 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:22:39.990362 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.380s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:39.990572 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:22:40.013206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:41.077508 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Starting finish_migration {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 14:22:41.078875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance directory exists: not creating {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 14:22:41.079072 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Creating image(s)
May 28 14:22:41.080069 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:41.166597 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:41.167028 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:22:41.167248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:41.267884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:41.268436 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Cannot resize image /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:22:41.772165 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:22:41.772362 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Ensure instance console log exists: /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:22:41.772703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:41.772908 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:41.773079 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:41.775580 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Start _get_guest_xml network_info=[{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '6f92ae14-93ac-4391-8453-3c0a5f4fc9b9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c', 'attached_at': '2026-05-28T14:22:40.000000', 'detached_at': '', 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'serial': '2dde8977-3910-4623-b762-d53bfec25ee3'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:22:41.779247 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:22:41.780547 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1738752461', uuid='271dc0f9-a1e8-43c8-b2c1-db22f93ac69c'), owner=OwnerMeta(userid='039853f7e499423384aa13ada9b39d22', username='tempest-TestEncryptedCinderVolumes-1171403786-project-member', projectid='50ea6d8cf0d14c40ad9163f647b3d065', projectname='tempest-TestEncryptedCinderVolumes-1171403786'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-1044938039', flavorid='8cbfa764-1ad6-491a-953f-52363b4a5d78', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978161.7801857) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:22:41.781629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:22:41.781912 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:22:41.782769 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:22:41.782942 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:22:41.784065 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:22:41.784394 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T14:22:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='8cbfa764-1ad6-491a-953f-52363b4a5d78',id=13,is_public=True,memory_mb=192,name='tempest-1044938039',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:22:41.784539 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:22:41.784635 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:22:41.784743 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:22:41.784817 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:22:41.784903 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:22:41.785042 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:22:41.785131 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:22:41.785228 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:22:41.785346 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:22:41.785478 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:22:41.795651 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:22:41.882581 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:22:41.883018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:41.883249 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:41.883813 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:41.884215 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:22:41.884660 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:41.884817 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:41.885158 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:41.885376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:22:41.898393 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:41.899236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:41.899804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:41.900103 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:22:41.900718 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:41.900950 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:22:41.912523 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:22:41.912523 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:41.918776 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:22:41.918776 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3] added
May 28 14:22:41.927470 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:41.927470 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:22:41.927470 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:22:41.931247 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3] added
May 28 14:22:41.931247 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:22:41.931247 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:41.931247 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:41.931247 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:22:41.931247 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:22:41.931247 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:41.931593 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:22:41.931593 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:22:41.931741 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:22:41.990622 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:41.990952 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:41.991169 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:41.991399 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:41.991609 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:41.991753 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:22:41.992002 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.83 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:22:42.048896 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:22:42.926336 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:22:42.932104 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:22:42.941324 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:22:42.941324 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:22:42.950659 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:22:42.950659 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:42.961104 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:42.965835 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.979061 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.979765 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.984830 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:42.985114 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:43.029601 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260]
May 28 14:22:43.029601 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260] successful.
May 28 14:22:43.029601 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:43.044063 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:43.055468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260]
May 28 14:22:43.055468 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260] successful.
May 28 14:22:43.055468 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.064168 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.064501 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:43.064672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:43.064672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:22:43.065692 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('9', '-', '-', 0) found on session 203 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:22:43.065771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:22:43.070978 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:43.088123 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 203 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:43.088330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.092073 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:43.092470 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:43.092470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:43.092811 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:22:43.093475 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('14', '-', '-', 0) found on session 204 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:22:43.093572 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:22:43.109168 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 204 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:22:43.111715 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:22:43.701317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:43.701514 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:43.701699 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:43.701829 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:43.701934 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:43.704129 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Terminating instance
May 28 14:22:43.779978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:43.901374 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:22:44.206930 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:22:44.232102 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:44.254954 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:44.374329 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d53ae97b-05c2-4018-b907-f5c56e4c3e80 req-3b5a4dd3-758b-4846-a819-8f50b56aa3b6 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-vif-unplugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:44.375049 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d53ae97b-05c2-4018-b907-f5c56e4c3e80 req-3b5a4dd3-758b-4846-a819-8f50b56aa3b6 service nova] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:44.375211 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d53ae97b-05c2-4018-b907-f5c56e4c3e80 req-3b5a4dd3-758b-4846-a819-8f50b56aa3b6 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:44.375330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d53ae97b-05c2-4018-b907-f5c56e4c3e80 req-3b5a4dd3-758b-4846-a819-8f50b56aa3b6 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:44.375510 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d53ae97b-05c2-4018-b907-f5c56e4c3e80 req-3b5a4dd3-758b-4846-a819-8f50b56aa3b6 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] No waiting events found dispatching network-vif-unplugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:44.375890 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d53ae97b-05c2-4018-b907-f5c56e4c3e80 req-3b5a4dd3-758b-4846-a819-8f50b56aa3b6 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-vif-unplugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:22:44.392972 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:44.398161 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:44.507650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:44.514954 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:44.529857 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999597384000026 future=<Future at 0x71a75c294c80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:44.534134 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Instance destroyed successfully.
May 28 14:22:44.534862 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lazy-loading 'resources' on Instance uuid 5aefef2c-79e8-4a63-88e1-11aeb4f7023d {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:44.824303 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:44.824585 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:22:44.826692 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:44.827015 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:22:44.916606 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found WWN 3300000002cd95d19 for multipath device dm-9 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:22:44.916896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:44.917759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000002cd95d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000002cd95d19'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:44.917892 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cd95d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000002cd95d19'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:22:44.946834 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'attaching', 'instance': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c', 'attached_at': '2026-05-28T14:22:40.000000', 'detached_at': '', 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'serial': '2dde8977-3910-4623-b762-d53bfec25ee3'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:22:44.947305 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:22:44.947565 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:22:44.947732 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:22:44.960916 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:22:44.960916 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:22:44.960916 np0000001643 nova-compute[98269]:     <volume>2dde8977-3910-4623-b762-d53bfec25ee3</volume>
May 28 14:22:44.960916 np0000001643 nova-compute[98269]:   </usage>
May 28 14:22:44.960916 np0000001643 nova-compute[98269]: </secret>
May 28 14:22:44.960916 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:22:45.014560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.037934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1352384900',display_name='tempest-TestVolumeBootPatternV346-server-1352384900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-1352384900',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRymvWZhZVj+0Hp9E62siqYyiPokqb5f5KVBZnGE3dW56nfScnms2AdsFlI2JKWMKAa02ANKDwd2bOKaZbceZcZwFfxYWDpdIi63qjHXylFffZjXBEO+Ky4DZCVMe56Lw==',key_name='tempest-keypair-1084749110',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:22:05Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-8w0w6xi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=5aefef2c-79e8-4a63-88e1-11aeb4f7023d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:22:45.038131 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "address": "fa:16:3e:e1:1a:18", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5643af4d-48", "ovs_interfaceid": "5643af4d-48d5-4fa4-a3a9-f16cdf15b89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:45.038817 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1a:18,bridge_name='br-int',has_traffic_filtering=True,id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5643af4d-48') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:45.039134 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1a:18,bridge_name='br-int',has_traffic_filtering=True,id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5643af4d-48') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:22:45.040957 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.041133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5643af4d-48, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:45.042098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.042870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:45.043063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.043840 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.043956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c755e4d7-5392-4915-bf6c-66a98b25aa87) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:45.044344 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.044756 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:45.044919 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.046252 np0000001643 nova-compute[98269]: INFO os_vif [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1a:18,bridge_name='br-int',has_traffic_filtering=True,id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5643af4d-48')
May 28 14:22:45.047622 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:22:45.047873 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:45.048021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:45.048319 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:45.048605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d67546a-f26e-402b-8f88-47bffd513e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:22:45.048719 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:45.075520 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '204')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:22:45.075520 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', '194')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:45.076333 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16', '195')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:45.076778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781174c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:22:45.076948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:22:45.077177 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flush multipath device 3300000007985665a {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:22:45.137933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:45.181114 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:45.222768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:22:45.223130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:22:45.223949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:22:45.235593 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:22:45.235740 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:22:45.247568 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:45.277262 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.40.100,3260]
May 28 14:22:45.277262 np0000001643 nova-compute[98269]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.40.100,3260] successful.
May 28 14:22:45.277262 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:45.295233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:45.307378 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:45.340342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.50.100,3260]
May 28 14:22:45.340342 np0000001643 nova-compute[98269]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-6d67546a-f26e-402b-8f88-47bffd513e16, portal: 192.168.50.100,3260] successful.
May 28 14:22:45.340342 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:45.361956 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:45.362170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:45.362296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== disconnect_volume: return (314ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:45.362421 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:22:45.362865 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Deleting instance files /opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d_del
May 28 14:22:45.363549 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Deletion of /opt/stack/data/nova/instances/5aefef2c-79e8-4a63-88e1-11aeb4f7023d_del complete
May 28 14:22:45.468545 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:21:30Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:22:45.468735 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:45.469239 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:45.470918 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] End _get_guest_xml xml=<domain type="qemu">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <uuid>271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</uuid>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <name>instance-0000004a</name>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1738752461</nova:name>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:22:41</nova:creationTime>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:flavor name="tempest-1044938039" id="8cbfa764-1ad6-491a-953f-52363b4a5d78">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:extraSpecs/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:user uuid="039853f7e499423384aa13ada9b39d22">tempest-TestEncryptedCinderVolumes-1171403786-project-member</nova:user>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:project uuid="50ea6d8cf0d14c40ad9163f647b3d065">tempest-TestEncryptedCinderVolumes-1171403786</nova:project>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <nova:port uuid="6ca52656-0417-4c07-901f-b10823a33b3a">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <system>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <entry name="serial">271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</entry>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <entry name="uuid">271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</entry>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </system>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <os>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   </os>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <features>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   </features>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   <devices>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </disk>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </disk>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <alias name="ua-2dde8977-3910-4623-b762-d53bfec25ee3"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <serial>2dde8977-3910-4623-b762-d53bfec25ee3</serial>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <encryption format="luks">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:         <secret type="passphrase" uuid="97568773-3d6e-40e6-8116-cd5807e4e5c2"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       </encryption>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </disk>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:9f:fe:f6"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <target dev="tap6ca52656-04"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </interface>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/console.log" append="off"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </serial>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <video>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </video>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </rng>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:   </devices>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]: </domain>
May 28 14:22:45.470918 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:21:30Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "vif_mac": "fa:16:3e:9f:fe:f6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:22:45.474116 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.474641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0ca7d7e-0dea-58bb-904f-1584a02e4500', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:45.475285 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.476430 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:45.476810 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.478543 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.478734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ca52656-04, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:45.479199 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ca52656-04, col_values=(('qos', UUID('b663da01-e659-4a6e-a133-3de061473f23')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:45.479385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ca52656-04, col_values=(('external_ids', {'iface-id': '6ca52656-0417-4c07-901f-b10823a33b3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:fe:f6', 'vm-uuid': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:45.480219 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.481560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:45.485008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:45.485942 np0000001643 nova-compute[98269]: INFO os_vif [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04')
May 28 14:22:45.869216 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Took 1.66 seconds to destroy the instance on the hypervisor.
May 28 14:22:45.871673 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:22:45.872031 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:22:45.872181 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:22:45.872897 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:45.929061 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:46.366561 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c46dab09-4566-4dfb-9181-54b0ab7fe0c8 req-2f6fb3bf-54e4-4c7a-b9b6-33a225919d85 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-vif-deleted-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:46.367007 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-c46dab09-4566-4dfb-9181-54b0ab7fe0c8 req-2f6fb3bf-54e4-4c7a-b9b6-33a225919d85 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Neutron deleted interface 5643af4d-48d5-4fa4-a3a9-f16cdf15b89b; detaching it from the instance and deleting it from the info cache
May 28 14:22:46.368691 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-c46dab09-4566-4dfb-9181-54b0ab7fe0c8 req-2f6fb3bf-54e4-4c7a-b9b6-33a225919d85 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Detach interface failed, port_id=5643af4d-48d5-4fa4-a3a9-f16cdf15b89b, reason: Instance 5aefef2c-79e8-4a63-88e1-11aeb4f7023d could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:22:46.427406 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a71d4d58-0cca-4604-9596-e44f39863991 req-f141f089-db4d-4655-9c1f-331ca0b48040 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-vif-unplugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:46.428064 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a71d4d58-0cca-4604-9596-e44f39863991 req-f141f089-db4d-4655-9c1f-331ca0b48040 service nova] Acquiring lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:46.428220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a71d4d58-0cca-4604-9596-e44f39863991 req-f141f089-db4d-4655-9c1f-331ca0b48040 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:46.428431 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a71d4d58-0cca-4604-9596-e44f39863991 req-f141f089-db4d-4655-9c1f-331ca0b48040 service nova] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:46.428577 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a71d4d58-0cca-4604-9596-e44f39863991 req-f141f089-db4d-4655-9c1f-331ca0b48040 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] No waiting events found dispatching network-vif-unplugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:46.428801 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a71d4d58-0cca-4604-9596-e44f39863991 req-f141f089-db4d-4655-9c1f-331ca0b48040 service nova] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Received event network-vif-unplugged-5643af4d-48d5-4fa4-a3a9-f16cdf15b89b for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:22:46.754409 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:47.002405 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:47.002534 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:47.002569 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:22:47.002678 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] No VIF found with MAC fa:16:3e:9f:fe:f6, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:22:47.003090 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Using config drive
May 28 14:22:47.256735 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Took 1.38 seconds to deallocate network for instance.
May 28 14:22:47.375138 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:47.401062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:47.500813 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:47.573187 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-efa10a28-8691-4717-98b1-be07e02e7891 req-9a3db987-0df9-41e8-b85d-b30bc3f73d65 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:47.573503 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efa10a28-8691-4717-98b1-be07e02e7891 req-9a3db987-0df9-41e8-b85d-b30bc3f73d65 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:47.573786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efa10a28-8691-4717-98b1-be07e02e7891 req-9a3db987-0df9-41e8-b85d-b30bc3f73d65 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:47.573986 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efa10a28-8691-4717-98b1-be07e02e7891 req-9a3db987-0df9-41e8-b85d-b30bc3f73d65 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:47.574623 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-efa10a28-8691-4717-98b1-be07e02e7891 req-9a3db987-0df9-41e8-b85d-b30bc3f73d65 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:47.574794 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-efa10a28-8691-4717-98b1-be07e02e7891 req-9a3db987-0df9-41e8-b85d-b30bc3f73d65 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state active and task_state resize_finish.
May 28 14:22:47.735396 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:47.736242 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:47.744214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:47.763837 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:47.808611 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:22:47.822995 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:22:47.823330 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:22:48.314256 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:48.314484 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:48.614461 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:22:48.614826 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:22:48.764613 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00044954999975743704 future=<Future at 0x71a75c16f830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:48.764768 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:48.764898 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.764485246999811 future=<Future at 0x71a75c294c80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:48.765025 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=10.764369379000073 future=<Future at 0x71a75c294c80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:48.766555 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Emitting event <LifecycleEvent: 1779978153.7640455, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:48.766919 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Stopped (Lifecycle Event)
May 28 14:22:48.978400 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance event wait completed in 0 seconds for  {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:22:48.978953 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c due to new event <LifecycleEvent: 1779978168.978637, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Resumed> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:22:48.980335 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978168.978637, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:48.980335 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Resumed (Lifecycle Event)
May 28 14:22:48.983101 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance running successfully.
May 28 14:22:48.983917 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Failed to set time: agent not configured {{(pid=98269) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 14:22:48.984066 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1822f7a5-f83e-4fb5-a32b-233d533f5a35 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] finish_migration finished successfully. {{(pid=98269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 14:22:49.119467 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:22:49.269938 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1db9797d-c59d-4e1f-a896-0fe28016a24f tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:49.483321 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:49.486599 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:22:49.636195 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ce3c1e65-0ec1-4f9d-a578-3250c8085b14 req-6ef1d81d-306e-4a88-9db4-9938d5da2335 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:49.636670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ce3c1e65-0ec1-4f9d-a578-3250c8085b14 req-6ef1d81d-306e-4a88-9db4-9938d5da2335 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:49.636670 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ce3c1e65-0ec1-4f9d-a578-3250c8085b14 req-6ef1d81d-306e-4a88-9db4-9938d5da2335 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:49.636800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ce3c1e65-0ec1-4f9d-a578-3250c8085b14 req-6ef1d81d-306e-4a88-9db4-9938d5da2335 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:49.637956 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ce3c1e65-0ec1-4f9d-a578-3250c8085b14 req-6ef1d81d-306e-4a88-9db4-9938d5da2335 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:49.638166 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ce3c1e65-0ec1-4f9d-a578-3250c8085b14 req-6ef1d81d-306e-4a88-9db4-9938d5da2335 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state resized and task_state None.
May 28 14:22:49.641589 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.324s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:49.696106 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Deleted allocations for instance 5aefef2c-79e8-4a63-88e1-11aeb4f7023d
May 28 14:22:49.859275 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:49.859275 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:49.859275 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:49.859275 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:49.859275 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:49.861039 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Terminating instance
May 28 14:22:49.989553 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 14:22:49.989795 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978169.989615, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:49.989905 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Started (Lifecycle Event)
May 28 14:22:50.015787 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.364879 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:22:50.392112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.395745 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.416714 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.425186 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.450786 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.451387 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.480876 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:50.492198 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:22:50.496909 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:22:50.557348 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5cad5621-e65f-42b8-96b5-73f029bf8e11 req-1e4d3255-078c-4211-8823-74868bc49004 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-vif-unplugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:50.557348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5cad5621-e65f-42b8-96b5-73f029bf8e11 req-1e4d3255-078c-4211-8823-74868bc49004 service nova] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:50.557584 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5cad5621-e65f-42b8-96b5-73f029bf8e11 req-1e4d3255-078c-4211-8823-74868bc49004 service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:50.558171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5cad5621-e65f-42b8-96b5-73f029bf8e11 req-1e4d3255-078c-4211-8823-74868bc49004 service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:50.558362 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5cad5621-e65f-42b8-96b5-73f029bf8e11 req-1e4d3255-078c-4211-8823-74868bc49004 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] No waiting events found dispatching network-vif-unplugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:50.558555 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5cad5621-e65f-42b8-96b5-73f029bf8e11 req-1e4d3255-078c-4211-8823-74868bc49004 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-vif-unplugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:22:50.690562 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Instance destroyed successfully.
May 28 14:22:50.692079 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid 72383293-d922-490c-a7c2-11ed2b3e3e88 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:50.707923 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-46d70f94-8d07-4aa1-a704-3b1ca8b92790 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "5aefef2c-79e8-4a63-88e1-11aeb4f7023d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.006s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:50.999349 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99978752099969 future=<Future at 0x71a77810a240 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:51.195491 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1205806636',display_name='tempest-TestVolumeBootPattern-server-1205806636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1205806636',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:22:10Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-wswdh26a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:22:11Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=72383293-d922-490c-a7c2-11ed2b3e3e88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:22:51.195491 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "address": "fa:16:3e:0c:9d:e1", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad40a33e-ce", "ovs_interfaceid": "ad40a33e-ce30-4200-ae0a-3a1c6cf305b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:51.195491 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:9d:e1,bridge_name='br-int',has_traffic_filtering=True,id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad40a33e-ce') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:51.195491 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:9d:e1,bridge_name='br-int',has_traffic_filtering=True,id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad40a33e-ce') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:22:51.195762 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:51.195989 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad40a33e-ce, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:51.196939 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:51.197939 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:51.198822 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:51.199634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:51.199812 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a26c2cfe-a52b-4267-bff2-ab1cbe426eac) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:51.200367 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:51.201025 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:51.201871 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:51.204265 np0000001643 nova-compute[98269]: INFO os_vif [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:9d:e1,bridge_name='br-int',has_traffic_filtering=True,id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad40a33e-ce')
May 28 14:22:51.207356 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:22:51.207356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:51.207356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:51.207356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:51.207356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:22:51.207356 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:51.239733 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '204')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '197')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '198')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778160540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'): ({'sdh'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sde, sdh {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:22:51.239733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 33000000089d82104 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:22:51.296410 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:51.340046 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:51.399090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sde, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:22:51.399090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sde, sdh have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:22:51.399090 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sde', 'sdh'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:22:51.410153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sde', 'sdh'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:22:51.410153 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:22:51.422810 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:51.427244 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:51.455703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260]
May 28 14:22:51.455703 np0000001643 nova-compute[98269]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260] successful.
May 28 14:22:51.455703 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:51.481280 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:51.492129 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:51.492554 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:51.492796 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:51.497880 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:51.540866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260]
May 28 14:22:51.540866 np0000001643 nova-compute[98269]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260] successful.
May 28 14:22:51.540866 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:51.562468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:51.562468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:51.562468 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (352ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:51.562468 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:22:51.562468 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Deleting instance files /opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88_del
May 28 14:22:51.562468 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Deletion of /opt/stack/data/nova/instances/72383293-d922-490c-a7c2-11ed2b3e3e88_del complete
May 28 14:22:51.578281 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Port 6ca52656-0417-4c07-901f-b10823a33b3a binding to destination host np0000001643 is already ACTIVE {{(pid=98269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 14:22:51.578595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:22:51.578770 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:22:51.578949 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:22:52.067118 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Took 1.70 seconds to destroy the instance on the hypervisor.
May 28 14:22:52.067744 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:22:52.068089 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:22:52.068219 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:22:52.068514 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:52.080883 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:52.147158 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:52.410579 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:52.598784 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:52.637992 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-78accda2-c61a-4b99-b896-715ad74b1e0b req-3fdf45ab-31f0-475a-8c27-51df42322936 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-vif-unplugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:52.638212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-78accda2-c61a-4b99-b896-715ad74b1e0b req-3fdf45ab-31f0-475a-8c27-51df42322936 service nova] Acquiring lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:52.638428 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-78accda2-c61a-4b99-b896-715ad74b1e0b req-3fdf45ab-31f0-475a-8c27-51df42322936 service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:52.638635 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-78accda2-c61a-4b99-b896-715ad74b1e0b req-3fdf45ab-31f0-475a-8c27-51df42322936 service nova] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:52.638687 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-78accda2-c61a-4b99-b896-715ad74b1e0b req-3fdf45ab-31f0-475a-8c27-51df42322936 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] No waiting events found dispatching network-vif-unplugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:52.638783 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-78accda2-c61a-4b99-b896-715ad74b1e0b req-3fdf45ab-31f0-475a-8c27-51df42322936 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-vif-unplugged-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:22:52.655534 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f4a6074-4c03-4573-96f8-99869f70421f req-b78b92f6-afb9-4130-865f-f821c55b3215 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Received event network-vif-deleted-ad40a33e-ce30-4200-ae0a-3a1c6cf305b8 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:52.655848 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-2f4a6074-4c03-4573-96f8-99869f70421f req-b78b92f6-afb9-4130-865f-f821c55b3215 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Neutron deleted interface ad40a33e-ce30-4200-ae0a-3a1c6cf305b8; detaching it from the instance and deleting it from the info cache
May 28 14:22:52.657633 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f4a6074-4c03-4573-96f8-99869f70421f req-b78b92f6-afb9-4130-865f-f821c55b3215 service nova] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Detach interface failed, port_id=ad40a33e-ce30-4200-ae0a-3a1c6cf305b8, reason: Instance 72383293-d922-490c-a7c2-11ed2b3e3e88 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:22:53.095368 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:53.100782 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:22:53.597414 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Took 1.53 seconds to deallocate network for instance.
May 28 14:22:53.604081 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Creating tmpfile /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/tmpwh89qcnk to verify with other compute node that the instance is on the same shared storage. {{(pid=98269) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 14:22:53.604302 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:22:54.129868 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.132285 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.149603 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.152208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.156541 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Took 0.56 seconds to detach 1 volumes for instance.
May 28 14:22:54.178357 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.285615 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38c7cefd-8286-48f8-8051-e221d5582b2c req-a1cf5e1c-9f75-437f-84ee-29bc7d569ce1 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:54.285737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38c7cefd-8286-48f8-8051-e221d5582b2c req-a1cf5e1c-9f75-437f-84ee-29bc7d569ce1 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:54.285899 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38c7cefd-8286-48f8-8051-e221d5582b2c req-a1cf5e1c-9f75-437f-84ee-29bc7d569ce1 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:54.285981 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-38c7cefd-8286-48f8-8051-e221d5582b2c req-a1cf5e1c-9f75-437f-84ee-29bc7d569ce1 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:54.286098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-38c7cefd-8286-48f8-8051-e221d5582b2c req-a1cf5e1c-9f75-437f-84ee-29bc7d569ce1 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:54.286240 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-38c7cefd-8286-48f8-8051-e221d5582b2c req-a1cf5e1c-9f75-437f-84ee-29bc7d569ce1 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state resized and task_state resize_reverting.
May 28 14:22:54.429055 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99972845000002 future=<Future at 0x71a75c124230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:54.430336 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance destroyed successfully.
May 28 14:22:54.430743 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'resources' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:54.661962 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:54.662105 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:54.673288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:54.673603 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:54.673838 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:54.674019 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:54.674164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:54.677456 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Terminating instance
May 28 14:22:54.907901 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:22:54.908090 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:22:54.932923 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:22:49Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:22:54.933120 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:54.933658 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:54.933870 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:22:54.934841 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.935093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ca52656-04, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:54.936142 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.937123 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:54.937432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.938222 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.938409 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b663da01-e659-4a6e-a133-3de061473f23) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:54.939430 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:54.940420 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:54.942001 np0000001643 nova-compute[98269]: INFO os_vif [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04')
May 28 14:22:54.944592 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:22:54.944839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:54.944957 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:54.945258 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:54.945546 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:22:54.945649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:22:54.970191 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:54.970191 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:54.970191 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:54.970191 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:54.970191 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:54.970191 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:54.970191 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:54.970510 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:54.970510 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:54.970510 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:54.970510 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:54.970510 np0000001643 nova-compute[98269]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:54.970510 np0000001643 nova-compute[98269]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:22:54.970510 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:54.970510 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '204')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:22:54.970727 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '204')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:54.971333 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '203')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:54.972068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7804b2f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'): ({'sdd'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:22:54.972287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Removing multipathed devices sdi, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:22:54.972439 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flush multipath device 3300000002cd95d19 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:22:55.007803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:55.052975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:55.100054 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if SCSI volumes sdi, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:22:55.100307 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] SCSI volumes sdi, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:22:55.101330 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if device paths {'sdi', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:22:55.112600 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Device paths {'sdi', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:22:55.112779 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:22:55.124239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:55.158709 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260]
May 28 14:22:55.158709 np0000001643 nova-compute[98269]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260] successful.
May 28 14:22:55.158709 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:55.176051 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:55.180845 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:22:55.189141 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:55.196373 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:55.198133 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:55.217485 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:55.225029 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260]
May 28 14:22:55.225029 np0000001643 nova-compute[98269]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260] successful.
May 28 14:22:55.225029 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:55.240752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:55.241895 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:55.242016 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== disconnect_volume: return (297ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:55.242166 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:22:55.328912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-575dddc2-3058-4cd4-869f-c1e0756410c9 req-2f185fd3-0073-42e0-9d82-4f616489119a service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-vif-unplugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:55.328912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-575dddc2-3058-4cd4-869f-c1e0756410c9 req-2f185fd3-0073-42e0-9d82-4f616489119a service nova] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:55.328912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-575dddc2-3058-4cd4-869f-c1e0756410c9 req-2f185fd3-0073-42e0-9d82-4f616489119a service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:55.328912 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-575dddc2-3058-4cd4-869f-c1e0756410c9 req-2f185fd3-0073-42e0-9d82-4f616489119a service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:55.328912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-575dddc2-3058-4cd4-869f-c1e0756410c9 req-2f185fd3-0073-42e0-9d82-4f616489119a service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] No waiting events found dispatching network-vif-unplugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:55.328912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-575dddc2-3058-4cd4-869f-c1e0756410c9 req-2f185fd3-0073-42e0-9d82-4f616489119a service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-vif-unplugged-10860281-714d-496c-8291-f49e6d56579f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:22:55.362680 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:55.368622 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:55.411101 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:22:55.477596 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:55.484781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:55.500417 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99970273200006 future=<Future at 0x71a75c32ad80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:55.501861 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Instance destroyed successfully.
May 28 14:22:55.502406 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lazy-loading 'resources' on Instance uuid 99929164-66e4-49d4-9241-c61f6e2cc985 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:55.919343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.257s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:55.967725 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance 72383293-d922-490c-a7c2-11ed2b3e3e88
May 28 14:22:56.004802 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-935027716',display_name='tempest-TestVolumeBootPatternV346-server-935027716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-935027716',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG58ttUAiDmV/Kknz0CnjJ8vOzuAdWfpyJDfyQUUErkzlOzHyceuEuYwxd4swPXzJfrDgAVEHTqkUZsnA0LjJKFNofDaXBYRQv7iRyvmipXoSdVFSN72/WldIZ8/6kzl5Q==',key_name='tempest-keypair-713122902',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:21:03Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-nyhhlxjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=99929164-66e4-49d4-9241-c61f6e2cc985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:22:56.005071 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "10860281-714d-496c-8291-f49e6d56579f", "address": "fa:16:3e:b5:72:f1", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10860281-71", "ovs_interfaceid": "10860281-714d-496c-8291-f49e6d56579f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:22:56.005677 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:72:f1,bridge_name='br-int',has_traffic_filtering=True,id=10860281-714d-496c-8291-f49e6d56579f,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10860281-71') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:22:56.005915 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:72:f1,bridge_name='br-int',has_traffic_filtering=True,id=10860281-714d-496c-8291-f49e6d56579f,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10860281-71') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:22:56.007026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:56.007177 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10860281-71, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:56.007980 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:56.009241 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:22:56.009891 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:56.010008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=814ec1b0-8978-4a12-bd3e-165fbb541f67) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:22:56.010372 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:56.011089 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:22:56.012690 np0000001643 nova-compute[98269]: INFO os_vif [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:72:f1,bridge_name='br-int',has_traffic_filtering=True,id=10860281-714d-496c-8291-f49e6d56579f,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10860281-71')
May 28 14:22:56.014082 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:22:56.014396 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:22:56.014589 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:22:56.014926 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:22:56.015258 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:22:56.015433 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:22:56.040632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:56.040632 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:56.040632 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:56.040632 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:56.040632 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:22:56.040839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:56.040839 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:22:56.040839 np0000001643 nova-compute[98269]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:56.040839 np0000001643 nova-compute[98269]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f (non-flash)
May 28 14:22:56.040839 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:22:56.040839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:22:56.041032 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '190')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:56.041632 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f', '189')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:22:56.042189 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a780197560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'): ({'sdj'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:22:56.042355 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Removing multipathed devices sdj, sdk {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:22:56.042560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flush multipath device 330000000556d5875 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:22:56.097400 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:56.132949 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:22:56.169837 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:22:56.170309 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:22:56.170808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:22:56.184502 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:22:56.184673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:22:56.194745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:56.225700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.40.100,3260]
May 28 14:22:56.225700 np0000001643 nova-compute[98269]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.40.100,3260] successful.
May 28 14:22:56.225700 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:56.238227 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:56.249907 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:56.281280 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.50.100,3260]
May 28 14:22:56.281280 np0000001643 nova-compute[98269]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-13a32d7b-7505-42a9-bc59-f9d2ee13dd9f, portal: 192.168.50.100,3260] successful.
May 28 14:22:56.281280 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:56.294115 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:22:56.294391 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:22:56.294610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== disconnect_volume: return (279ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:22:56.294772 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:22:56.295101 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Deleting instance files /opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985_del
May 28 14:22:56.295734 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Deletion of /opt/stack/data/nova/instances/99929164-66e4-49d4-9241-c61f6e2cc985_del complete
May 28 14:22:56.355694 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-59302810-420b-48b0-a2a6-9ac89fe56e9e req-ecc47a45-b85e-4014-aa5a-e86704d55133 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:56.355874 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-59302810-420b-48b0-a2a6-9ac89fe56e9e req-ecc47a45-b85e-4014-aa5a-e86704d55133 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:56.356038 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-59302810-420b-48b0-a2a6-9ac89fe56e9e req-ecc47a45-b85e-4014-aa5a-e86704d55133 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:56.356164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-59302810-420b-48b0-a2a6-9ac89fe56e9e req-ecc47a45-b85e-4014-aa5a-e86704d55133 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:56.356296 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-59302810-420b-48b0-a2a6-9ac89fe56e9e req-ecc47a45-b85e-4014-aa5a-e86704d55133 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:56.356406 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-59302810-420b-48b0-a2a6-9ac89fe56e9e req-ecc47a45-b85e-4014-aa5a-e86704d55133 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state resized and task_state resize_reverting.
May 28 14:22:56.360502 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:56.361038 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:56.802578 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Took 1.62 seconds to destroy the instance on the hypervisor.
May 28 14:22:56.803124 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:22:56.803605 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:22:56.803735 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:22:56.804380 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:56.859117 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:22:56.864094 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'migration_context' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:22:56.975196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-db255910-dddf-45b9-991b-d520adc6b82f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "72383293-d922-490c-a7c2-11ed2b3e3e88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.117s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:57.366766 np0000001643 nova-compute[98269]: DEBUG nova.objects.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Object Instance<271dc0f9-a1e8-43c8-b2c1-db22f93ac69c> lazy-loaded attributes: resources,migration_context {{(pid=98269) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 14:22:57.380820 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5c9f709d-175d-49df-813d-b2bc9072d4c4 req-5fccbc17-37c5-4e1d-85b6-9c0ba1ef6ea3 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-vif-unplugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:57.380978 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5c9f709d-175d-49df-813d-b2bc9072d4c4 req-5fccbc17-37c5-4e1d-85b6-9c0ba1ef6ea3 service nova] Acquiring lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:57.381155 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5c9f709d-175d-49df-813d-b2bc9072d4c4 req-5fccbc17-37c5-4e1d-85b6-9c0ba1ef6ea3 service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:57.381316 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5c9f709d-175d-49df-813d-b2bc9072d4c4 req-5fccbc17-37c5-4e1d-85b6-9c0ba1ef6ea3 service nova] Lock "99929164-66e4-49d4-9241-c61f6e2cc985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:57.381475 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5c9f709d-175d-49df-813d-b2bc9072d4c4 req-5fccbc17-37c5-4e1d-85b6-9c0ba1ef6ea3 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] No waiting events found dispatching network-vif-unplugged-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:22:57.381678 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5c9f709d-175d-49df-813d-b2bc9072d4c4 req-5fccbc17-37c5-4e1d-85b6-9c0ba1ef6ea3 service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-vif-unplugged-10860281-714d-496c-8291-f49e6d56579f for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:22:57.606225 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:22:57.606433 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:22:57.670557 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:22:58.109276 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:22:58.172371 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Took 1.37 seconds to deallocate network for instance.
May 28 14:22:58.416527 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2732bf82-2420-42a3-a064-f7e0baf8f882 req-cf82f78d-fa59-499a-af87-66963b266b0d service nova] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Received event network-vif-deleted-10860281-714d-496c-8291-f49e6d56579f {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:22:58.719643 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:22:58.803266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:58.803423 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:59.121464 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 2.760s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:22:59.121724 np0000001643 nova-compute[98269]: DEBUG nova.compute.rpcapi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98269) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 14:22:59.224822 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:59.224944 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:22:59.306967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:22:59.469422 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:22:59.469780 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:22:59.530055 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003899190000993258 future=<Future at 0x71a75c294c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:59.530184 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:59.530223 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.468864344999929 future=<Future at 0x71a77810a240 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:59.530293 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=6.468793672999709 future=<Future at 0x71a77810a240 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:22:59.531341 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978164.5292892, 5aefef2c-79e8-4a63-88e1-11aeb4f7023d => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:22:59.531341 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] VM Stopped (Lifecycle Event)
May 28 14:22:59.850913 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:22:59.972142 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:23:00.033386 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 5aefef2c-79e8-4a63-88e1-11aeb4f7023d] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:00.477917 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.253s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:00.479669 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.629s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:00.482892 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:23:00.483030 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Claim successful on node np0000001643
May 28 14:23:00.537352 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Deleted allocations for instance 99929164-66e4-49d4-9241-c61f6e2cc985
May 28 14:23:00.687380 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Swapping old allocation on dict_keys(['f568fd9c-b967-45a3-9c51-ad00d748c4b7']) held by migration aba505c1-5a7c-41db-a46f-12cd35a89127 for instance
May 28 14:23:00.766221 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Overwriting current allocation {'allocations': {'f568fd9c-b967-45a3-9c51-ad00d748c4b7': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 96}}, 'project_id': '50ea6d8cf0d14c40ad9163f647b3d065', 'user_id': '039853f7e499423384aa13ada9b39d22', 'consumer_generation': 1} on consumer 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 14:23:00.839779 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:00.893925 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:23:00.894047 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquired lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:23:00.894178 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:23:01.015738 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:01.015950 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:01.015998 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:23:01.016033 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:23:01.016940 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:01.017094 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:23:01.396101 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:01.547763 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-f5697975-295f-4fa0-b255-5c741a7aaf50 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "99929164-66e4-49d4-9241-c61f6e2cc985" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.874s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:01.715548 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:23:01.715815 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:23:01.733226 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:01.842619 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:23:02.220885 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:23:02.344313 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Releasing lock "refresh_cache-271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:23:02.344931 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:23:02.354178 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:23:02.371397 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:23:02.422335 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:23:02.422662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:23:02.431643 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:23:02.432622 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feab:4a84', 'fe80::446e:2dff:fe76:adeb'] 
May 28 14:23:02.432728 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:23:02.432836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:23:02.433102 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:23:02.728090 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.248s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:02.728678 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:23:03.237210 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:23:03.237437 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:23:03.237840 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:03.238101 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:03.303739 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:23:03.516677 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Starting finish_revert_migration {{(pid=98269) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 14:23:03.536228 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Start _get_guest_xml network_info=[{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '4f08f208-2730-4b9d-aac2-748cd2e85d10', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c', 'attached_at': '2026-05-28T14:23:03.000000', 'detached_at': '', 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'serial': '2dde8977-3910-4623-b762-d53bfec25ee3'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:23:03.538888 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:23:03.540426 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1738752461', uuid='271dc0f9-a1e8-43c8-b2c1-db22f93ac69c'), owner=OwnerMeta(userid='039853f7e499423384aa13ada9b39d22', username='tempest-TestEncryptedCinderVolumes-1171403786-project-member', projectid='50ea6d8cf0d14c40ad9163f647b3d065', projectname='tempest-TestEncryptedCinderVolumes-1171403786'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978183.5400007) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:23:03.541637 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:23:03.542042 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:23:03.543356 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:23:03.543605 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:23:03.545104 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:23:03.545567 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:23:03.545803 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:23:03.545955 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:23:03.546171 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:23:03.546319 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:23:03.546519 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:23:03.546754 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:23:03.546930 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:23:03.547117 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:23:03.547306 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:23:03.547515 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:23:03.547775 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'vcpu_model' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:23:03.740947 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:23:03.778406 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Successfully created port: 86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:23:04.062705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:23:04.165580 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config --force-share --output=json" returned: 0 in 0.103s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:23:04.166132 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:04.166426 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:04.167312 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:04.167884 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:23:04.168343 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:23:04.168552 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:04.168952 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:04.169204 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:23:04.182427 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:04.183097 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:04.183642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:04.183964 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:23:04.184416 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:04.184653 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:23:04.196000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:23:04.196000 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:04.200914 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:23:04.200914 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:04.209558 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3] added
May 28 14:23:04.209558 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:23:04.209558 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:04.209558 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:04.209558 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:04.209558 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:04.209558 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:04.209803 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:23:04.210056 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:23:04.210241 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:23:04.213649 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3] added
May 28 14:23:04.213649 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:23:04.213649 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:04.213649 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:04.213649 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:04.213649 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:04.213649 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:04.213867 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:23:04.214006 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:23:04.214160 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:23:04.249886 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:23:04.289181 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Successfully updated port: 86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:23:04.296559 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:04.296841 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:04.297182 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:04.297403 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:04.297620 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:04.300979 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Terminating instance
May 28 14:23:04.337683 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-changed-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:04.337799 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Refreshing instance network info cache due to event network-changed-86b56357-8606-4fdf-bd31-9570ea3aa841. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:23:04.337960 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] Acquiring lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:23:04.338060 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] Acquired lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:23:04.338160 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Refreshing network info cache for port 86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:23:04.756170 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Booting with volume 65e3082c-e702-49e2-89fe-709beaf49e42 at /dev/vda
May 28 14:23:04.791407 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:23:04.798192 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:23:04.805111 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:23:04.808042 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:23:04.823332 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:04.825585 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:04.832342 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:23:04.847426 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:04.852628 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:04.867192 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:04.873547 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:04.888666 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:23:04.888967 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:23:04.898335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:23:04.899123 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044'] 
May 28 14:23:04.899299 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:23:04.899409 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:23:04.899687 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:23:04.899884 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updating existing volume attachment record: ba5ae7a3-5fd3-4bf3-a24b-8bb5e6d3eded {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:23:04.933697 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:23:05.082684 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:23:05.102179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:05.110985 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:05.126536 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999686781000037 future=<Future at 0x71a75c328740 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:05.128971 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Instance destroyed successfully.
May 28 14:23:05.130168 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lazy-loading 'resources' on Instance uuid 20b5dfd0-1a53-4169-99be-7859b4ccfa21 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:23:05.210846 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:23:05.214718 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:23:05.223496 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:23:05.223496 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:23:05.230771 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:23:05.230771 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.237423 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.245925 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.254049 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.254049 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.254049 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:05.254208 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.254208 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.254208 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:05.261759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.261759 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.261759 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:05.261926 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.261926 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.261926 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:05.283174 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260]
May 28 14:23:05.283174 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260] successful.
May 28 14:23:05.283174 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.295942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.301836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260]
May 28 14:23:05.301836 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260] successful.
May 28 14:23:05.301836 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.310830 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.310830 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.310830 np0000001643 nova-compute[98269]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.310830 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.310830 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:05.310998 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.310998 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.310998 np0000001643 nova-compute[98269]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.310998 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.310998 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:05.311289 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:05.311463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:23:05.312021 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('7', '-', '-', 0) found on session 205 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:23:05.312133 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:23:05.317593 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:05.331915 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 205 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:23:05.332051 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:05.334496 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:05.334496 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:23:05.335097 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] HCTL ('8', '-', '-', 0) found on session 206 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:23:05.335235 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:23:05.350379 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Searching for a device in session 206 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:23:05.350514 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:23:05.585073 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9d277a83-956c-474b-b21b-296a03805815 req-674d73a3-e284-44be-8097-f1e2d2d743e6 service nova] Releasing lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:23:05.585394 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:23:05.585599 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:23:05.634417 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-181217873',display_name='tempest-TestVolumeBootPatternV346-server-181217873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpatternv346-server-181217873',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgjUpJPstY5DK+vXWF78r5HGX5GX1PcXTXMGOqC2DF1fVZyAh0BF+RT1x4VaB6k+BEnRnCwpgkO6+5c2xafZr1z+LZrXO4WS2zkVx8202rXFccQovCp6ylp9NiBhwteRQ==',key_name='tempest-keypair-2102280864',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:20:02Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18d5cb6ddda14738b70c2460eb02dc4c',ramdisk_id='',reservation_id='r-19pxnn52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-425599745',owner_user_name='tempest-TestVolumeBootPatternV346-425599745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='117f5a19409d45e9be5e969913c67263',uuid=20b5dfd0-1a53-4169-99be-7859b4ccfa21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:23:05.634610 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converting VIF {"id": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "address": "fa:16:3e:ab:4a:84", "network": {"id": "fcea772a-5d0b-4ba8-bce3-97719a8fb224", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1458089366-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "18d5cb6ddda14738b70c2460eb02dc4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20f15c5-49", "ovs_interfaceid": "a20f15c5-498b-4095-80a5-5e3bed89e7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:23:05.635282 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:84,bridge_name='br-int',has_traffic_filtering=True,id=a20f15c5-498b-4095-80a5-5e3bed89e7ae,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20f15c5-49') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:23:05.635532 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:84,bridge_name='br-int',has_traffic_filtering=True,id=a20f15c5-498b-4095-80a5-5e3bed89e7ae,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20f15c5-49') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:23:05.637166 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:05.637388 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa20f15c5-49, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:05.638426 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:05.640193 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:05.640755 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:05.640883 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5741ed99-02ad-4cf2-b5ed-a241b58bde1f) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:05.641832 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:05.642300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:05.642848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:05.644766 np0000001643 nova-compute[98269]: INFO os_vif [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:4a:84,bridge_name='br-int',has_traffic_filtering=True,id=a20f15c5-498b-4095-80a5-5e3bed89e7ae,network=Network(fcea772a-5d0b-4ba8-bce3-97719a8fb224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20f15c5-49')
May 28 14:23:05.646209 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:23:05.646571 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:23:05.646705 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:05.999526 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00034866400028477074 future=<Future at 0x71a77810a240 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:06.000345 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978170.9990466, 72383293-d922-490c-a7c2-11ed2b3e3e88 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:06.000625 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:06.000774 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] VM Stopped (Lifecycle Event)
May 28 14:23:06.001996 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.426773728999706 future=<Future at 0x71a75c124230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:06.002110 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=3.426646530999733 future=<Future at 0x71a75c124230 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:06.144201 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:23:06.185324 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:23:06.287176 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:06.406846 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-vif-unplugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:06.407401 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:06.407614 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:06.407736 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:06.407865 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] No waiting events found dispatching network-vif-unplugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:23:06.407979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-vif-unplugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:23:06.408765 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-vif-unplugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:06.411105 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updating instance_info_cache with network_info: [{"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:23:06.412002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] Acquiring lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:06.412217 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:06.412329 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:06.412468 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] No waiting events found dispatching network-vif-unplugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:23:06.412584 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-af4dee4a-8db0-4f22-9f1b-f3d931d76027 req-3e13e94b-2b56-4abf-b2a9-a32144dbf621 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-vif-unplugged-a20f15c5-498b-4095-80a5-5e3bed89e7ae for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:23:06.503334 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 72383293-d922-490c-a7c2-11ed2b3e3e88] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:06.913539 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:23:06.913786 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Instance network_info: |[{"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:23:06.984935 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:23:06.986095 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:23:06.986488 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Creating image(s)
May 28 14:23:06.986902 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:23:06.987013 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Ensure instance console log exists: /opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:23:06.987230 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:06.987374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:06.987534 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:06.987934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Start _get_guest_xml network_info=[{"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'ba5ae7a3-5fd3-4bf3-a24b-8bb5e6d3eded', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a7214001-d5cf-4579-9e4b-577392bc2cf9', 'attached_at': '', 'detached_at': '', 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'serial': '65e3082c-e702-49e2-89fe-709beaf49e42'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:23:06.990407 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:23:06.991384 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2054338988', uuid='a7214001-d5cf-4579-9e4b-577392bc2cf9'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978186.9910636) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:23:06.992421 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:23:06.992771 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:23:06.993664 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:23:06.993839 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:23:06.994657 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:23:06.994951 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:23:06.995072 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:23:06.995172 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:23:06.995280 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:23:06.995330 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:23:06.995429 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:23:06.995604 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:23:06.995720 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:23:06.995810 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:23:06.995905 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:23:06.996010 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:23:07.004782 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:23:07.005216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:23:07.005216 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:07.204252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found WWN 3300000002cd95d19 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:23:07.204596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:07.205256 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.558s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:07.205665 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04b04bd2-a23e-4158-9272-b4d04c93da61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:23:07.205854 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:23:07.206426 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000002cd95d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002cd95d19'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:23:07.206624 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cd95d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002cd95d19'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:23:07.228703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:07.228703 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:07.228703 np0000001643 nova-compute[98269]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:07.228703 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:07.228703 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:07.228925 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:07.228925 np0000001643 nova-compute[98269]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61 (non-flash)
May 28 14:23:07.228925 np0000001643 nova-compute[98269]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:07.228925 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:07.228925 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:07.229087 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '206')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:23:07.229260 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '184')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:23:07.230369 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61', '183')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:23:07.231347 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c764040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:23:07.231627 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Removing multipathed devices sdf, sdg {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:23:07.231926 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Flush multipath device 330000000bb663941 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:23:07.237761 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c', 'attached_at': '2026-05-28T14:23:03.000000', 'detached_at': '', 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'serial': '2dde8977-3910-4623-b762-d53bfec25ee3'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:23:07.238498 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:23:07.238732 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:23:07.238914 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:23:07.253016 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:23:07.253016 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:23:07.253016 np0000001643 nova-compute[98269]:     <volume>2dde8977-3910-4623-b762-d53bfec25ee3</volume>
May 28 14:23:07.253016 np0000001643 nova-compute[98269]:   </usage>
May 28 14:23:07.253016 np0000001643 nova-compute[98269]: </secret>
May 28 14:23:07.253016 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:23:07.288872 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:23:07.336263 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:23:07.385853 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:23:07.386099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:23:07.386831 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:23:07.402404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:23:07.402404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:23:07.414134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.445777 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.40.100,3260]
May 28 14:23:07.445777 np0000001643 nova-compute[98269]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.40.100,3260] successful.
May 28 14:23:07.445777 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.461706 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.473852 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.508429 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.50.100,3260]
May 28 14:23:07.508429 np0000001643 nova-compute[98269]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-04b04bd2-a23e-4158-9272-b4d04c93da61, portal: 192.168.50.100,3260] successful.
May 28 14:23:07.508429 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.521854 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.522007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:07.522194 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] <== disconnect_volume: return (1875ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:23:07.522441 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:23:07.523020 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Deleting instance files /opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21_del
May 28 14:23:07.523631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.518s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:07.523631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:23:07.524185 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Deletion of /opt/stack/data/nova/instances/20b5dfd0-1a53-4169-99be-7859b4ccfa21_del complete
May 28 14:23:07.536115 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:07.536756 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:07.537398 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:07.537924 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:07.538196 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:23:07.538460 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:23:07.550220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:23:07.550220 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.555329 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:23:07.555329 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.564334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42] added
May 28 14:23:07.564334 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:23:07.564334 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:07.564334 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:07.564334 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:07.564334 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:07.564334 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.564535 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:23:07.564660 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:23:07.564806 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:23:07.566245 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42] added
May 28 14:23:07.566245 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:23:07.566245 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:07.566245 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:07.566245 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:23:07.566245 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:23:07.566245 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:07.566517 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:23:07.566678 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:23:07.566831 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:23:07.765040 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:22:49Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:23:07.765327 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:23:07.765737 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:23:07.767252 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] End _get_guest_xml xml=<domain type="qemu">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <uuid>271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</uuid>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <name>instance-0000004a</name>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1738752461</nova:name>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:23:03</nova:creationTime>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:user uuid="039853f7e499423384aa13ada9b39d22">tempest-TestEncryptedCinderVolumes-1171403786-project-member</nova:user>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:project uuid="50ea6d8cf0d14c40ad9163f647b3d065">tempest-TestEncryptedCinderVolumes-1171403786</nova:project>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <nova:port uuid="6ca52656-0417-4c07-901f-b10823a33b3a">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <system>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <entry name="serial">271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</entry>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <entry name="uuid">271dc0f9-a1e8-43c8-b2c1-db22f93ac69c</entry>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </system>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <os>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   </os>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <features>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   </features>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   <devices>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </disk>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk.config"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </disk>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <alias name="ua-2dde8977-3910-4623-b762-d53bfec25ee3"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <serial>2dde8977-3910-4623-b762-d53bfec25ee3</serial>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <encryption format="luks">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:         <secret type="passphrase" uuid="111549fe-50eb-44eb-a476-d968b8861bfe"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       </encryption>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </disk>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:9f:fe:f6"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <target dev="tap6ca52656-04"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </interface>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/console.log" append="off"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </serial>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <video>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </video>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </rng>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:   </devices>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]: </domain>
May 28 14:23:07.767252 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Preparing to wait for external event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:22:49Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001643',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:07.770948 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:23:07.771682 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:07.772181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0ca7d7e-0dea-58bb-904f-1584a02e4500', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:07.773221 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:07.774616 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:07.774616 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:07.776721 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:07.776976 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ca52656-04, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:07.777336 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ca52656-04, col_values=(('qos', UUID('49477f4d-fd33-4f85-9800-796686069ce5')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:07.777520 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ca52656-04, col_values=(('external_ids', {'iface-id': '6ca52656-0417-4c07-901f-b10823a33b3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:fe:f6', 'vm-uuid': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:07.778653 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:07.780059 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:07.785299 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:07.786294 np0000001643 nova-compute[98269]: INFO os_vif [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04')
May 28 14:23:08.032341 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Took 3.23 seconds to destroy the instance on the hypervisor.
May 28 14:23:08.032850 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:23:08.033019 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:23:08.033126 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:23:08.033682 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:08.096730 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:08.187530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.208371 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.209322 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.297278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.301868 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.371198 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-efbbec91-278d-4141-97d9-9b2b2514b4fe req-32a512ae-9184-456b-916a-733610960b71 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:08.371821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efbbec91-278d-4141-97d9-9b2b2514b4fe req-32a512ae-9184-456b-916a-733610960b71 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:08.372139 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efbbec91-278d-4141-97d9-9b2b2514b4fe req-32a512ae-9184-456b-916a-733610960b71 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:08.372292 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-efbbec91-278d-4141-97d9-9b2b2514b4fe req-32a512ae-9184-456b-916a-733610960b71 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:08.372439 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-efbbec91-278d-4141-97d9-9b2b2514b4fe req-32a512ae-9184-456b-916a-733610960b71 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Processing event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:23:08.520353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2fac45dc-af64-4c8f-9084-450a777b4a72 req-4ff76a85-7f5b-4c29-9429-0f260bacc1c6 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Received event network-vif-deleted-a20f15c5-498b-4095-80a5-5e3bed89e7ae {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:08.520353 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-2fac45dc-af64-4c8f-9084-450a777b4a72 req-4ff76a85-7f5b-4c29-9429-0f260bacc1c6 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Neutron deleted interface a20f15c5-498b-4095-80a5-5e3bed89e7ae; detaching it from the instance and deleting it from the info cache
May 28 14:23:08.520353 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2fac45dc-af64-4c8f-9084-450a777b4a72 req-4ff76a85-7f5b-4c29-9429-0f260bacc1c6 service nova] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Detach interface failed, port_id=a20f15c5-498b-4095-80a5-5e3bed89e7ae, reason: Instance 20b5dfd0-1a53-4169-99be-7859b4ccfa21 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:23:08.526098 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.529648 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.532997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.551119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:08.565247 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:23:08.567198 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:23:08.578983 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:23:08.578983 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:23:08.589154 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:23:08.589154 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.596935 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.613631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.622794 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.622794 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.622794 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:08.622943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.622943 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.622943 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:08.629813 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.629813 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.629813 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:08.629941 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.629941 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.629941 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:08.650365 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260]
May 28 14:23:08.650365 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260] successful.
May 28 14:23:08.650365 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.662001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.667832 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260]
May 28 14:23:08.667832 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260] successful.
May 28 14:23:08.667832 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.675723 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.675723 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.675723 np0000001643 nova-compute[98269]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.675723 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.675723 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:08.675933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.675933 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.675933 np0000001643 nova-compute[98269]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.675933 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.675933 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:08.676072 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:08.676178 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:23:08.676760 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('9', '-', '-', 0) found on session 207 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:23:08.676861 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:23:08.680959 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:08.694759 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 207 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:23:08.695944 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:23:08.700287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.700287 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.700287 np0000001643 nova-compute[98269]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.700287 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.700287 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:08.700440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.700440 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:08.700440 np0000001643 nova-compute[98269]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.700440 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:08.700440 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:08.700752 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:08.700884 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:23:08.701817 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('10', '-', '-', 0) found on session 208 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:23:08.701817 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:23:08.718203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 208 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:23:08.718203 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:23:08.967344 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:23:09.429199 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00035758300009547384 future=<Future at 0x71a75c124230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:09.429998 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978174.4286807, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:09.430255 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Stopped (Lifecycle Event)
May 28 14:23:09.430791 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:09.431436 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.068681351000123 future=<Future at 0x71a75c32ad80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:09.431436 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=1.0685601230002248 future=<Future at 0x71a75c32ad80 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:09.471582 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Took 1.44 seconds to deallocate network for instance.
May 28 14:23:09.538742 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:23:09.833794 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Removed pending STOPPED event for 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c due to new event <LifecycleEvent: 1779978189.833287, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Started> {{(pid=98269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 14:23:09.834222 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:23:09.834414 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978189.833287, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:09.834609 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Started (Lifecycle Event)
May 28 14:23:09.840081 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance running successfully.
May 28 14:23:09.840590 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] finish_revert_migration finished successfully. {{(pid=98269) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 14:23:09.933309 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7ce318e1-8510-4e93-87f4-a8b67a7b4eac tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:10.019795 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:10.021998 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:23:10.337345 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:10.339390 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:23:10.428110 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65f418b8-c009-4c2a-acc8-3c613c43fbe0 req-db551330-5023-4fa6-9c62-66004954e46c service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:10.428348 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65f418b8-c009-4c2a-acc8-3c613c43fbe0 req-db551330-5023-4fa6-9c62-66004954e46c service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:10.428586 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65f418b8-c009-4c2a-acc8-3c613c43fbe0 req-db551330-5023-4fa6-9c62-66004954e46c service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:10.428786 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-65f418b8-c009-4c2a-acc8-3c613c43fbe0 req-db551330-5023-4fa6-9c62-66004954e46c service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:10.428949 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-65f418b8-c009-4c2a-acc8-3c613c43fbe0 req-db551330-5023-4fa6-9c62-66004954e46c service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:23:10.429118 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-65f418b8-c009-4c2a-acc8-3c613c43fbe0 req-db551330-5023-4fa6-9c62-66004954e46c service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received unexpected event network-vif-plugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with vm_state resized and task_state resize_reverting.
May 28 14:23:10.500376 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003337640000609099 future=<Future at 0x71a75c32ad80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:10.500944 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Emitting event <LifecycleEvent: 1779978175.4999273, 99929164-66e4-49d4-9241-c61f6e2cc985 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:10.500993 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:10.501159 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] VM Stopped (Lifecycle Event)
May 28 14:23:10.502427 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.623620619000121 future=<Future at 0x71a75c328740 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:10.502667 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.623308982999788 future=<Future at 0x71a75c328740 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:10.529389 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:10.529845 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:10.558673 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 33000000089d82104 for multipath device dm-1 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:23:10.559111 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:10.559286 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (3554ms) {'type': 'block', 'scsi_wwn': '33000000089d82104', 'path': '/dev/dm-1', 'multipath_id': '33000000089d82104'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:23:10.559396 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000089d82104', 'path': '/dev/dm-1', 'multipath_id': '33000000089d82104'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:23:10.701322 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:23:10.701535 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:23:10.842114 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 14:23:10.842396 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978190.8421836, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:10.842562 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Paused (Lifecycle Event)
May 28 14:23:10.887432 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-bea09078-be64-4136-b930-2206476ae000 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance to original state: 'active'
May 28 14:23:11.004375 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a58ab72c-b19f-4524-b3ff-953fdba7e4c7 tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 99929164-66e4-49d4-9241-c61f6e2cc985] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:11.064934 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2054338988',display_name='tempest-TestVolumeBootPattern-server-2054338988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2054338988',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-mua7yu1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:23:04Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=a7214001-d5cf-4579-9e4b-577392bc2cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:23:11.065223 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:23:11.065691 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:00,bridge_name='br-int',has_traffic_filtering=True,id=86b56357-8606-4fdf-bd31-9570ea3aa841,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b56357-86') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:23:11.066223 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid a7214001-d5cf-4579-9e4b-577392bc2cf9 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:23:11.203989 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:23:11.345562 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:11.347919 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978191.3476334, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:11.348094 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Resumed (Lifecycle Event)
May 28 14:23:11.568706 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] End _get_guest_xml xml=<domain type="qemu">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <uuid>a7214001-d5cf-4579-9e4b-577392bc2cf9</uuid>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <name>instance-0000004d</name>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-2054338988</nova:name>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:23:06</nova:creationTime>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         <nova:port uuid="86b56357-8606-4fdf-bd31-9570ea3aa841">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <system>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <entry name="serial">a7214001-d5cf-4579-9e4b-577392bc2cf9</entry>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <entry name="uuid">a7214001-d5cf-4579-9e4b-577392bc2cf9</entry>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </system>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <os>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   </os>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <features>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   </features>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   <devices>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9/disk.config"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </disk>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <alias name="ua-65e3082c-e702-49e2-89fe-709beaf49e42"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-1"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <serial>65e3082c-e702-49e2-89fe-709beaf49e42</serial>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </disk>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:b6:35:00"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <target dev="tap86b56357-86"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </interface>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9/console.log" append="off"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </serial>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <video>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </video>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </rng>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:   </devices>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]: </domain>
May 28 14:23:11.568706 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:23:11.570995 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Preparing to wait for external event network-vif-plugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:23:11.570995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:11.570995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:11.570995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:11.570995 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2054338988',display_name='tempest-TestVolumeBootPattern-server-2054338988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2054338988',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-mua7yu1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:23:04Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=a7214001-d5cf-4579-9e4b-577392bc2cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:23:11.570995 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:23:11.570995 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:00,bridge_name='br-int',has_traffic_filtering=True,id=86b56357-8606-4fdf-bd31-9570ea3aa841,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b56357-86') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:23:11.571259 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:00,bridge_name='br-int',has_traffic_filtering=True,id=86b56357-8606-4fdf-bd31-9570ea3aa841,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b56357-86') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:23:11.571433 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:11.572290 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:11.573026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:23:11.577263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:11.577263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9579854c-a64b-5fd0-a793-c5dc21a6b0c9', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:11.578131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:11.579995 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:11.583953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:11.583953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86b56357-86, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:11.583953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86b56357-86, col_values=(('qos', UUID('f2cd5ac1-f529-4917-b939-0f5f87b68af2')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:11.583953 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86b56357-86, col_values=(('external_ids', {'iface-id': '86b56357-8606-4fdf-bd31-9570ea3aa841', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:35:00', 'vm-uuid': 'a7214001-d5cf-4579-9e4b-577392bc2cf9'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:11.584298 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:11.585706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:11.591258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:11.592694 np0000001643 nova-compute[98269]: INFO os_vif [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:00,bridge_name='br-int',has_traffic_filtering=True,id=86b56357-8606-4fdf-bd31-9570ea3aa841,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b56357-86')
May 28 14:23:11.710193 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.180s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:11.754546 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Deleted allocations for instance 20b5dfd0-1a53-4169-99be-7859b4ccfa21
May 28 14:23:11.850911 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:11.852891 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:23:12.078044 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:12.078274 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:12.580753 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Detaching volume 2dde8977-3910-4623-b762-d53bfec25ee3
May 28 14:23:12.619172 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Attempting to driver detach volume 2dde8977-3910-4623-b762-d53bfec25ee3 from mountpoint /dev/vdb
May 28 14:23:12.647780 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '271dc0f9-a1e8-43c8-b2c1-db22f93ac69c', 'attached_at': '2026-05-28T14:23:03.000000', 'detached_at': '', 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'serial': '2dde8977-3910-4623-b762-d53bfec25ee3'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:23:12.650845 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:23:12.651894 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:23:12.652001 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Attempting to detach device vdb from instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:23:12.652204 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   <alias name="ua-2dde8977-3910-4623-b762-d53bfec25ee3"/>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   <serial>2dde8977-3910-4623-b762-d53bfec25ee3</serial>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="111549fe-50eb-44eb-a476-d968b8861bfe"/>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]: </disk>
May 28 14:23:12.652204 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:23:12.658648 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c from the persistent domain config.
May 28 14:23:12.658844 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] (1/8): Attempting to detach device vdb with device alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 from instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:23:12.659164 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   <alias name="ua-2dde8977-3910-4623-b762-d53bfec25ee3"/>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   <serial>2dde8977-3910-4623-b762-d53bfec25ee3</serial>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="111549fe-50eb-44eb-a476-d968b8861bfe"/>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]: </disk>
May 28 14:23:12.659164 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:23:12.762821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-33510937-f5b9-4921-a8a3-f20b8ff5d102 tempest-TestVolumeBootPatternV346-425599745 tempest-TestVolumeBootPatternV346-425599745-project-member] Lock "20b5dfd0-1a53-4169-99be-7859b4ccfa21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.466s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:13.110800 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:23:13.110932 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:23:13.111064 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:b6:35:00, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:23:13.111588 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Using config drive
May 28 14:23:13.619694 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:13.746730 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Creating config drive at /opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9/disk.config
May 28 14:23:13.750122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpobhc_ab7 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:23:13.802869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpobhc_ab7" returned: 0 in 0.052s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:23:14.190278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:14.219295 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:14.219295 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:14.321336 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:14.420510 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d94a56d6-face-4d61-bd16-d67094bf3572 req-26255f9e-0b06-4e16-9fee-73cd5bf8518a service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-vif-plugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:14.423018 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d94a56d6-face-4d61-bd16-d67094bf3572 req-26255f9e-0b06-4e16-9fee-73cd5bf8518a service nova] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:14.423528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d94a56d6-face-4d61-bd16-d67094bf3572 req-26255f9e-0b06-4e16-9fee-73cd5bf8518a service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:14.424454 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d94a56d6-face-4d61-bd16-d67094bf3572 req-26255f9e-0b06-4e16-9fee-73cd5bf8518a service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:14.424673 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d94a56d6-face-4d61-bd16-d67094bf3572 req-26255f9e-0b06-4e16-9fee-73cd5bf8518a service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Processing event network-vif-plugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:23:14.572323 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:14.573874 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:14.575813 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:14.595160 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:15.005244 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:23:15.005735 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978195.005286, a7214001-d5cf-4579-9e4b-577392bc2cf9 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:15.005910 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] VM Started (Lifecycle Event)
May 28 14:23:15.017472 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:23:15.017472 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Instance spawned successfully.
May 28 14:23:15.017472 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:23:15.021718 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:15.508971 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:15.511432 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:23:15.526008 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:23:15.526261 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:23:15.526457 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:23:15.526698 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:23:15.526936 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:23:15.527169 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:23:16.014099 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:23:16.014458 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978196.0142236, a7214001-d5cf-4579-9e4b-577392bc2cf9 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:16.014605 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] VM Paused (Lifecycle Event)
May 28 14:23:16.040835 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Took 9.06 seconds to spawn the instance on the hypervisor.
May 28 14:23:16.041027 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:16.118845 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:16.477892 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d767de06-d1ab-4fb0-a0fc-40f2191af0a5 req-9d748027-1497-431f-9bb0-b598222aae41 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-vif-plugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:16.478072 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d767de06-d1ab-4fb0-a0fc-40f2191af0a5 req-9d748027-1497-431f-9bb0-b598222aae41 service nova] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:16.478237 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d767de06-d1ab-4fb0-a0fc-40f2191af0a5 req-9d748027-1497-431f-9bb0-b598222aae41 service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:16.478473 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d767de06-d1ab-4fb0-a0fc-40f2191af0a5 req-9d748027-1497-431f-9bb0-b598222aae41 service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:16.478871 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d767de06-d1ab-4fb0-a0fc-40f2191af0a5 req-9d748027-1497-431f-9bb0-b598222aae41 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] No waiting events found dispatching network-vif-plugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:23:16.478994 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-d767de06-d1ab-4fb0-a0fc-40f2191af0a5 req-9d748027-1497-431f-9bb0-b598222aae41 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received unexpected event network-vif-plugged-86b56357-8606-4fdf-bd31-9570ea3aa841 for instance with vm_state active and task_state None.
May 28 14:23:16.517006 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:16.520351 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978196.520118, a7214001-d5cf-4579-9e4b-577392bc2cf9 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:16.520772 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] VM Resumed (Lifecycle Event)
May 28 14:23:16.567275 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Took 16.76 seconds to build instance.
May 28 14:23:16.584688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:17.023233 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:17.025732 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:23:17.068782 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-50279420-8b36-4f83-bc12-52ca87a6512f tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.265s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:17.662980 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 for instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:23:17.821063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:18.556169 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-changed-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:18.556744 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Refreshing instance network info cache due to event network-changed-86b56357-8606-4fdf-bd31-9570ea3aa841. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:23:18.556880 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] Acquiring lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:23:18.557005 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] Acquired lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:23:18.557199 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Refreshing network info cache for port 86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:23:19.061461 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:19.374564 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:19.525227 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updated VIF entry in instance network info cache for port 86b56357-8606-4fdf-bd31-9570ea3aa841. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:23:19.525670 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updating instance_info_cache with network_info: [{"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:23:20.022579 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:20.027596 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4363fde6-df80-41c6-92e9-d1b99f989e61 req-3d2df6b9-6f7a-4185-9a96-2124c37d0130 service nova] Releasing lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:23:20.126394 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00037209099991741823 future=<Future at 0x71a75c328740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:20.126810 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978185.125902, 20b5dfd0-1a53-4169-99be-7859b4ccfa21 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:20.126986 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:20.127142 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] VM Stopped (Lifecycle Event)
May 28 14:23:20.630995 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 20b5dfd0-1a53-4169-99be-7859b4ccfa21] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:21.542072 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:21.585435 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:23.745128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:25.023700 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:26.588641 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:30.024530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:31.591375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:35.028083 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:36.594135 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:37.663604 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Waiting for libvirt event about the detach of device vdb with device alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 from instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c is timed out.
May 28 14:23:37.665963 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Found disk vdb by alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:23:37.666096 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Failed to detach device vdb with device alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 from instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c from the live domain config. Libvirt did not report any error but the device is still in the config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2694}}
May 28 14:23:37.666233 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] (2/8): Attempting to detach device vdb with device alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 from instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:23:37.666556 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   <alias name="ua-2dde8977-3910-4623-b762-d53bfec25ee3"/>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   <serial>2dde8977-3910-4623-b762-d53bfec25ee3</serial>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="111549fe-50eb-44eb-a476-d968b8861bfe"/>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]: </disk>
May 28 14:23:37.666556 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:23:37.827074 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:37.827422 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:37.827626 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:23:37.827792 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:38.173754 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779978218.1733344, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => ua-2dde8977-3910-4623-b762-d53bfec25ee3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:23:38.176519 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2dde8977-3910-4623-b762-d53bfec25ee3 for instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:23:38.179313 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully detached device vdb from instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c from the live domain config.
May 28 14:23:38.181739 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:23:38.182232 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:23:38.182420 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:23:38.182868 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:23:38.183282 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dde8977-3910-4623-b762-d53bfec25ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:23:38.183476 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:23:38.215257 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:38.215257 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:38.215257 np0000001643 nova-compute[98269]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:38.215257 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:38.215257 np0000001643 nova-compute[98269]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748f8f3a-2775-4330-900c-bad97e6226aa (non-flash)
May 28 14:23:38.215257 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:23:38.215602 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:38.215602 np0000001643 nova-compute[98269]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3 (non-flash)
May 28 14:23:38.215602 np0000001643 nova-compute[98269]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:38.215602 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:23:38.215602 np0000001643 nova-compute[98269]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748f8f3a-2775-4330-900c-bad97e6226aa (non-flash)
May 28 14:23:38.215602 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:23:38.215602 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-748f8f3a-2775-4330-900c-bad97e6226aa', '209')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:23:38.215896 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '205')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:23:38.216785 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3', '206')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:23:38.217745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801cf9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:23:38.217968 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:23:38.218251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Flush multipath device 3300000002cd95d19 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:23:38.258811 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:23:38.305943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:23:38.334176 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:38.334410 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:38.334594 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:38.334760 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:23:38.350745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:23:38.350886 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:23:38.351878 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:23:38.362913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:23:38.363092 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:23:38.375099 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:38.407432 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260]
May 28 14:23:38.407432 np0000001643 nova-compute[98269]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.40.100,3260] successful.
May 28 14:23:38.407432 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:38.420086 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:38.430685 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:38.462250 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260]
May 28 14:23:38.462250 np0000001643 nova-compute[98269]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-2dde8977-3910-4623-b762-d53bfec25ee3, portal: 192.168.50.100,3260] successful.
May 28 14:23:38.462250 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:38.477304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:23:38.478246 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:23:38.478407 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] <== disconnect_volume: return (295ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:23:38.478573 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:23:39.029345 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'flavor' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:23:39.354229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:23:39.445714 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:23:39.446402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:23:39.555905 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:23:39.560783 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:23:39.562604 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:23:39.563676 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:23:39.613358 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:23:39.614090 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=13148MB free_disk=72.65111541748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:23:39.614306 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:39.614758 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:40.028279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:40.038040 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-4bb37b94-1a5c-457e-89ea-51b855ba323c tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.960s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:40.206109 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:40.206298 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:40.206481 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:40.206619 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:40.206722 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:40.208813 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Terminating instance
May 28 14:23:40.667829 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:23:40.667943 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance a7214001-d5cf-4579-9e4b-577392bc2cf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:23:40.668088 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:23:40.668211 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:23:39 up 50 min,  2 users,  load average: 2.62, 3.99, 4.24\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_50ea6d8cf0d14c40ad9163f647b3d065': '1', 'io_workload': '0', 'num_proj_6a701352f7484e2d810439622b1c8bda': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:23:40.711579 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:23:40.728335 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:40.732131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:40.744851 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:40.746998 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:40.766226 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:40.806703 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:23:40.806918 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:23:40.854434 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-01da31b9-e45c-4e53-b44d-50f45c1735b0 req-001677b0-9b64-4005-a4f5-274c0f3a8d94 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:40.855233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-01da31b9-e45c-4e53-b44d-50f45c1735b0 req-001677b0-9b64-4005-a4f5-274c0f3a8d94 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:40.855233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-01da31b9-e45c-4e53-b44d-50f45c1735b0 req-001677b0-9b64-4005-a4f5-274c0f3a8d94 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:40.855233 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-01da31b9-e45c-4e53-b44d-50f45c1735b0 req-001677b0-9b64-4005-a4f5-274c0f3a8d94 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:40.855233 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-01da31b9-e45c-4e53-b44d-50f45c1735b0 req-001677b0-9b64-4005-a4f5-274c0f3a8d94 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:23:40.855233 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-01da31b9-e45c-4e53-b44d-50f45c1735b0 req-001677b0-9b64-4005-a4f5-274c0f3a8d94 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:23:40.925702 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:41.039206 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999696379999932 future=<Future at 0x71a75c10bcb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:41.039704 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999377721999736 future=<Future at 0x71a75c10bcb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:41.039704 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999231839000004 future=<Future at 0x71a75c10bcb0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:41.041564 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Instance destroyed successfully.
May 28 14:23:41.042804 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lazy-loading 'resources' on Instance uuid 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:23:41.309315 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:23:41.545408 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1738752461',display_name='tempest-TestEncryptedCinderVolumes-server-1738752461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1738752461',id=74,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpy/Ts2c0Wr5YWm0B6gnCjfwtRi+wrKOR7FR+Q/Tzr5bWegMseI0rU2vgz83osL9hAatS65gxKV8ySo24iI68GzgqBiNXWjgZu8Xify6+zgQnennzy+ONesP16X/cyzww==',key_name='tempest-keypair-2139398892',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:23:10Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50ea6d8cf0d14c40ad9163f647b3d065',ramdisk_id='',reservation_id='r-nt9aei01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1171403786',owner_user_name='tempest-TestEncryptedCinderVolumes-1171403786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:23:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='039853f7e499423384aa13ada9b39d22',uuid=271dc0f9-a1e8-43c8-b2c1-db22f93ac69c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:23:41.545408 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converting VIF {"id": "6ca52656-0417-4c07-901f-b10823a33b3a", "address": "fa:16:3e:9f:fe:f6", "network": {"id": "dd2155d8-f73e-48a2-8788-d350d4da283a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1916386032-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50ea6d8cf0d14c40ad9163f647b3d065", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca52656-04", "ovs_interfaceid": "6ca52656-0417-4c07-901f-b10823a33b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:23:41.545408 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:23:41.545791 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:23:41.547013 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:41.547327 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ca52656-04, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:41.548426 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:41.549206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:41.549662 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:41.550389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:41.550389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49477f4d-fd33-4f85-9800-796686069ce5) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:23:41.551001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:41.551001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:23:41.551321 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:41.552866 np0000001643 nova-compute[98269]: INFO os_vif [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fe:f6,bridge_name='br-int',has_traffic_filtering=True,id=6ca52656-0417-4c07-901f-b10823a33b3a,network=Network(dd2155d8-f73e-48a2-8788-d350d4da283a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca52656-04')
May 28 14:23:41.553146 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Deleting instance files /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_del
May 28 14:23:41.557084 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Deletion of /opt/stack/data/nova/instances/271dc0f9-a1e8-43c8-b2c1-db22f93ac69c_del complete
May 28 14:23:41.815396 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:23:41.815546 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.201s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:41.815885 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:41.816031 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:23:42.062612 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 14:23:42.063145 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:23:42.063547 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:23:42.063729 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:23:42.063990 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:42.152941 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:23:42.317821 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:42.506900 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-838c68e0-fa5a-4837-b2f3-84aadef2b889 req-ec0e79f0-e679-4df0-b9d4-23ec3435670a service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-deleted-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:42.507022 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-838c68e0-fa5a-4837-b2f3-84aadef2b889 req-ec0e79f0-e679-4df0-b9d4-23ec3435670a service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Neutron deleted interface 6ca52656-0417-4c07-901f-b10823a33b3a; detaching it from the instance and deleting it from the info cache
May 28 14:23:42.508706 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-838c68e0-fa5a-4837-b2f3-84aadef2b889 req-ec0e79f0-e679-4df0-b9d4-23ec3435670a service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Detach interface failed, port_id=6ca52656-0417-4c07-901f-b10823a33b3a, reason: Instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:23:42.819537 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:23:42.911751 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-311d683c-b0c9-4900-9e6c-c88359b67cbe req-58dd706b-bcdb-43dd-b72a-08bbda6c31f0 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:23:42.912085 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-311d683c-b0c9-4900-9e6c-c88359b67cbe req-58dd706b-bcdb-43dd-b72a-08bbda6c31f0 service nova] Acquiring lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:42.912259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-311d683c-b0c9-4900-9e6c-c88359b67cbe req-58dd706b-bcdb-43dd-b72a-08bbda6c31f0 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:42.912355 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-311d683c-b0c9-4900-9e6c-c88359b67cbe req-58dd706b-bcdb-43dd-b72a-08bbda6c31f0 service nova] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:42.912491 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-311d683c-b0c9-4900-9e6c-c88359b67cbe req-58dd706b-bcdb-43dd-b72a-08bbda6c31f0 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] No waiting events found dispatching network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:23:42.912591 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-311d683c-b0c9-4900-9e6c-c88359b67cbe req-58dd706b-bcdb-43dd-b72a-08bbda6c31f0 service nova] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Received event network-vif-unplugged-6ca52656-0417-4c07-901f-b10823a33b3a for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:23:42.964764 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:23:43.466809 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Took 1.40 seconds to deallocate network for instance.
May 28 14:23:43.818942 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:43.819200 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:43.819424 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:43.819665 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:23:43.971684 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:43.971838 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:44.092471 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:23:44.092724 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:23:44.595360 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:23:44.826990 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:44.827268 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:44.827373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:23:45.029050 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:45.101992 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.130s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:45.146458 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Deleted allocations for instance 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c
May 28 14:23:45.329373 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:23:45.329640 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:23:46.154703 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-ab1286f9-24d1-4249-9f1a-d63874ce388e tempest-TestEncryptedCinderVolumes-1171403786 tempest-TestEncryptedCinderVolumes-1171403786-project-member] Lock "271dc0f9-a1e8-43c8-b2c1-db22f93ac69c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.948s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:23:46.551532 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:48.325663 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:23:48.326561 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:23:49.625312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:50.039723 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:51.358739 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:51.552301 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:55.038540 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:56.039222 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.000329165000039211 future=<Future at 0x71a75c10bcb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:56.039716 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978221.038778, 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:23:56.039802 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:23:56.039867 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] VM Stopped (Lifecycle Event)
May 28 14:23:56.542206 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c8fefc78-8fc6-4a5f-afca-680fd64db9e5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 271dc0f9-a1e8-43c8-b2c1-db22f93ac69c] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:23:56.554324 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:23:58.748601 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:58.748950 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:59.250261 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:23:59.943396 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:23:59.943827 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:23:59.947966 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:23:59.947966 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Claim successful on node np0000001643
May 28 14:24:00.040003 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:00.990823 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:24:01.028060 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:24:01.028265 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:24:01.064199 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:24:01.107637 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:24:01.224727 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:24:01.224908 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:24:01.556172 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:01.727619 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:24:02.233682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.290s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:02.234112 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:24:02.739111 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:24:02.739298 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:24:02.739558 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:02.739736 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:02.814774 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d205ac18dd14beea4c09d9637f969e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a701352f7484e2d810439622b1c8bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:24:03.242061 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:24:03.322043 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Successfully created port: d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:24:03.745323 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:24:03.822939 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Successfully updated port: d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:24:03.864847 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-changed-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:03.864970 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Refreshing instance network info cache due to event network-changed-d9cc0e84-9828-4f71-b80c-a60a77a582aa. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:24:03.865108 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] Acquiring lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:24:03.865201 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] Acquired lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:24:03.865514 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Refreshing network info cache for port d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:24:04.249000 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Booting with volume 5e8646e4-fe1c-43e5-9a97-4803c3110b09 at /dev/vda
May 28 14:24:04.291430 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:24:04.303003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:24:04.323053 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:04.342138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:24:04.367322 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:04.370323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:24:04.370666 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:24:04.379340 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:24:04.380140 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:feb6:3500', 'fe80::8097:21ff:fe89:3b01'] 
May 28 14:24:04.380265 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:24:04.380428 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:24:04.380721 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:24:04.380946 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updating existing volume attachment record: 219e739f-eafb-40b7-904a-890c48733437 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:24:04.435360 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:24:04.604199 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:05.106310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-645576f5-96da-42fa-a6b0-89b25b698e16 req-f21d6484-a930-4128-a23a-9f6d1876c02b service nova] Releasing lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:24:05.106936 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquired lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:24:05.107177 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:24:05.678953 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:24:05.845356 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:05.972373 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updating instance_info_cache with network_info: [{"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:06.477936 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Releasing lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:24:06.479220 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:24:06.480725 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Instance network_info: |[{"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:24:06.481039 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:24:06.481347 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Creating image(s)
May 28 14:24:06.481860 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:24:06.482031 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Ensure instance console log exists: /opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:24:06.482330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:06.482577 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:06.482759 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:06.483312 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Start _get_guest_xml network_info=[{"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '219e739f-eafb-40b7-904a-890c48733437', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd411f846-f07f-4824-94d7-96cc11105ac1', 'attached_at': '', 'detached_at': '', 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'serial': '5e8646e4-fe1c-43e5-9a97-4803c3110b09'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:24:06.488140 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:24:06.489532 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1826298325', uuid='d411f846-f07f-4824-94d7-96cc11105ac1'), owner=OwnerMeta(userid='3d205ac18dd14beea4c09d9637f969e8', username='tempest-TestVolumeBootPattern-1916664954-project-member', projectid='6a701352f7484e2d810439622b1c8bda', projectname='tempest-TestVolumeBootPattern-1916664954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978246.4891057) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:24:06.490737 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:24:06.491132 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:24:06.492216 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:24:06.492444 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:24:06.493815 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:24:06.494173 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:24:06.494373 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:24:06.494612 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:24:06.494789 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:24:06.494914 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:24:06.495052 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:24:06.495263 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:24:06.495410 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:24:06.495597 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:24:06.495746 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:24:06.495930 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:24:06.512103 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:24:06.512576 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:24:06.512775 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:24:06.513217 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:24:06.513518 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:24:06.525252 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:24:06.525908 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:24:06.526495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:24:06.526709 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:24:06.527098 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:24:06.527266 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:24:06.536188 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:24:06.536188 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:06.542210 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:24:06.542210 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:06.549603 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09] added
May 28 14:24:06.549603 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:24:06.549603 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:24:06.549603 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:24:06.549603 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:24:06.549603 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:24:06.549603 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:06.549875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:24:06.549958 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:24:06.550107 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:24:06.552732 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09] added
May 28 14:24:06.552732 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:24:06.552732 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:24:06.552732 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:24:06.552732 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:24:06.552732 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:24:06.552732 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:06.552905 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:24:06.553066 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:24:06.553240 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:24:06.557921 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:07.550638 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:24:07.553641 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:24:07.562658 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:24:07.562658 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:24:07.568184 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:24:07.568184 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.573612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.579206 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.586371 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.586371 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.586371 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.586371 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:24:07.586574 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.586574 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.586574 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.586574 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:24:07.591697 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.591697 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.591697 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.591697 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:24:07.591868 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.591868 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.591868 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.591868 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:24:07.617710 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.40.100,3260]
May 28 14:24:07.617710 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.40.100,3260] successful.
May 28 14:24:07.617710 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.628648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.629404 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.50.100,3260]
May 28 14:24:07.629404 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.50.100,3260] successful.
May 28 14:24:07.629404 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.642165 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.642165 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.642165 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.642165 np0000001643 nova-compute[98269]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.642165 np0000001643 nova-compute[98269]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.642165 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:24:07.642353 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.642353 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.642353 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.642353 np0000001643 nova-compute[98269]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.642353 np0000001643 nova-compute[98269]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.642353 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:24:07.642700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:24:07.642972 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:24:07.643432 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:07.644423 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('8', '-', '-', 0) found on session 212 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:24:07.644610 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:24:07.661239 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.661239 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.661239 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.661239 np0000001643 nova-compute[98269]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.661239 np0000001643 nova-compute[98269]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.661239 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:24:07.661368 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.661368 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:07.661368 np0000001643 nova-compute[98269]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17237104-b611-43a4-b802-9803c5ac3e10 (non-flash)
May 28 14:24:07.661368 np0000001643 nova-compute[98269]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.661368 np0000001643 nova-compute[98269]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:07.661368 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:24:07.661703 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:24:07.661829 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:24:07.662376 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 212 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:24:07.662642 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:24:07.663538 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] HCTL ('11', '-', '-', 0) found on session 213 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:24:07.663663 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:24:07.677401 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Searching for a device in session 213 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:24:07.677401 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:24:08.527100 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:24:09.541909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Found WWN 3300000002612d934 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:24:09.542259 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:24:09.542259 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000002612d934', 'path': '/dev/dm-0', 'multipath_id': '3300000002612d934'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:24:09.542351 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002612d934', 'path': '/dev/dm-0', 'multipath_id': '3300000002612d934'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:24:10.047503 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1826298325',display_name='tempest-TestVolumeBootPattern-server-1826298325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1826298325',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-99x9gaye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:24:04Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=d411f846-f07f-4824-94d7-96cc11105ac1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:24:10.047762 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:24:10.048401 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:97,bridge_name='br-int',has_traffic_filtering=True,id=d9cc0e84-9828-4f71-b80c-a60a77a582aa,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cc0e84-98') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:24:10.048975 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'pci_devices' on Instance uuid d411f846-f07f-4824-94d7-96cc11105ac1 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:24:10.553011 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] End _get_guest_xml xml=<domain type="qemu">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <uuid>d411f846-f07f-4824-94d7-96cc11105ac1</uuid>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <name>instance-0000004e</name>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestVolumeBootPattern-server-1826298325</nova:name>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:24:06</nova:creationTime>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:user uuid="3d205ac18dd14beea4c09d9637f969e8">tempest-TestVolumeBootPattern-1916664954-project-member</nova:user>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:project uuid="6a701352f7484e2d810439622b1c8bda">tempest-TestVolumeBootPattern-1916664954</nova:project>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         <nova:port uuid="d9cc0e84-9828-4f71-b80c-a60a77a582aa">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <system>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <entry name="serial">d411f846-f07f-4824-94d7-96cc11105ac1</entry>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <entry name="uuid">d411f846-f07f-4824-94d7-96cc11105ac1</entry>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </system>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <os>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   </os>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <features>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   </features>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   <devices>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1/disk.config"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </disk>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <alias name="ua-5e8646e4-fe1c-43e5-9a97-4803c3110b09"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <serial>5e8646e4-fe1c-43e5-9a97-4803c3110b09</serial>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </disk>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:bb:74:97"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <target dev="tapd9cc0e84-98"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </interface>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1/console.log" append="off"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </serial>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <video>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </video>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </rng>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:   </devices>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]: </domain>
May 28 14:24:10.553011 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Preparing to wait for external event network-vif-plugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1826298325',display_name='tempest-TestVolumeBootPattern-server-1826298325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1826298325',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-99x9gaye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:24:04Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=d411f846-f07f-4824-94d7-96cc11105ac1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:97,bridge_name='br-int',has_traffic_filtering=True,id=d9cc0e84-9828-4f71-b80c-a60a77a582aa,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cc0e84-98') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:97,bridge_name='br-int',has_traffic_filtering=True,id=d9cc0e84-9828-4f71-b80c-a60a77a582aa,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cc0e84-98') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:24:10.556322 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:10.556706 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:10.556761 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:24:10.557368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:10.557535 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87440858-0167-5294-ba00-ce4fefa0bc91', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:10.558314 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:10.559284 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:24:10.559497 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:10.561541 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:10.561708 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9cc0e84-98, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:10.562031 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9cc0e84-98, col_values=(('qos', UUID('610f5e44-5d71-46d2-814e-71ff9a2dc6d4')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:10.562223 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9cc0e84-98, col_values=(('external_ids', {'iface-id': 'd9cc0e84-9828-4f71-b80c-a60a77a582aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:74:97', 'vm-uuid': 'd411f846-f07f-4824-94d7-96cc11105ac1'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:10.563025 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:10.564204 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:24:10.569677 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:10.570635 np0000001643 nova-compute[98269]: INFO os_vif [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:74:97,bridge_name='br-int',has_traffic_filtering=True,id=d9cc0e84-9828-4f71-b80c-a60a77a582aa,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cc0e84-98')
May 28 14:24:12.094435 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:24:12.094435 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:24:12.094435 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] No VIF found with MAC fa:16:3e:bb:74:97, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:24:12.094953 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Using config drive
May 28 14:24:12.602859 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:12.732112 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Creating config drive at /opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1/disk.config
May 28 14:24:12.735091 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbecfa_oh {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:12.791427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbecfa_oh" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:13.199270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:13.219511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:13.307310 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:13.472756 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f53b12e-48d4-4bf5-8c63-f1fa8b76a350 req-4528ac07-bfac-4384-85c2-c671554ac4fa service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-vif-plugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:13.473259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f53b12e-48d4-4bf5-8c63-f1fa8b76a350 req-4528ac07-bfac-4384-85c2-c671554ac4fa service nova] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:13.473455 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f53b12e-48d4-4bf5-8c63-f1fa8b76a350 req-4528ac07-bfac-4384-85c2-c671554ac4fa service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:13.473605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8f53b12e-48d4-4bf5-8c63-f1fa8b76a350 req-4528ac07-bfac-4384-85c2-c671554ac4fa service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:13.473748 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8f53b12e-48d4-4bf5-8c63-f1fa8b76a350 req-4528ac07-bfac-4384-85c2-c671554ac4fa service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Processing event network-vif-plugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:24:13.512076 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:13.512572 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:13.937330 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978253.9369538, d411f846-f07f-4824-94d7-96cc11105ac1 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:24:13.937479 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] VM Started (Lifecycle Event)
May 28 14:24:13.939508 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:24:13.942902 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:24:13.945925 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Instance spawned successfully.
May 28 14:24:13.946106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:24:14.441016 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:14.444952 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:24:14.457651 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:14.457927 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:14.458223 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:14.458483 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:14.458836 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:14.459098 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:14.523637 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:14.947635 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:24:14.947635 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978254.946558, d411f846-f07f-4824-94d7-96cc11105ac1 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:24:14.947635 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] VM Paused (Lifecycle Event)
May 28 14:24:14.970236 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Took 8.49 seconds to spawn the instance on the hypervisor.
May 28 14:24:14.970392 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:15.043046 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:15.449189 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:15.452788 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978255.4512205, d411f846-f07f-4824-94d7-96cc11105ac1 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:24:15.452788 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] VM Resumed (Lifecycle Event)
May 28 14:24:15.481192 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Took 15.73 seconds to build instance.
May 28 14:24:15.533017 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f996043-ef0b-4e90-939d-84bbe2bfbf30 req-879fdb33-1574-4e76-b13c-e311dcf5ffe2 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-vif-plugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:15.533423 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f996043-ef0b-4e90-939d-84bbe2bfbf30 req-879fdb33-1574-4e76-b13c-e311dcf5ffe2 service nova] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:15.533650 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f996043-ef0b-4e90-939d-84bbe2bfbf30 req-879fdb33-1574-4e76-b13c-e311dcf5ffe2 service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:15.533805 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f996043-ef0b-4e90-939d-84bbe2bfbf30 req-879fdb33-1574-4e76-b13c-e311dcf5ffe2 service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:15.534017 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f996043-ef0b-4e90-939d-84bbe2bfbf30 req-879fdb33-1574-4e76-b13c-e311dcf5ffe2 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] No waiting events found dispatching network-vif-plugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:24:15.534075 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-2f996043-ef0b-4e90-939d-84bbe2bfbf30 req-879fdb33-1574-4e76-b13c-e311dcf5ffe2 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received unexpected event network-vif-plugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa for instance with vm_state active and task_state None.
May 28 14:24:15.564963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:15.959470 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:15.963830 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:24:15.982857 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-c9d15d59-2971-45f7-92ca-576a224b3eab tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.234s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:16.723542 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:17.590461 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-changed-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:17.590595 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Refreshing instance network info cache due to event network-changed-d9cc0e84-9828-4f71-b80c-a60a77a582aa. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:24:17.590846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] Acquiring lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:24:17.590988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] Acquired lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:24:17.591180 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Refreshing network info cache for port d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:24:18.093416 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:18.434113 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:18.585145 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updated VIF entry in instance network info cache for port d9cc0e84-9828-4f71-b80c-a60a77a582aa. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:24:18.585422 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updating instance_info_cache with network_info: [{"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:19.089381 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-10aad18a-9779-4a45-b2e7-d52a1ed0c19c req-9b6abbda-4672-48a1-8e75-ee993420a923 service nova] Releasing lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:24:20.000343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:20.043933 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:20.580265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:21.811300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:25.046932 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:25.591385 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:30.046816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:30.593552 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:35.047653 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:35.199993 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:35.200212 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:35.607568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:35.702988 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:24:36.281850 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:36.282222 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:36.287047 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:24:36.287191 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Claim successful on node np0000001643
May 28 14:24:37.481942 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:24:37.482429 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:24:37.827206 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:37.827406 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:24:37.984538 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:24:38.492408 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.210s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:38.492967 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:24:38.998439 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:24:38.998689 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:24:38.998985 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:38.999944 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:39.068532 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b24afd65ee7940c29ab00493368e2417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbeafad41ae4c0696b9aaf07b5e21b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:24:39.502296 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:24:39.523021 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Successfully created port: 74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:24:39.826909 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:39.827046 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:24:39.827247 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:39.957731 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Successfully updated port: 74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:24:40.001083 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-changed-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:40.001380 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Refreshing instance network info cache due to event network-changed-74a34395-040e-43b5-a62f-615eb039a9e9. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:24:40.001543 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] Acquiring lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:24:40.001700 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] Acquired lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:24:40.001820 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Refreshing network info cache for port 74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:24:40.007095 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:24:40.048061 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:40.331062 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:40.331191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:40.331318 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:40.331433 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:24:40.459545 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:24:40.503596 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:40.568480 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:24:40.620259 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:40.718097 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:41.014085 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:24:41.014828 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:24:41.015074 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Creating image(s)
May 28 14:24:41.015493 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:41.015662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "/opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:41.016086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "/opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:41.016798 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:24:41.019089 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:24:41.020183 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:41.106374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:41.106800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:41.107231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:41.107655 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:24:41.109999 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:24:41.110288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:41.196523 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.086s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:41.196916 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:41.221705 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-750fcfa6-bc83-4958-a0c2-93be3537b69f req-9a2ef8e3-0eec-47c2-8990-bef9837ac7d1 service nova] Releasing lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:24:41.222706 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquired lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:24:41.223011 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:24:41.251063 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk 1073741824" returned: 0 in 0.054s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:41.251459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:41.251799 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:41.344988 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.093s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:41.345524 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:24:41.345741 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:41.367273 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:24:41.368730 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:24:41.370688 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:24:41.373383 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:41.422290 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:41.425787 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=12796MB free_disk=72.6621322631836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:24:41.426054 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:41.426427 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:41.435818 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:41.436221 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Cannot resize image /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:24:41.436602 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:24:41.436772 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Ensure instance console log exists: /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:24:41.437205 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:41.437383 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:41.437548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:41.789566 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:24:41.924484 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:42.051024 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:24:42.055720 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Updating instance_info_cache with network_info: [{"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:42.488982 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance a7214001-d5cf-4579-9e4b-577392bc2cf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:24:42.489107 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance d411f846-f07f-4824-94d7-96cc11105ac1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:24:42.489217 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0fa3c2aa-266c-468f-8574-b6061e75b586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:24:42.489363 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:24:42.489543 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:24:41 up 51 min,  2 users,  load average: 2.51, 3.71, 4.13\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_6a701352f7484e2d810439622b1c8bda': '2', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_6bbeafad41ae4c0696b9aaf07b5e21b2': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:24:42.557709 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Releasing lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:24:42.558099 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Instance network_info: |[{"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:24:42.559881 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Start _get_guest_xml network_info=[{"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:24:42.563540 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:24:42.564706 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-28696357', uuid='0fa3c2aa-266c-468f-8574-b6061e75b586'), owner=OwnerMeta(userid='b24afd65ee7940c29ab00493368e2417', username='tempest-TestEncryptedCinderVolumes-373548889-project-member', projectid='6bbeafad41ae4c0696b9aaf07b5e21b2', projectname='tempest-TestEncryptedCinderVolumes-373548889'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978282.564339) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:24:42.565886 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:24:42.566225 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:24:42.567174 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:24:42.567328 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:24:42.568182 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:24:42.568493 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:24:42.568630 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:24:42.568720 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:24:42.568829 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:24:42.568907 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:24:42.569006 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:24:42.569146 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:24:42.569252 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:24:42.569356 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:24:42.569485 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:24:42.569608 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:24:42.579304 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-28696357',display_name='tempest-TestEncryptedCinderVolumes-server-28696357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-28696357',id=79,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrM9eduAsk72kW5g3SQFb1fmTcCHmZZnc1qM7p120jL0OsbzaLUSQHfX7ljPlNcJMcY4HHi/yRIovM42Gf2IIj9UUCQ5NAfUdyWXRljbUFyzfMijHebvP1ZJtRfz+NWmA==',key_name='tempest-keypair-2047400690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-uxpcka59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b24afd65ee7940c29ab00493368e2417',uuid=0fa3c2aa-266c-468f-8574-b6061e75b586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:24:42.579887 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:24:42.580496 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=74a34395-040e-43b5-a62f-615eb039a9e9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a34395-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:24:42.581092 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fa3c2aa-266c-468f-8574-b6061e75b586 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:24:42.679267 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:24:42.679525 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:24:43.083866 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] End _get_guest_xml xml=<domain type="qemu">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <uuid>0fa3c2aa-266c-468f-8574-b6061e75b586</uuid>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <name>instance-0000004f</name>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-28696357</nova:name>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:24:42</nova:creationTime>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:user uuid="b24afd65ee7940c29ab00493368e2417">tempest-TestEncryptedCinderVolumes-373548889-project-member</nova:user>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:project uuid="6bbeafad41ae4c0696b9aaf07b5e21b2">tempest-TestEncryptedCinderVolumes-373548889</nova:project>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         <nova:port uuid="74a34395-040e-43b5-a62f-615eb039a9e9">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <system>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <entry name="serial">0fa3c2aa-266c-468f-8574-b6061e75b586</entry>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <entry name="uuid">0fa3c2aa-266c-468f-8574-b6061e75b586</entry>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </system>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <os>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   </os>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <features>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   </features>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   <devices>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </disk>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk.config"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </disk>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:3c:5c:19"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <target dev="tap74a34395-04"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </interface>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/console.log" append="off"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </serial>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <video>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </video>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </rng>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:   </devices>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]: </domain>
May 28 14:24:43.083866 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Preparing to wait for external event network-vif-plugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-28696357',display_name='tempest-TestEncryptedCinderVolumes-server-28696357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-28696357',id=79,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrM9eduAsk72kW5g3SQFb1fmTcCHmZZnc1qM7p120jL0OsbzaLUSQHfX7ljPlNcJMcY4HHi/yRIovM42Gf2IIj9UUCQ5NAfUdyWXRljbUFyzfMijHebvP1ZJtRfz+NWmA==',key_name='tempest-keypair-2047400690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-uxpcka59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b24afd65ee7940c29ab00493368e2417',uuid=0fa3c2aa-266c-468f-8574-b6061e75b586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=74a34395-040e-43b5-a62f-615eb039a9e9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a34395-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=74a34395-040e-43b5-a62f-615eb039a9e9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a34395-04') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:43.087326 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:43.087982 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:24:43.088195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:43.088376 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4d77f78-6639-5ac2-b0b3-c773fa90e65f', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:43.089227 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:43.090072 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:24:43.090455 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:43.092513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:43.092812 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74a34395-04, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:43.093208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74a34395-04, col_values=(('qos', UUID('cea8930b-820e-455b-84dd-bb51de38fa3c')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:43.093397 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74a34395-04, col_values=(('external_ids', {'iface-id': '74a34395-040e-43b5-a62f-615eb039a9e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:5c:19', 'vm-uuid': '0fa3c2aa-266c-468f-8574-b6061e75b586'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:43.094437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:43.095563 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:24:43.100034 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:43.100949 np0000001643 nova-compute[98269]: INFO os_vif [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=74a34395-040e-43b5-a62f-615eb039a9e9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a34395-04')
May 28 14:24:43.182693 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:24:43.691001 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:24:43.691163 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.265s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:43.691559 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:24:44.617211 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:24:44.617527 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:24:44.617527 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No VIF found with MAC fa:16:3e:3c:5c:19, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:24:44.617887 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Using config drive
May 28 14:24:44.691642 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:44.691880 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:44.692134 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:44.692439 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.13 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:24:44.823816 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:44.824042 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:24:45.049281 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:45.122741 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:45.228240 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Creating config drive at /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk.config
May 28 14:24:45.232031 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0oujovv0 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:24:45.288259 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0oujovv0" returned: 0 in 0.056s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:24:45.679938 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:45.704519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:45.809126 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:45.828025 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:45.829054 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:24:45.874212 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e89d25dd-b7e0-4ede-869b-2889f759a21d req-018ed65a-07e8-4bc4-adc9-20c2fbceb075 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-vif-plugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:45.874532 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e89d25dd-b7e0-4ede-869b-2889f759a21d req-018ed65a-07e8-4bc4-adc9-20c2fbceb075 service nova] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:45.874938 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e89d25dd-b7e0-4ede-869b-2889f759a21d req-018ed65a-07e8-4bc4-adc9-20c2fbceb075 service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:45.875122 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-e89d25dd-b7e0-4ede-869b-2889f759a21d req-018ed65a-07e8-4bc4-adc9-20c2fbceb075 service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:45.876245 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-e89d25dd-b7e0-4ede-869b-2889f759a21d req-018ed65a-07e8-4bc4-adc9-20c2fbceb075 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Processing event network-vif-plugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:24:45.979076 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:46.023800 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:46.026554 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:46.034743 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:46.055021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:46.532829 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978286.532349, 0fa3c2aa-266c-468f-8574-b6061e75b586 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:24:46.532975 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] VM Started (Lifecycle Event)
May 28 14:24:46.536487 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:24:46.539257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:24:46.542838 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Instance spawned successfully.
May 28 14:24:46.543367 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:24:47.037059 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:47.039260 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:24:47.054196 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:47.054777 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:47.054777 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:47.054919 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:47.055197 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:47.055697 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:24:47.541895 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:24:47.542155 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978287.5419514, 0fa3c2aa-266c-468f-8574-b6061e75b586 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:24:47.542282 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] VM Paused (Lifecycle Event)
May 28 14:24:47.560414 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Took 6.55 seconds to spawn the instance on the hypervisor.
May 28 14:24:47.560838 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:47.947317 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a423796f-9cc9-4c1e-ac73-bcf428ce94ca req-a71c2ffa-cad5-43d8-84d4-4a4ddcb2269c service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-vif-plugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:47.947846 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a423796f-9cc9-4c1e-ac73-bcf428ce94ca req-a71c2ffa-cad5-43d8-84d4-4a4ddcb2269c service nova] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:47.949876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a423796f-9cc9-4c1e-ac73-bcf428ce94ca req-a71c2ffa-cad5-43d8-84d4-4a4ddcb2269c service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:47.950220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-a423796f-9cc9-4c1e-ac73-bcf428ce94ca req-a71c2ffa-cad5-43d8-84d4-4a4ddcb2269c service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:47.950330 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-a423796f-9cc9-4c1e-ac73-bcf428ce94ca req-a71c2ffa-cad5-43d8-84d4-4a4ddcb2269c service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] No waiting events found dispatching network-vif-plugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:24:47.950527 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-a423796f-9cc9-4c1e-ac73-bcf428ce94ca req-a71c2ffa-cad5-43d8-84d4-4a4ddcb2269c service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received unexpected event network-vif-plugged-74a34395-040e-43b5-a62f-615eb039a9e9 for instance with vm_state active and task_state None.
May 28 14:24:48.044571 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:48.046794 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978288.0465708, 0fa3c2aa-266c-468f-8574-b6061e75b586 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:24:48.046902 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] VM Resumed (Lifecycle Event)
May 28 14:24:48.069934 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Took 11.86 seconds to build instance.
May 28 14:24:48.095982 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:48.550102 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:24:48.552668 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:24:48.571287 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d00d9393-acac-430a-b751-5e503f697e49 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.371s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:49.823799 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:24:49.824485 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:24:50.001777 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-changed-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:50.002098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Refreshing instance network info cache due to event network-changed-74a34395-040e-43b5-a62f-615eb039a9e9. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:24:50.002322 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] Acquiring lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:24:50.002531 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] Acquired lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:24:50.002666 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Refreshing network info cache for port 74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:24:50.050877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:50.505357 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:50.843814 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:50.963137 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Updated VIF entry in instance network info cache for port 74a34395-040e-43b5-a62f-615eb039a9e9. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:24:50.963570 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Updating instance_info_cache with network_info: [{"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:51.465746 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-d2a6f30a-88ce-4b1e-b51d-582102fcb141 req-13ca3c82-6977-4c18-b049-a362f84f78e6 service nova] Releasing lock "refresh_cache-0fa3c2aa-266c-468f-8574-b6061e75b586" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:24:53.099134 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:54.254593 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-changed-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:54.255032 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Refreshing instance network info cache due to event network-changed-d9cc0e84-9828-4f71-b80c-a60a77a582aa. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:24:54.255032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] Acquiring lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:24:54.255032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] Acquired lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:24:54.255170 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Refreshing network info cache for port d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:24:54.757209 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:54.784564 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:54.784780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:54.784995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:54.785179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:54.785310 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:54.787883 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Terminating instance
May 28 14:24:55.031182 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:55.054011 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:55.152729 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updated VIF entry in instance network info cache for port d9cc0e84-9828-4f71-b80c-a60a77a582aa. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:24:55.152992 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updating instance_info_cache with network_info: [{"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:55.290962 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:24:55.330586 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:55.346910 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:55.500029 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:55.509131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:55.621756 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999643592000211 future=<Future at 0x71a75c1dd0a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:24:55.622878 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998513677000119 future=<Future at 0x71a75c1dd0a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:24:55.623119 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998253117999866 future=<Future at 0x71a75c1dd0a0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:24:55.625222 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Instance destroyed successfully.
May 28 14:24:55.625792 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid d411f846-f07f-4824-94d7-96cc11105ac1 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:24:55.655963 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-69ea12b2-86ab-49d0-b1da-a68127d5c73a req-55510bc1-7431-4270-aee0-fb678acf3e65 service nova] Releasing lock "refresh_cache-d411f846-f07f-4824-94d7-96cc11105ac1" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:24:56.128240 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1826298325',display_name='tempest-TestVolumeBootPattern-server-1826298325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-1826298325',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:24:14Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-99x9gaye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:24:15Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=d411f846-f07f-4824-94d7-96cc11105ac1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:24:56.128529 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "address": "fa:16:3e:bb:74:97", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cc0e84-98", "ovs_interfaceid": "d9cc0e84-9828-4f71-b80c-a60a77a582aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:24:56.129077 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:74:97,bridge_name='br-int',has_traffic_filtering=True,id=d9cc0e84-9828-4f71-b80c-a60a77a582aa,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cc0e84-98') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:24:56.129348 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:74:97,bridge_name='br-int',has_traffic_filtering=True,id=d9cc0e84-9828-4f71-b80c-a60a77a582aa,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cc0e84-98') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:24:56.130747 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:56.130992 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9cc0e84-98, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:56.131968 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:56.134244 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:24:56.134816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:56.134898 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=610f5e44-5d71-46d2-814e-71ff9a2dc6d4) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:24:56.135303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:56.136270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:24:56.139177 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:24:56.141328 np0000001643 nova-compute[98269]: INFO os_vif [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:74:97,bridge_name='br-int',has_traffic_filtering=True,id=d9cc0e84-9828-4f71-b80c-a60a77a582aa,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cc0e84-98')
May 28 14:24:56.145143 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:24:56.145494 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:24:56.145658 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:24:56.146026 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:24:56.146336 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e8646e4-fe1c-43e5-9a97-4803c3110b09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:24:56.146519 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:24:56.172735 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:56.172735 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:56.172735 np0000001643 nova-compute[98269]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:56.172735 np0000001643 nova-compute[98269]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:56.172735 np0000001643 nova-compute[98269]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:24:56.172735 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:24:56.172943 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:56.172943 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:24:56.172943 np0000001643 nova-compute[98269]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:56.172943 np0000001643 nova-compute[98269]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09 (non-flash)
May 28 14:24:56.172943 np0000001643 nova-compute[98269]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:24:56.172943 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:24:56.173142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', '218')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:24:56.173142 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', '212')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:24:56.173976 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09', '213')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:24:56.174714 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a778153f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:24:56.174909 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sdf, sdc {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:24:56.175150 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 3300000002612d934 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:24:56.236237 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:24:56.291003 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:24:56.330438 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-vif-unplugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:56.330616 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:56.330765 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:56.330872 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:56.330981 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] No waiting events found dispatching network-vif-unplugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:24:56.331092 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-vif-unplugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:24:56.331217 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-vif-unplugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:56.331321 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] Acquiring lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:56.331466 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:56.331634 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] Lock "d411f846-f07f-4824-94d7-96cc11105ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:24:56.331743 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] No waiting events found dispatching network-vif-unplugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:24:56.331837 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-33d9c836-71c6-4953-943e-79fe70185410 req-1303b199-1676-45f5-b9b8-4a6b691e7d1c service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-vif-unplugged-d9cc0e84-9828-4f71-b80c-a60a77a582aa for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:24:56.344886 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:24:56.345038 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:24:56.346270 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:24:56.358644 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:24:56.358822 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:24:56.371512 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:56.400824 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.40.100,3260]
May 28 14:24:56.400824 np0000001643 nova-compute[98269]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.40.100,3260] successful.
May 28 14:24:56.400824 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:56.417607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:56.432031 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:56.468470 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.50.100,3260]
May 28 14:24:56.468470 np0000001643 nova-compute[98269]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-5e8646e4-fe1c-43e5-9a97-4803c3110b09, portal: 192.168.50.100,3260] successful.
May 28 14:24:56.468470 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:56.478067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:24:56.478341 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:24:56.478527 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (332ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:24:56.478688 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:24:56.478997 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Deleting instance files /opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1_del
May 28 14:24:56.479569 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Deletion of /opt/stack/data/nova/instances/d411f846-f07f-4824-94d7-96cc11105ac1_del complete
May 28 14:24:56.987313 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Took 1.70 seconds to destroy the instance on the hypervisor.
May 28 14:24:56.987928 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:24:56.988274 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:24:56.988428 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:24:56.988707 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:57.104010 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:24:57.806900 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:24:58.309120 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Took 1.32 seconds to deallocate network for instance.
May 28 14:24:58.404734 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-680ce6ea-4f9c-4c75-9536-625b91c7a2dc req-27cc9cb3-5426-4afb-bf49-97421daa319b service nova] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Received event network-vif-deleted-d9cc0e84-9828-4f71-b80c-a60a77a582aa {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:24:58.857458 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:24:59.362526 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:24:59.362673 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:24:59.518377 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:24:59.518592 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:25:00.021007 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:25:00.054949 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:00.527667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.165s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:00.574633 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance d411f846-f07f-4824-94d7-96cc11105ac1
May 28 14:25:01.136086 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:01.581812 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-fa60e08b-226d-48a5-8936-4668e2e6c80c tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "d411f846-f07f-4824-94d7-96cc11105ac1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.797s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:02.474093 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:02.474537 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:02.976023 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:25:03.518828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:03.519125 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:03.521912 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:25:03.522049 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Claim successful on node np0000001643
May 28 14:25:03.727979 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-changed-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:03.728317 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Refreshing instance network info cache due to event network-changed-86b56357-8606-4fdf-bd31-9570ea3aa841. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:25:03.728465 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] Acquiring lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:25:03.728575 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] Acquired lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:25:03.728673 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Refreshing network info cache for port 86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:25:04.230401 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:04.267196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:04.267196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:04.267196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:04.267196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:04.267196 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:04.271316 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Terminating instance
May 28 14:25:04.493861 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:04.627639 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updated VIF entry in instance network info cache for port 86b56357-8606-4fdf-bd31-9570ea3aa841. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:25:04.627981 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updating instance_info_cache with network_info: [{"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:25:04.699806 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:25:04.699973 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:25:04.774332 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:25:04.789905 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:04.792627 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:04.807897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:04.826849 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:04.827821 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:04.923753 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-793074ab-4884-4000-8562-bffa1aa5c4a7 req-ff05815b-ccbc-4f20-846a-8fe72788f689 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-vif-unplugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:04.924260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-793074ab-4884-4000-8562-bffa1aa5c4a7 req-ff05815b-ccbc-4f20-846a-8fe72788f689 service nova] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:04.924487 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-793074ab-4884-4000-8562-bffa1aa5c4a7 req-ff05815b-ccbc-4f20-846a-8fe72788f689 service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:04.924619 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-793074ab-4884-4000-8562-bffa1aa5c4a7 req-ff05815b-ccbc-4f20-846a-8fe72788f689 service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:04.924777 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-793074ab-4884-4000-8562-bffa1aa5c4a7 req-ff05815b-ccbc-4f20-846a-8fe72788f689 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] No waiting events found dispatching network-vif-unplugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:25:04.924912 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-793074ab-4884-4000-8562-bffa1aa5c4a7 req-ff05815b-ccbc-4f20-846a-8fe72788f689 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-vif-unplugged-86b56357-8606-4fdf-bd31-9570ea3aa841 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:25:05.055652 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:05.090411 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999717512000188 future=<Future at 0x71a75c31d790 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:05.092396 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Instance destroyed successfully.
May 28 14:25:05.092792 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lazy-loading 'resources' on Instance uuid a7214001-d5cf-4579-9e4b-577392bc2cf9 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:25:05.129667 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6f1ca3a1-c6f1-4b90-94a1-2e2e80280f07 req-bf5febe2-f6f8-4545-ab6c-be623ebfd87f service nova] Releasing lock "refresh_cache-a7214001-d5cf-4579-9e4b-577392bc2cf9" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:25:05.202286 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:25:05.594981 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2054338988',display_name='tempest-TestVolumeBootPattern-server-2054338988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testvolumebootpattern-server-2054338988',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo/KzNQs0ivfYxmzND4fNzSiiEhjjRMoq8+j7Z44nl9gw7DmGbFpcBuTtPKdVSSffLXOBOXWaDwCW1J5ME4ORbg+VjgYPwRNrRtou0rHc51XKPYvh8rZDEjMtndvIe3Ug==',key_name='tempest-TestVolumeBootPattern-442081332',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:23:16Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a701352f7484e2d810439622b1c8bda',ramdisk_id='',reservation_id='r-mua7yu1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1916664954',owner_user_name='tempest-TestVolumeBootPattern-1916664954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:23:16Z,user_data=None,user_id='3d205ac18dd14beea4c09d9637f969e8',uuid=a7214001-d5cf-4579-9e4b-577392bc2cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:25:05.595217 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converting VIF {"id": "86b56357-8606-4fdf-bd31-9570ea3aa841", "address": "fa:16:3e:b6:35:00", "network": {"id": "f448362c-2339-4533-a2be-22d5b1b844b0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1966488604-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a701352f7484e2d810439622b1c8bda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b56357-86", "ovs_interfaceid": "86b56357-8606-4fdf-bd31-9570ea3aa841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:25:05.595764 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:35:00,bridge_name='br-int',has_traffic_filtering=True,id=86b56357-8606-4fdf-bd31-9570ea3aa841,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b56357-86') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:25:05.595999 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:35:00,bridge_name='br-int',has_traffic_filtering=True,id=86b56357-8606-4fdf-bd31-9570ea3aa841,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b56357-86') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:25:05.596900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:05.597126 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86b56357-86, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:05.598052 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:05.598745 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:05.598942 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:05.599559 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:05.599682 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2cd5ac1-f529-4917-b939-0f5f87b68af2) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:05.600084 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:05.600511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:05.600613 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:05.601987 np0000001643 nova-compute[98269]: INFO os_vif [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:35:00,bridge_name='br-int',has_traffic_filtering=True,id=86b56357-8606-4fdf-bd31-9570ea3aa841,network=Network(f448362c-2339-4533-a2be-22d5b1b844b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b56357-86')
May 28 14:25:05.603429 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:25:05.603710 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:25:05.603831 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:05.604120 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:05.604391 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e3082c-e702-49e2-89fe-709beaf49e42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:25:05.604554 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:25:05.627758 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:25:05.627758 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:25:05.627758 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:05.628233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:25:05.628233 np0000001643 nova-compute[98269]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42 (non-flash)
May 28 14:25:05.628233 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:05.628233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '208')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:25:05.628233 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '207')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:25:05.628807 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42', '208')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:25:05.629435 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c300540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'): ({'sde'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:25:05.629733 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Removing multipathed devices sde, sdd {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:25:05.629936 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Flush multipath device 33000000089d82104 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:25:05.698906 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:25:05.708131 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.189s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:05.708611 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:25:05.743019 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:25:05.780786 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:25:05.780948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:25:05.781565 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:25:05.791886 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:25:05.792029 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:25:05.803933 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:05.832028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260]
May 28 14:25:05.832028 np0000001643 nova-compute[98269]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.40.100,3260] successful.
May 28 14:25:05.832028 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:05.843101 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:05.855894 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:05.877970 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260]
May 28 14:25:05.877970 np0000001643 nova-compute[98269]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-65e3082c-e702-49e2-89fe-709beaf49e42, portal: 192.168.50.100,3260] successful.
May 28 14:25:05.877970 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:05.888866 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:05.889070 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:05.889212 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] <== disconnect_volume: return (285ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:25:05.889335 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:25:05.889599 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Deleting instance files /opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9_del
May 28 14:25:05.890044 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Deletion of /opt/stack/data/nova/instances/a7214001-d5cf-4579-9e4b-577392bc2cf9_del complete
May 28 14:25:06.214916 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:25:06.215091 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:25:06.215338 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:06.215616 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:06.284642 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6684870edb4241b78d25362d8e7d852a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c8ab14764c4724ba1e8a0678911782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:25:06.396412 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Took 1.62 seconds to destroy the instance on the hypervisor.
May 28 14:25:06.397078 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:25:06.397520 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:25:06.397655 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:25:06.397910 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:06.460391 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:06.686019 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Successfully created port: c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:25:06.725183 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:25:06.795783 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2018853f-d326-4136-8758-c5f1900bb585 req-155ace25-a37d-4207-ba21-b6ce883c8369 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-vif-deleted-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:06.796005 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-2018853f-d326-4136-8758-c5f1900bb585 req-155ace25-a37d-4207-ba21-b6ce883c8369 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Neutron deleted interface 86b56357-8606-4fdf-bd31-9570ea3aa841; detaching it from the instance and deleting it from the info cache
May 28 14:25:06.797571 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2018853f-d326-4136-8758-c5f1900bb585 req-155ace25-a37d-4207-ba21-b6ce883c8369 service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Detach interface failed, port_id=86b56357-8606-4fdf-bd31-9570ea3aa841, reason: Instance a7214001-d5cf-4579-9e4b-577392bc2cf9 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:25:06.997385 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-72045dd7-d80c-4e8b-a202-ebd949c82430 req-dfa5068e-8302-4e72-9553-34881a51f11e service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-vif-unplugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:06.997685 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-72045dd7-d80c-4e8b-a202-ebd949c82430 req-dfa5068e-8302-4e72-9553-34881a51f11e service nova] Acquiring lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:06.997828 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-72045dd7-d80c-4e8b-a202-ebd949c82430 req-dfa5068e-8302-4e72-9553-34881a51f11e service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:06.997964 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-72045dd7-d80c-4e8b-a202-ebd949c82430 req-dfa5068e-8302-4e72-9553-34881a51f11e service nova] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:06.998170 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-72045dd7-d80c-4e8b-a202-ebd949c82430 req-dfa5068e-8302-4e72-9553-34881a51f11e service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] No waiting events found dispatching network-vif-unplugged-86b56357-8606-4fdf-bd31-9570ea3aa841 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:25:06.998331 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-72045dd7-d80c-4e8b-a202-ebd949c82430 req-dfa5068e-8302-4e72-9553-34881a51f11e service nova] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Received event network-vif-unplugged-86b56357-8606-4fdf-bd31-9570ea3aa841 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:25:07.143657 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Successfully updated port: c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:25:07.252481 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:25:07.645800 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:25:07.645967 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquired lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:25:07.646113 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:25:07.730640 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:25:07.754271 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Took 1.36 seconds to deallocate network for instance.
May 28 14:25:08.203120 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:25:08.234503 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Booting with volume 455fa5fb-1e4a-4b0f-a358-9266ef6e19cc at /dev/vdb
May 28 14:25:08.271220 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:25:08.282903 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:25:08.305101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:08.324853 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Took 0.57 seconds to detach 1 volumes for instance.
May 28 14:25:08.346124 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:25:08.346481 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:25:08.356134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:25:08.357435 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe3c:5c19', 'fe80::5cf2:93ff:fe58:5286'] 
May 28 14:25:08.357631 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:25:08.357807 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:25:08.358143 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:25:08.358396 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Updating existing volume attachment record: 4aadecbc-d587-4a0c-9d48-61eb05326f3c {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:25:08.363148 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:08.492164 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Updating instance_info_cache with network_info: [{"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:25:08.837462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:08.837862 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:08.994388 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Releasing lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:25:08.995053 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Instance network_info: |[{"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:25:09.027208 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:25:09.027754 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:25:09.077854 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-changed-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:09.078270 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Refreshing instance network info cache due to event network-changed-c21cca62-6c99-4b73-95a7-7a1896af0562. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:25:09.078553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] Acquiring lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:25:09.078737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] Acquired lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:25:09.078928 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Refreshing network info cache for port c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:25:09.530230 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:25:09.582190 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:09.853658 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:09.972135 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Updated VIF entry in instance network info cache for port c21cca62-6c99-4b73-95a7-7a1896af0562. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:25:09.972135 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Updating instance_info_cache with network_info: [{"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:25:10.036248 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.198s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:10.056914 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:10.084998 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Deleted allocations for instance a7214001-d5cf-4579-9e4b-577392bc2cf9
May 28 14:25:10.452939 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:25:10.454005 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:25:10.454220 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Creating image(s)
May 28 14:25:10.454688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:10.454831 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "/opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:10.455252 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "/opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:10.456355 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:25:10.459094 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:25:10.460411 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:10.475189 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-2f363c6d-ac52-4516-9798-35d68207113d req-fc61d166-8279-4135-8ace-ed249e99fcb4 service nova] Releasing lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:25:10.551048 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:10.551562 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "d247e6c14755b92f89afa3981dba8a24a5994476" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:10.552002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:10.552509 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:25:10.555460 np0000001643 nova-compute[98269]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98269) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 14:25:10.555893 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:10.603947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:10.622933 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.001543406000109826 future=<Future at 0x71a75c1dd0a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:10.623730 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978295.6212673, d411f846-f07f-4824-94d7-96cc11105ac1 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:25:10.623917 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:10.624136 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] VM Stopped (Lifecycle Event)
May 28 14:25:10.625482 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.46463022800026 future=<Future at 0x71a75c31d790 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:10.625752 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=9.464487119000296 future=<Future at 0x71a75c31d790 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:10.647217 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.091s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:10.647619 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk 1073741824 {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:10.700017 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476,backing_fmt=raw /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk 1073741824" returned: 0 in 0.052s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:10.700514 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "d247e6c14755b92f89afa3981dba8a24a5994476" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:10.701414 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:10.791111 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 --force-share --output=json" returned: 0 in 0.090s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:10.791608 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk. size=1073741824 {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 14:25:10.791873 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:10.885658 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:10.885658 np0000001643 nova-compute[98269]: DEBUG nova.virt.disk.api [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Cannot resize image /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk to a smaller size. {{(pid=98269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 14:25:10.886277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Created local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 14:25:10.886277 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Ensure instance console log exists: /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:25:10.886486 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:10.886959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:10.886959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:10.889364 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Start _get_guest_xml network_info=[{"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'image_id': 'ad923155-4eca-4cf1-b871-662172c18500'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': -1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '4aadecbc-d587-4a0c-9d48-61eb05326f3c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ecde64c7-09ae-4603-9c99-27aff39db163', 'attached_at': '', 'detached_at': '', 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'serial': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:25:10.894173 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:25:10.895800 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ad923155-4eca-4cf1-b871-662172c18500', instance_meta=NovaInstanceMeta(name='tempest-instance-1426325758', uuid='ecde64c7-09ae-4603-9c99-27aff39db163'), owner=OwnerMeta(userid='6684870edb4241b78d25362d8e7d852a', username='tempest-VolumesBackupsTest-109734936-project-member', projectid='21c8ab14764c4724ba1e8a0678911782', projectname='tempest-VolumesBackupsTest-109734936'), image=ImageMeta(id='ad923155-4eca-4cf1-b871-662172c18500', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978310.8953445) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:25:10.897135 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:25:10.897589 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:25:10.898492 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:25:10.898662 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:25:10.899721 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:25:10.900082 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T13:58:43Z,direct_url=<?>,disk_format='qcow2',id=ad923155-4eca-4cf1-b871-662172c18500,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='20c487217eff4dc8b342518997c3e985',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T13:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:25:10.900284 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:25:10.900348 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:25:10.900743 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:25:10.900743 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:25:10.900743 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:25:10.900855 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:25:10.900972 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:25:10.901121 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:25:10.901229 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:25:10.901371 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:25:10.912422 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:25:10.912795 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:25:10.912955 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:10.913281 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:10.913529 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:25:10.927101 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:10.927863 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:10.928335 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:10.928554 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:25:10.931630 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:10.931894 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:25:10.940560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:25:10.940560 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:10.948919 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:25:10.948919 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:10.956720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc] added
May 28 14:25:10.956720 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:25:10.956720 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:10.956720 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:10.956720 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:10.956720 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:10.956720 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:10.957053 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:25:10.957204 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:25:10.957329 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:25:10.963304 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc] added
May 28 14:25:10.963304 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:25:10.963304 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:10.963304 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:10.963304 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:10.963304 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:10.963304 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:10.963560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:25:10.963759 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:25:10.963938 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:25:11.098517 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-540c6f14-b909-4cac-aa3c-c0a1b64f96b5 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Lock "a7214001-d5cf-4579-9e4b-577392bc2cf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.831s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:11.127798 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: d411f846-f07f-4824-94d7-96cc11105ac1] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:25:11.957870 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:25:11.964325 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:25:11.969560 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:25:11.969560 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:25:11.975605 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:25:11.975605 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:11.980999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:11.987653 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:11.992541 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:25:11.992541 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:11.992647 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:25:11.992647 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:11.992803 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:25:11.992803 np0000001643 nova-compute[98269]: 
May 28 14:25:12.000808 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:25:12.000808 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:12.000975 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:25:12.000975 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:12.001039 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:25:12.001039 np0000001643 nova-compute[98269]: 
May 28 14:25:12.019548 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.40.100,3260]
May 28 14:25:12.019548 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.40.100,3260] successful.
May 28 14:25:12.019548 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:12.030224 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:12.040760 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.040760 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.040760 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:12.041079 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.041079 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.041079 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:12.041467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.113s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:12.042014 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.50.100,3260]
May 28 14:25:12.042014 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.50.100,3260] successful.
May 28 14:25:12.042014 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:12.042361 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:25:12.043151 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] HCTL ('7', '-', '-', 0) found on session 219 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:25:12.043328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:25:12.054411 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:12.065088 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Searching for a device in session 219 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:25:12.065255 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:25:12.072440 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.072440 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.072440 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:12.072612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.072612 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:12.072612 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:12.072792 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:12.072894 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:25:12.073291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] HCTL ('8', '-', '-', 0) found on session 220 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:25:12.073406 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:25:12.089000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Searching for a device in session 220 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:25:12.089000 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:25:12.929148 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:25:13.638335 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:13.944190 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Found WWN 3300000004259ff46 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:25:13.944498 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:13.946293 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000004259ff46', 'path': '/dev/dm-0', 'multipath_id': '3300000004259ff46'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:25:13.946293 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004259ff46', 'path': '/dev/dm-0', 'multipath_id': '3300000004259ff46'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:25:14.451047 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1426325758',display_name='tempest-instance-1426325758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-instance-1426325758',id=80,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTSdbEzUO74MI87eJfCqw3qfMmi/RlJx3SR7BZqqBlse3bIWzNwjwqmiN8DaaDZwcRBMxDGJiz4j+ZqQYebM+nv2zsI38wbR5b4N7psYcGmgR8hU86msggVzlxEaDSY9g==',key_name='tempest-keypair-875244913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21c8ab14764c4724ba1e8a0678911782',ramdisk_id='',reservation_id='r-1o9ccjl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-109734936',owner_user_name='tempest-VolumesBackupsTest-109734936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6684870edb4241b78d25362d8e7d852a',uuid=ecde64c7-09ae-4603-9c99-27aff39db163,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:25:14.451322 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Converting VIF {"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:25:14.451896 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:72:8a,bridge_name='br-int',has_traffic_filtering=True,id=c21cca62-6c99-4b73-95a7-7a1896af0562,network=Network(b1532790-c66d-48f3-9246-4dfb84c7e8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21cca62-6c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:25:14.452411 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lazy-loading 'pci_devices' on Instance uuid ecde64c7-09ae-4603-9c99-27aff39db163 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:25:14.954895 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] End _get_guest_xml xml=<domain type="qemu">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <uuid>ecde64c7-09ae-4603-9c99-27aff39db163</uuid>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <name>instance-00000050</name>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:name>tempest-instance-1426325758</nova:name>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:25:10</nova:creationTime>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:image uuid="ad923155-4eca-4cf1-b871-662172c18500">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:user uuid="6684870edb4241b78d25362d8e7d852a">tempest-VolumesBackupsTest-109734936-project-member</nova:user>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:project uuid="21c8ab14764c4724ba1e8a0678911782">tempest-VolumesBackupsTest-109734936</nova:project>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:root type="image" uuid="ad923155-4eca-4cf1-b871-662172c18500"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         <nova:port uuid="c21cca62-6c99-4b73-95a7-7a1896af0562">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <system>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <entry name="serial">ecde64c7-09ae-4603-9c99-27aff39db163</entry>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <entry name="uuid">ecde64c7-09ae-4603-9c99-27aff39db163</entry>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </system>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <os>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   </os>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <features>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   </features>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   <devices>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <disk type="file" device="disk">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </disk>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk.config"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </disk>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <alias name="ua-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <source dev="/dev/dm-0"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <target dev="vdb" bus="virtio"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <serial>455fa5fb-1e4a-4b0f-a358-9266ef6e19cc</serial>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </disk>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:f9:72:8a"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <target dev="tapc21cca62-6c"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </interface>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/console.log" append="off"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </serial>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <video>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </video>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </rng>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:   </devices>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]: </domain>
May 28 14:25:14.954895 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Preparing to wait for external event network-vif-plugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1426325758',display_name='tempest-instance-1426325758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-instance-1426325758',id=80,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTSdbEzUO74MI87eJfCqw3qfMmi/RlJx3SR7BZqqBlse3bIWzNwjwqmiN8DaaDZwcRBMxDGJiz4j+ZqQYebM+nv2zsI38wbR5b4N7psYcGmgR8hU86msggVzlxEaDSY9g==',key_name='tempest-keypair-875244913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21c8ab14764c4724ba1e8a0678911782',ramdisk_id='',reservation_id='r-1o9ccjl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-109734936',owner_user_name='tempest-VolumesBackupsTest-109734936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6684870edb4241b78d25362d8e7d852a',uuid=ecde64c7-09ae-4603-9c99-27aff39db163,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Converting VIF {"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:72:8a,bridge_name='br-int',has_traffic_filtering=True,id=c21cca62-6c99-4b73-95a7-7a1896af0562,network=Network(b1532790-c66d-48f3-9246-4dfb84c7e8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21cca62-6c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:72:8a,bridge_name='br-int',has_traffic_filtering=True,id=c21cca62-6c99-4b73-95a7-7a1896af0562,network=Network(b1532790-c66d-48f3-9246-4dfb84c7e8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21cca62-6c') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:14.958808 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:25:14.959145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:14.959271 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '185bdf6b-f1c5-51eb-9895-f68aeb53e0d3', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:14.970879 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:14.971534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:14.973112 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:14.975601 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:14.975769 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc21cca62-6c, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:14.976119 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc21cca62-6c, col_values=(('qos', UUID('351c9043-3556-4893-a2e4-628c4b53b548')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:14.976317 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc21cca62-6c, col_values=(('external_ids', {'iface-id': 'c21cca62-6c99-4b73-95a7-7a1896af0562', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:72:8a', 'vm-uuid': 'ecde64c7-09ae-4603-9c99-27aff39db163'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:14.977001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:14.977992 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:14.983692 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:14.984419 np0000001643 nova-compute[98269]: INFO os_vif [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:72:8a,bridge_name='br-int',has_traffic_filtering=True,id=c21cca62-6c99-4b73-95a7-7a1896af0562,network=Network(b1532790-c66d-48f3-9246-4dfb84c7e8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21cca62-6c')
May 28 14:25:15.056962 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:15.278215 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:16.498963 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:25:16.499488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:25:16.499488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:25:16.499488 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] No VIF found with MAC fa:16:3e:f9:72:8a, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:25:16.499684 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Using config drive
May 28 14:25:17.004702 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:17.124040 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Creating config drive at /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk.config
May 28 14:25:17.127780 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3u8t106y {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:17.192442 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3u8t106y" returned: 0 in 0.064s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:17.562032 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:17.580548 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:17.582222 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:17.665130 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:17.728059 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f3747367-345a-45d6-8340-54a2e5b7a836 req-b6f42859-74be-4697-a6b4-e394101f0c51 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-vif-plugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:17.728294 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f3747367-345a-45d6-8340-54a2e5b7a836 req-b6f42859-74be-4697-a6b4-e394101f0c51 service nova] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:17.728901 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f3747367-345a-45d6-8340-54a2e5b7a836 req-b6f42859-74be-4697-a6b4-e394101f0c51 service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:17.729016 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-f3747367-345a-45d6-8340-54a2e5b7a836 req-b6f42859-74be-4697-a6b4-e394101f0c51 service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:17.729396 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-f3747367-345a-45d6-8340-54a2e5b7a836 req-b6f42859-74be-4697-a6b4-e394101f0c51 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Processing event network-vif-plugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:25:17.866483 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:17.867645 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:17.869637 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:17.883859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:18.236918 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978318.2365346, ecde64c7-09ae-4603-9c99-27aff39db163 => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:25:18.237082 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] VM Started (Lifecycle Event)
May 28 14:25:18.238747 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:25:18.241132 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:25:18.243066 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Instance spawned successfully.
May 28 14:25:18.243318 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:25:18.739974 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:25:18.742569 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:25:18.749421 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:25:18.749557 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:25:18.749830 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:25:18.750115 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:25:18.750257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:25:18.750530 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:25:19.245277 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:25:19.245504 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978319.245276, ecde64c7-09ae-4603-9c99-27aff39db163 => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:25:19.245611 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] VM Paused (Lifecycle Event)
May 28 14:25:19.255190 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Took 8.80 seconds to spawn the instance on the hypervisor.
May 28 14:25:19.255350 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:25:19.747709 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:25:19.750018 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978319.7498007, ecde64c7-09ae-4603-9c99-27aff39db163 => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:25:19.750138 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] VM Resumed (Lifecycle Event)
May 28 14:25:19.766308 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Took 16.29 seconds to build instance.
May 28 14:25:19.784301 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ed43222b-339e-467f-a219-fd3d068f0f4d req-f61e5075-6080-4306-9fd5-4b179710db28 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-vif-plugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:19.784364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ed43222b-339e-467f-a219-fd3d068f0f4d req-f61e5075-6080-4306-9fd5-4b179710db28 service nova] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:19.784553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ed43222b-339e-467f-a219-fd3d068f0f4d req-f61e5075-6080-4306-9fd5-4b179710db28 service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:19.784860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-ed43222b-339e-467f-a219-fd3d068f0f4d req-f61e5075-6080-4306-9fd5-4b179710db28 service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:19.785026 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-ed43222b-339e-467f-a219-fd3d068f0f4d req-f61e5075-6080-4306-9fd5-4b179710db28 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] No waiting events found dispatching network-vif-plugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:25:19.785119 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-ed43222b-339e-467f-a219-fd3d068f0f4d req-f61e5075-6080-4306-9fd5-4b179710db28 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received unexpected event network-vif-plugged-c21cca62-6c99-4b73-95a7-7a1896af0562 for instance with vm_state active and task_state None.
May 28 14:25:19.986895 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:20.058279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:20.090547 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0003967919997194258 future=<Future at 0x71a75c31d790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:20.090935 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978305.0900297, a7214001-d5cf-4579-9e4b-577392bc2cf9 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:25:20.091077 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:20.091216 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] VM Stopped (Lifecycle Event)
May 28 14:25:20.252859 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:25:20.254133 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:25:20.267754 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.793s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:20.593823 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: a7214001-d5cf-4579-9e4b-577392bc2cf9] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:25:21.374815 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-changed-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:21.376004 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Refreshing instance network info cache due to event network-changed-c21cca62-6c99-4b73-95a7-7a1896af0562. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:25:21.376301 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] Acquiring lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:25:21.377024 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] Acquired lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:25:21.378278 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Refreshing network info cache for port c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:25:21.883598 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:22.166582 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:22.290198 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Updated VIF entry in instance network info cache for port c21cca62-6c99-4b73-95a7-7a1896af0562. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:25:22.290601 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Updating instance_info_cache with network_info: [{"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:25:22.792682 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-9ab54b86-2268-4722-a9bd-507fcd8cc26c req-9bf4dce0-d964-4854-a28f-8ccbdd3291e6 service nova] Releasing lock "refresh_cache-ecde64c7-09ae-4603-9c99-27aff39db163" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:25:24.989439 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:25.060962 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:25.478026 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:25.478262 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:25.981091 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'flavor' on Instance uuid 0fa3c2aa-266c-468f-8574-b6061e75b586 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:25:26.987693 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:28.049528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:28.049961 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:28.049961 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Attaching volume b796e217-386a-4991-9a23-cb58245fcb25 to /dev/vdb
May 28 14:25:28.087285 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:25:28.098682 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:25:28.122817 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:28.168860 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:25:28.169159 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:25:28.177851 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:25:28.179031 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044', 'fe80::fc16:3eff:fe3c:5c19', 'fe80::5cf2:93ff:fe58:5286', 'fe80::fc16:3eff:fef9:728a', 'fe80::405b:11ff:fe4d:6d39'] 
May 28 14:25:28.179174 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:25:28.179296 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:25:28.179605 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:25:28.179918 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Updating existing volume attachment record: ab3abbfc-c570-4ef4-973e-3167af4c8f52 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:25:28.769156 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0fa3c2aa-266c-468f-8574-b6061e75b586', 'attached_at': '', 'detached_at': '', 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'serial': 'b796e217-386a-4991-9a23-cb58245fcb25'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:25:28.772506 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:25:28.772900 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:25:28.773067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:28.773648 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:28.773839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:25:28.784889 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:28.785544 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:28.786008 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:28.786195 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:25:28.786802 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:28.787049 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:25:28.800467 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:25:28.800467 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:28.806119 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:25:28.806119 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:28.811912 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25] added
May 28 14:25:28.811912 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:25:28.811912 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:28.811912 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:28.811912 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:28.811912 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:28.811912 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:28.812331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:25:28.812331 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:25:28.812472 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:25:28.818560 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25] added
May 28 14:25:28.818560 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:25:28.818560 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:28.818560 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:28.818560 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:25:28.818560 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:25:28.818560 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:28.819015 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:25:28.819015 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:25:28.819015 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:25:29.812889 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:25:29.821745 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:25:29.824651 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:25:29.824651 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:25:29.835917 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:25:29.835917 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.841108 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.853334 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.853334 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.853334 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.853334 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:29.853554 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.853554 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.853554 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.853554 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:29.858046 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.870247 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.870247 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.870247 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.870247 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:29.870469 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.870469 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.870469 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.870469 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:29.893872 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.40.100,3260]
May 28 14:25:29.893872 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.40.100,3260] successful.
May 28 14:25:29.893872 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.904804 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.913981 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.50.100,3260]
May 28 14:25:29.913981 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.50.100,3260] successful.
May 28 14:25:29.913981 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.920028 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:29.920028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:29.920373 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:25:29.921004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] HCTL ('10', '-', '-', 0) found on session 222 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:25:29.921121 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:25:29.928130 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:29.935403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching for a device in session 222 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:25:29.935593 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:25:29.942843 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.942843 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.942843 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.942843 np0000001643 nova-compute[98269]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.942843 np0000001643 nova-compute[98269]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.942843 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:29.943004 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.943004 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:29.943004 np0000001643 nova-compute[98269]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e130b12-587a-4983-bb26-36ffa1c9bf9b (non-flash)
May 28 14:25:29.943004 np0000001643 nova-compute[98269]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.943004 np0000001643 nova-compute[98269]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:29.943004 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:29.943209 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:29.943313 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:25:29.943927 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] HCTL ('11', '-', '-', 0) found on session 223 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:25:29.944022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:25:29.959823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching for a device in session 223 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:25:29.959823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:25:29.991864 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:30.060467 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:30.787265 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 14:25:31.801932 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Found WWN 330000000458031c4 for multipath device dm-3 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:25:31.801932 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:31.803212 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000458031c4', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000458031c4'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:25:31.803212 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000458031c4', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000458031c4'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:25:31.804765 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:25:31.804969 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:25:31.805136 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:25:31.818480 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:25:31.818480 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:25:31.818480 np0000001643 nova-compute[98269]:     <volume>b796e217-386a-4991-9a23-cb58245fcb25</volume>
May 28 14:25:31.818480 np0000001643 nova-compute[98269]:   </usage>
May 28 14:25:31.818480 np0000001643 nova-compute[98269]: </secret>
May 28 14:25:31.818480 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:25:31.824368 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'flavor' on Instance uuid 0fa3c2aa-266c-468f-8574-b6061e75b586 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:25:32.328041 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Attempting to attach volume b796e217-386a-4991-9a23-cb58245fcb25 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98269) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 14:25:32.329647 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] attach device xml: <disk type="block" device="disk">
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:   <alias name="ua-b796e217-386a-4991-9a23-cb58245fcb25"/>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:   <serial>b796e217-386a-4991-9a23-cb58245fcb25</serial>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="33b23e8c-5a42-4182-a467-f700b6fcfef7"/>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]: </disk>
May 28 14:25:32.329647 np0000001643 nova-compute[98269]:  {{(pid=98269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 14:25:34.928496 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:25:34.928938 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:25:34.928938 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:25:34.928938 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No VIF found with MAC fa:16:3e:3c:5c:19, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:25:34.993270 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:35.064265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:36.470391 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-87d6bd74-16a5-45ed-b684-4ad8d6473872 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.421s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:36.890824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:36.891005 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:37.393271 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Detaching volume b796e217-386a-4991-9a23-cb58245fcb25
May 28 14:25:37.428960 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Attempting to driver detach volume b796e217-386a-4991-9a23-cb58245fcb25 from mountpoint /dev/vdb
May 28 14:25:37.457041 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '0fa3c2aa-266c-468f-8574-b6061e75b586', 'attached_at': '', 'detached_at': '', 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'serial': 'b796e217-386a-4991-9a23-cb58245fcb25'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:25:37.460308 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Found disk vdb by alias ua-b796e217-386a-4991-9a23-cb58245fcb25 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:25:37.461462 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Found disk vdb by alias ua-b796e217-386a-4991-9a23-cb58245fcb25 {{(pid=98269) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 14:25:37.461594 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Attempting to detach device vdb from instance 0fa3c2aa-266c-468f-8574-b6061e75b586 from the persistent domain config. {{(pid=98269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 14:25:37.461811 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   <alias name="ua-b796e217-386a-4991-9a23-cb58245fcb25"/>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   <serial>b796e217-386a-4991-9a23-cb58245fcb25</serial>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="33b23e8c-5a42-4182-a467-f700b6fcfef7"/>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]: </disk>
May 28 14:25:37.461811 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:25:37.467870 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully detached device vdb from instance 0fa3c2aa-266c-468f-8574-b6061e75b586 from the persistent domain config.
May 28 14:25:37.468046 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] (1/8): Attempting to detach device vdb with device alias ua-b796e217-386a-4991-9a23-cb58245fcb25 from instance 0fa3c2aa-266c-468f-8574-b6061e75b586 from the live domain config. {{(pid=98269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 14:25:37.468257 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.guest [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] detach device xml: <disk type="block" device="disk">
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   <alias name="ua-b796e217-386a-4991-9a23-cb58245fcb25"/>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   <target dev="vdb" bus="virtio"/>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   <serial>b796e217-386a-4991-9a23-cb58245fcb25</serial>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   <encryption format="luks">
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:     <secret type="passphrase" uuid="33b23e8c-5a42-4182-a467-f700b6fcfef7"/>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:   </encryption>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]: </disk>
May 28 14:25:37.468257 np0000001643 nova-compute[98269]:  {{(pid=98269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 14:25:37.927327 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Received event <DeviceRemovedEvent: 1779978337.9269638, 0fa3c2aa-266c-468f-8574-b6061e75b586 => ua-b796e217-386a-4991-9a23-cb58245fcb25> from libvirt while the driver is waiting for it; dispatched. {{(pid=98269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 14:25:37.928107 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b796e217-386a-4991-9a23-cb58245fcb25 for instance 0fa3c2aa-266c-468f-8574-b6061e75b586 {{(pid=98269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 14:25:37.930123 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully detached device vdb from instance 0fa3c2aa-266c-468f-8574-b6061e75b586 from the live domain config.
May 28 14:25:37.932105 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:25:37.932351 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:25:37.932567 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:37.932977 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:37.933220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b796e217-386a-4991-9a23-cb58245fcb25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:25:37.933331 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:25:37.955613 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:37.955613 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:37.955613 np0000001643 nova-compute[98269]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:37.955613 np0000001643 nova-compute[98269]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:37.955613 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:37.955842 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:37.955842 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:37.955842 np0000001643 nova-compute[98269]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:37.955842 np0000001643 nova-compute[98269]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25 (non-flash)
May 28 14:25:37.955842 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:37.955842 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', '223')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:25:37.955989 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', '222')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:25:37.956607 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25', '223')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:25:37.957176 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7801e8860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'): ({'sdf'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:25:37.957342 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Removing multipathed devices sdf, sde {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:25:37.957570 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flush multipath device 330000000458031c4 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:25:37.987678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:25:38.021878 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:25:38.062918 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:25:38.063094 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:25:38.064212 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:25:38.074730 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:25:38.074918 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:25:38.085067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:38.111327 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.40.100,3260]
May 28 14:25:38.111327 np0000001643 nova-compute[98269]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.40.100,3260] successful.
May 28 14:25:38.111327 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:38.123431 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:38.134155 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:38.159383 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.50.100,3260]
May 28 14:25:38.159383 np0000001643 nova-compute[98269]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-b796e217-386a-4991-9a23-cb58245fcb25, portal: 192.168.50.100,3260] successful.
May 28 14:25:38.159383 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:38.173771 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:38.174777 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.242s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:38.174881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== disconnect_volume: return (242ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:25:38.175028 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:25:38.726827 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'flavor' on Instance uuid 0fa3c2aa-266c-468f-8574-b6061e75b586 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:25:39.731714 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-589ed68d-2e21-44e5-9324-175a4f12fe5f tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.841s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:39.826909 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:39.827262 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:25:40.002155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.065460 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.134716 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:40.134947 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:40.135141 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:40.135280 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:40.135390 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:40.137748 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Terminating instance
May 28 14:25:40.640455 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:25:40.656272 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.657977 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.673698 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.676466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.689757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.695260 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.782840 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fb1d5c5-a3da-482b-87ef-c67c0951a87a req-ded54cb4-7ab3-4b92-ae17-a1ba0963cfeb service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-vif-unplugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:40.783266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fb1d5c5-a3da-482b-87ef-c67c0951a87a req-ded54cb4-7ab3-4b92-ae17-a1ba0963cfeb service nova] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:40.783344 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fb1d5c5-a3da-482b-87ef-c67c0951a87a req-ded54cb4-7ab3-4b92-ae17-a1ba0963cfeb service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:40.783483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-4fb1d5c5-a3da-482b-87ef-c67c0951a87a req-ded54cb4-7ab3-4b92-ae17-a1ba0963cfeb service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:40.783670 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fb1d5c5-a3da-482b-87ef-c67c0951a87a req-ded54cb4-7ab3-4b92-ae17-a1ba0963cfeb service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] No waiting events found dispatching network-vif-unplugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:25:40.783792 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fb1d5c5-a3da-482b-87ef-c67c0951a87a req-ded54cb4-7ab3-4b92-ae17-a1ba0963cfeb service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-vif-unplugged-74a34395-040e-43b5-a62f-615eb039a9e9 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:25:40.826901 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:40.827107 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:25:40.827281 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:40.936895 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.942999 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:40.970528 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999731698000232 future=<Future at 0x71a75c1dcd10 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:40.970940 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999224708999918 future=<Future at 0x71a75c1dcd10 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:40.971109 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999023472999852 future=<Future at 0x71a75c1dcd10 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:40.972647 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Instance destroyed successfully.
May 28 14:25:40.973535 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'resources' on Instance uuid 0fa3c2aa-266c-468f-8574-b6061e75b586 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:25:41.332340 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:41.332580 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:41.332732 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:41.332903 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:25:41.476099 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-28696357',display_name='tempest-TestEncryptedCinderVolumes-server-28696357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-28696357',id=79,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrM9eduAsk72kW5g3SQFb1fmTcCHmZZnc1qM7p120jL0OsbzaLUSQHfX7ljPlNcJMcY4HHi/yRIovM42Gf2IIj9UUCQ5NAfUdyWXRljbUFyzfMijHebvP1ZJtRfz+NWmA==',key_name='tempest-keypair-2047400690',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:24:47Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-uxpcka59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b24afd65ee7940c29ab00493368e2417',uuid=0fa3c2aa-266c-468f-8574-b6061e75b586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:25:41.476370 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "74a34395-040e-43b5-a62f-615eb039a9e9", "address": "fa:16:3e:3c:5c:19", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a34395-04", "ovs_interfaceid": "74a34395-040e-43b5-a62f-615eb039a9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:25:41.477090 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=74a34395-040e-43b5-a62f-615eb039a9e9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a34395-04') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:25:41.477592 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=74a34395-040e-43b5-a62f-615eb039a9e9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a34395-04') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:25:41.479195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:41.479376 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74a34395-04, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:41.480278 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:41.480977 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:41.481296 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:41.481997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:41.482109 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cea8930b-820e-455b-84dd-bb51de38fa3c) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:41.482534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:41.482923 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:41.483352 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:41.485224 np0000001643 nova-compute[98269]: INFO os_vif [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=74a34395-040e-43b5-a62f-615eb039a9e9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a34395-04')
May 28 14:25:41.485612 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Deleting instance files /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586_del
May 28 14:25:41.486603 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Deletion of /opt/stack/data/nova/instances/0fa3c2aa-266c-468f-8574-b6061e75b586_del complete
May 28 14:25:41.993952 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 14:25:41.994678 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:25:41.995057 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:25:41.995237 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:25:41.996047 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:42.114115 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:25:42.351709 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Error from libvirt while getting description of instance-0000004f: [Error Code 42] Domain not found: no domain with matching uuid '0fa3c2aa-266c-468f-8574-b6061e75b586' (instance-0000004f): libvirt.libvirtError: Domain not found: no domain with matching uuid '0fa3c2aa-266c-468f-8574-b6061e75b586' (instance-0000004f)
May 28 14:25:42.353777 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:42.456619 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:42.457171 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk --force-share --output=json {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:42.526998 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1dfb7439-a32b-4104-9af7-fc350b14f240 req-cd211ffc-04b7-46ac-8b20-02832455d200 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-vif-deleted-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:42.527428 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-1dfb7439-a32b-4104-9af7-fc350b14f240 req-cd211ffc-04b7-46ac-8b20-02832455d200 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Neutron deleted interface 74a34395-040e-43b5-a62f-615eb039a9e9; detaching it from the instance and deleting it from the info cache
May 28 14:25:42.530204 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1dfb7439-a32b-4104-9af7-fc350b14f240 req-cd211ffc-04b7-46ac-8b20-02832455d200 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Detach interface failed, port_id=74a34395-040e-43b5-a62f-615eb039a9e9, reason: Instance 0fa3c2aa-266c-468f-8574-b6061e75b586 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:25:42.545741 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:42.546101 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:25:42.548562 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:25:42.549563 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:25:42.596709 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:25:42.597389 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=13503MB free_disk=72.61027145385742GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:25:42.597663 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:42.597839 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:42.837529 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5a5d9a01-e8ef-4f57-8765-6e76d0ad6966 req-8dfce7f5-63ae-4337-8103-098871827e59 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-vif-unplugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:42.837977 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5a5d9a01-e8ef-4f57-8765-6e76d0ad6966 req-8dfce7f5-63ae-4337-8103-098871827e59 service nova] Acquiring lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:42.838194 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5a5d9a01-e8ef-4f57-8765-6e76d0ad6966 req-8dfce7f5-63ae-4337-8103-098871827e59 service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:42.838366 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-5a5d9a01-e8ef-4f57-8765-6e76d0ad6966 req-8dfce7f5-63ae-4337-8103-098871827e59 service nova] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:42.838556 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5a5d9a01-e8ef-4f57-8765-6e76d0ad6966 req-8dfce7f5-63ae-4337-8103-098871827e59 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] No waiting events found dispatching network-vif-unplugged-74a34395-040e-43b5-a62f-615eb039a9e9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:25:42.838720 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-5a5d9a01-e8ef-4f57-8765-6e76d0ad6966 req-8dfce7f5-63ae-4337-8103-098871827e59 service nova] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Received event network-vif-unplugged-74a34395-040e-43b5-a62f-615eb039a9e9 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:25:42.975024 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:25:43.477032 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Took 1.48 seconds to deallocate network for instance.
May 28 14:25:43.668237 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 0fa3c2aa-266c-468f-8574-b6061e75b586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:25:43.668597 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance ecde64c7-09ae-4603-9c99-27aff39db163 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:25:43.668597 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:25:43.668922 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:25:42 up 52 min,  2 users,  load average: 2.34, 3.48, 4.02\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_21c8ab14764c4724ba1e8a0678911782': '1', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_6bbeafad41ae4c0696b9aaf07b5e21b2': '1'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:25:43.803515 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:25:43.803780 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:25:43.983398 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:44.306380 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:25:44.812561 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:25:44.812976 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.215s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:44.812976 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.830s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:44.813222 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:25:44.949917 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:25:44.950083 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:25:45.066789 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:45.452536 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:25:45.958039 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.145s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:46.004648 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Deleted allocations for instance 0fa3c2aa-266c-468f-8574-b6061e75b586
May 28 14:25:46.483705 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:46.813400 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:46.813669 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:46.813908 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:46.814147 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:25:47.012266 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-7c70546d-9ab8-4daf-b8ed-a35b3f115291 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "0fa3c2aa-266c-468f-8574-b6061e75b586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.877s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:47.768852 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:47.827124 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:47.827579 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:25:49.823315 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:25:49.823802 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:25:50.067203 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:51.485088 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:55.970685 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00048448699999426026 future=<Future at 0x71a75c1dcd10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:55.971692 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Emitting event <LifecycleEvent: 1779978340.9700592, 0fa3c2aa-266c-468f-8574-b6061e75b586 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:25:55.971951 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:55.972266 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] VM Stopped (Lifecycle Event)
May 28 14:25:56.475123 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5e03e9f2-bebe-4683-9170-f23c7af1e36d tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: 0fa3c2aa-266c-468f-8574-b6061e75b586] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:25:56.486212 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.053458 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:58.053906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:58.053906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:58.053906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:58.054023 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:58.055902 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Terminating instance
May 28 14:25:58.559346 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:25:58.577384 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.580900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.593616 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.601591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.620312 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.710778 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f37d4d-fc01-4f5e-a1f6-e4a496716ce3 req-cec117b4-d928-4c08-899b-954056f83a7f service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-vif-unplugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:25:58.710995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f37d4d-fc01-4f5e-a1f6-e4a496716ce3 req-cec117b4-d928-4c08-899b-954056f83a7f service nova] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:25:58.710995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f37d4d-fc01-4f5e-a1f6-e4a496716ce3 req-cec117b4-d928-4c08-899b-954056f83a7f service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:25:58.711164 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b9f37d4d-fc01-4f5e-a1f6-e4a496716ce3 req-cec117b4-d928-4c08-899b-954056f83a7f service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:25:58.711264 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f37d4d-fc01-4f5e-a1f6-e4a496716ce3 req-cec117b4-d928-4c08-899b-954056f83a7f service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] No waiting events found dispatching network-vif-unplugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:25:58.711335 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b9f37d4d-fc01-4f5e-a1f6-e4a496716ce3 req-cec117b4-d928-4c08-899b-954056f83a7f service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-vif-unplugged-c21cca62-6c99-4b73-95a7-7a1896af0562 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:25:58.841020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.846593 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:58.875989 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999663459999738 future=<Future at 0x71a75c216ab0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:58.875989 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.99944855800004 future=<Future at 0x71a75c216ab0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:58.876176 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999357088000124 future=<Future at 0x71a75c216ab0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:25:58.877216 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Instance destroyed successfully.
May 28 14:25:58.877805 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lazy-loading 'resources' on Instance uuid ecde64c7-09ae-4603-9c99-27aff39db163 {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:25:59.379961 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-1426325758',display_name='tempest-instance-1426325758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-instance-1426325758',id=80,image_ref='ad923155-4eca-4cf1-b871-662172c18500',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTSdbEzUO74MI87eJfCqw3qfMmi/RlJx3SR7BZqqBlse3bIWzNwjwqmiN8DaaDZwcRBMxDGJiz4j+ZqQYebM+nv2zsI38wbR5b4N7psYcGmgR8hU86msggVzlxEaDSY9g==',key_name='tempest-keypair-875244913',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:25:19Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21c8ab14764c4724ba1e8a0678911782',ramdisk_id='',reservation_id='r-1o9ccjl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ad923155-4eca-4cf1-b871-662172c18500',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-109734936',owner_user_name='tempest-VolumesBackupsTest-109734936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6684870edb4241b78d25362d8e7d852a',uuid=ecde64c7-09ae-4603-9c99-27aff39db163,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:25:59.380547 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Converting VIF {"id": "c21cca62-6c99-4b73-95a7-7a1896af0562", "address": "fa:16:3e:f9:72:8a", "network": {"id": "b1532790-c66d-48f3-9246-4dfb84c7e8e1", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1556168312-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21c8ab14764c4724ba1e8a0678911782", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21cca62-6c", "ovs_interfaceid": "c21cca62-6c99-4b73-95a7-7a1896af0562", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:25:59.380667 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:72:8a,bridge_name='br-int',has_traffic_filtering=True,id=c21cca62-6c99-4b73-95a7-7a1896af0562,network=Network(b1532790-c66d-48f3-9246-4dfb84c7e8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21cca62-6c') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:25:59.380907 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:72:8a,bridge_name='br-int',has_traffic_filtering=True,id=c21cca62-6c99-4b73-95a7-7a1896af0562,network=Network(b1532790-c66d-48f3-9246-4dfb84c7e8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21cca62-6c') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:25:59.382660 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:59.382956 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc21cca62-6c, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:59.395667 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:59.396783 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:59.396894 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:59.397591 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:59.397764 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=351c9043-3556-4893-a2e4-628c4b53b548) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:25:59.398730 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:25:59.398825 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:25:59.400481 np0000001643 nova-compute[98269]: INFO os_vif [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:72:8a,bridge_name='br-int',has_traffic_filtering=True,id=c21cca62-6c99-4b73-95a7-7a1896af0562,network=Network(b1532790-c66d-48f3-9246-4dfb84c7e8e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21cca62-6c')
May 28 14:25:59.401889 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:25:59.402301 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:25:59.402495 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:25:59.402937 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:25:59.403309 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:25:59.403540 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:25:59.425370 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:59.425370 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:59.425370 np0000001643 nova-compute[98269]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:25:59.425370 np0000001643 nova-compute[98269]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:25:59.425370 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:25:59.425618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:59.425618 np0000001643 nova-compute[98269]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc (non-flash)
May 28 14:25:59.425618 np0000001643 nova-compute[98269]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:25:59.425618 np0000001643 nova-compute[98269]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:25:59.425618 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:25:59.425618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', '224'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', '225')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:25:59.425809 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', '219')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:25:59.426612 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc', '220')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:25:59.427220 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c173c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:25:59.427391 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:25:59.427616 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Flush multipath device 3300000004259ff46 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:25:59.477720 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:25:59.520900 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:25:59.561748 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:25:59.561882 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:25:59.562590 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:25:59.573186 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:25:59.573579 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:25:59.583312 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:59.613067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.40.100,3260]
May 28 14:25:59.613067 np0000001643 nova-compute[98269]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.40.100,3260] successful.
May 28 14:25:59.613067 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:59.627067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:59.637420 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:59.666110 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.50.100,3260]
May 28 14:25:59.666110 np0000001643 nova-compute[98269]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-455fa5fb-1e4a-4b0f-a358-9266ef6e19cc, portal: 192.168.50.100,3260] successful.
May 28 14:25:59.666110 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:59.676819 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:25:59.677022 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:25:59.677131 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] <== disconnect_volume: return (274ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:25:59.677244 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:25:59.677492 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Deleting instance files /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163_del
May 28 14:25:59.678121 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Deletion of /opt/stack/data/nova/instances/ecde64c7-09ae-4603-9c99-27aff39db163_del complete
May 28 14:26:00.069503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:00.183472 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Took 1.62 seconds to destroy the instance on the hypervisor.
May 28 14:26:00.183859 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:26:00.184015 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:26:00.184102 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:26:00.184350 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:00.267610 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:00.761937 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-vif-unplugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:26:00.762443 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] Acquiring lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:00.762637 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:00.762637 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] Lock "ecde64c7-09ae-4603-9c99-27aff39db163-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:00.762785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] No waiting events found dispatching network-vif-unplugged-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:26:00.762890 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-vif-unplugged-c21cca62-6c99-4b73-95a7-7a1896af0562 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:26:00.762984 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Received event network-vif-deleted-c21cca62-6c99-4b73-95a7-7a1896af0562 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:26:00.763091 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Neutron deleted interface c21cca62-6c99-4b73-95a7-7a1896af0562; detaching it from the instance and deleting it from the info cache
May 28 14:26:00.764624 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-b0f8e53b-0a4b-444a-8168-c0c6566e573c req-e2cb9d60-0230-475e-bf2e-e49a27cbd4c7 service nova] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Detach interface failed, port_id=c21cca62-6c99-4b73-95a7-7a1896af0562, reason: Instance ecde64c7-09ae-4603-9c99-27aff39db163 could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:26:01.114974 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:26:01.616782 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Took 1.43 seconds to deallocate network for instance.
May 28 14:26:02.161412 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Took 0.54 seconds to detach 1 volumes for instance.
May 28 14:26:02.666460 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:02.666583 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:02.754613 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:26:02.754873 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:26:03.257381 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:26:03.763060 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.096s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:03.812955 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Deleted allocations for instance ecde64c7-09ae-4603-9c99-27aff39db163
May 28 14:26:04.398948 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:04.821206 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-5d0537c2-8642-4cc6-802e-f923e302bff2 tempest-VolumesBackupsTest-109734936 tempest-VolumesBackupsTest-109734936-project-member] Lock "ecde64c7-09ae-4603-9c99-27aff39db163" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.768s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:08.397490 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:08.397889 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:08.899309 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:26:09.400018 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:26:09.443661 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:09.444113 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:09.447943 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:26:09.448119 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Claim successful on node np0000001643
May 28 14:26:10.549845 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:26:10.550287 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:26:11.052585 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:26:11.560086 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.116s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:11.560573 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:26:12.066692 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:26:12.067416 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:26:12.067696 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:12.067922 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:12.135263 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b24afd65ee7940c29ab00493368e2417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbeafad41ae4c0696b9aaf07b5e21b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:26:12.523147 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Successfully created port: 2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:26:12.571137 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:26:12.955059 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Successfully updated port: 2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:26:13.001465 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-changed-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:26:13.001806 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Refreshing instance network info cache due to event network-changed-2b039e25-0bf0-4d33-bff6-41be30b79bf9. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:26:13.001975 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] Acquiring lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:26:13.002080 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] Acquired lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:26:13.002293 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Refreshing network info cache for port 2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:26:13.075221 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:26:13.458017 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:26:13.504856 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:13.576728 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:26:13.579942 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Booting with volume 3661813d-e086-438d-9d16-7cb1eb9419b4 at /dev/vda
May 28 14:26:13.618273 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:26:13.628267 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:26:13.651490 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:26:13.692928 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:26:13.693199 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:26:13.701883 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:26:13.702653 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044'] 
May 28 14:26:13.702848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:26:13.702977 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:26:13.703164 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:26:13.703373 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Updating existing volume attachment record: e9875ffb-1fc2-4a6d-b2ba-09adea1c2be0 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:26:13.732364 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:26:13.875943 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.0004198440001346171 future=<Future at 0x71a75c216ab0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:26:13.876382 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978358.8753333, ecde64c7-09ae-4603-9c99-27aff39db163 => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:26:13.876572 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:26:13.876746 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] VM Stopped (Lifecycle Event)
May 28 14:26:14.235056 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-8161936a-e247-4a2a-b8b1-e3a07c129f11 req-141c3d7d-cf94-497c-b761-6d6712e20022 service nova] Releasing lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:26:14.235520 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquired lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:26:14.235688 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:26:14.379270 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-e9c6c2cf-d764-4726-9e89-0b4d42392477 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: ecde64c7-09ae-4603-9c99-27aff39db163] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:26:14.402464 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:14.794800 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:26:14.925044 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:15.040939 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Updating instance_info_cache with network_info: [{"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:26:15.542778 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Releasing lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:26:15.543098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Instance network_info: |[{"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:26:15.791088 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:26:15.792231 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:26:15.792543 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Creating image(s)
May 28 14:26:15.793209 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:26:15.793209 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Ensure instance console log exists: /opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:26:15.793540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:15.793794 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:15.794002 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:15.794629 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Start _get_guest_xml network_info=[{"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'e9875ffb-1fc2-4a6d-b2ba-09adea1c2be0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '89413fe5-bd1e-4dac-ab71-c5c4bdb1807e', 'attached_at': '', 'detached_at': '', 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'serial': '3661813d-e086-438d-9d16-7cb1eb9419b4'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:26:15.797966 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:26:15.798956 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1410755162', uuid='89413fe5-bd1e-4dac-ab71-c5c4bdb1807e'), owner=OwnerMeta(userid='b24afd65ee7940c29ab00493368e2417', username='tempest-TestEncryptedCinderVolumes-373548889-project-member', projectid='6bbeafad41ae4c0696b9aaf07b5e21b2', projectname='tempest-TestEncryptedCinderVolumes-373548889'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978375.7986603) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:26:15.800190 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:26:15.800552 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:26:15.801532 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:26:15.801697 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:26:15.802692 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:26:15.802953 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:26:15.803084 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:26:15.803173 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:26:15.803288 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:26:15.803364 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:26:15.803472 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:26:15.803695 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:26:15.804006 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:26:15.804082 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:26:15.804155 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:26:15.804265 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:26:15.817164 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:26:15.817487 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:26:15.817622 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:26:15.817948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:26:15.818111 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:26:15.829274 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:26:15.829647 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:26:15.829870 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:26:15.830364 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:26:15.830823 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:26:15.830982 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:26:15.839864 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:26:15.839864 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:15.844745 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:26:15.844745 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:15.851662 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4] added
May 28 14:26:15.851662 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:26:15.851662 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:26:15.851662 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:26:15.851662 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:26:15.851662 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:26:15.851662 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:15.851953 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:26:15.851953 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0221(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:26:15.852115 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:26:15.855312 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4] added
May 28 14:26:15.855312 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:26:15.855312 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:26:15.855312 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:26:15.855312 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:26:15.855312 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:26:15.855312 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:15.855518 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:26:15.855622 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:26:15.855742 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:26:16.852529 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:26:16.856134 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:26:16.864811 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:26:16.864811 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:26:16.869672 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:26:16.869672 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:16.876028 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:16.883067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:16.886900 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:26:16.886900 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:26:16.886997 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:26:16.886997 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:26:16.887099 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:26:16.887099 np0000001643 nova-compute[98269]: 
May 28 14:26:16.894616 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:26:16.894616 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:26:16.894768 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:26:16.894768 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:26:16.894917 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:26:16.894917 np0000001643 nova-compute[98269]: 
May 28 14:26:16.910966 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.40.100,3260]
May 28 14:26:16.910966 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.40.100,3260] successful.
May 28 14:26:16.910966 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:16.921599 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:16.933375 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:26:16.933375 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:26:16.933543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:26:16.933543 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:26:16.933815 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.104s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:26:16.933988 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:26:16.934395 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] HCTL ('7', '-', '-', 0) found on session 227 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:26:16.934523 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:26:16.949413 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching for a device in session 227 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:26:16.949413 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:26:17.922738 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.50.100,3260]
May 28 14:26:17.922738 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.50.100,3260] successful.
May 28 14:26:17.922738 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:17.936512 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:26:17.948170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:26:17.948170 np0000001643 nova-compute[98269]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:26:17.948170 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:26:17.948170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:26:17.948170 np0000001643 nova-compute[98269]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:26:17.948170 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:26:17.948170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.117s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:26:17.948170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:26:17.948747 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] HCTL ('8', '-', '-', 0) found on session 228 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:26:17.948925 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:26:17.961363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching for a device in session 228 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:26:17.961363 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:26:18.846700 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Found WWN 33000000008ddc327 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:26:18.847001 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:26:18.848102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000008ddc327', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000008ddc327'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:26:18.848239 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000008ddc327', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000008ddc327'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:26:18.877720 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '89413fe5-bd1e-4dac-ab71-c5c4bdb1807e', 'attached_at': '', 'detached_at': '', 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'serial': '3661813d-e086-438d-9d16-7cb1eb9419b4'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:26:18.878157 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:26:18.878343 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:26:18.878521 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:26:18.892751 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:26:18.892751 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:26:18.892751 np0000001643 nova-compute[98269]:     <volume>3661813d-e086-438d-9d16-7cb1eb9419b4</volume>
May 28 14:26:18.892751 np0000001643 nova-compute[98269]:   </usage>
May 28 14:26:18.892751 np0000001643 nova-compute[98269]: </secret>
May 28 14:26:18.892751 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:26:19.400165 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1410755162',display_name='tempest-TestEncryptedCinderVolumes-server-1410755162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1410755162',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgyueuyA0Ov/KsnzDbAyYg3w44E6zk3fd4WxOvLapcDPYWvuXWiZUthJfz5NBsCyrT+aXRdtD7yYca+A5/MDKo4Tb5SRzv+eRH3/z+u2JVphjATjhT1RHCgLbcDu3n7Q==',key_name='tempest-TestEncryptedCinderVolumes-404173636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-mees62tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:26:13Z,user_data=None,user_id='b24afd65ee7940c29ab00493368e2417',uuid=89413fe5-bd1e-4dac-ab71-c5c4bdb1807e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:26:19.400614 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:26:19.401031 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=2b039e25-0bf0-4d33-bff6-41be30b79bf9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b039e25-0b') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:26:19.402022 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'pci_devices' on Instance uuid 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:26:19.408195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:26:19.408195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:26:19.408195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:26:19.408195 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:26:19.414477 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:19.415087 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:26:19.905874 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] End _get_guest_xml xml=<domain type="qemu">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <uuid>89413fe5-bd1e-4dac-ab71-c5c4bdb1807e</uuid>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <name>instance-00000051</name>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1410755162</nova:name>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:26:15</nova:creationTime>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:user uuid="b24afd65ee7940c29ab00493368e2417">tempest-TestEncryptedCinderVolumes-373548889-project-member</nova:user>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:project uuid="6bbeafad41ae4c0696b9aaf07b5e21b2">tempest-TestEncryptedCinderVolumes-373548889</nova:project>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <nova:port uuid="2b039e25-0bf0-4d33-bff6-41be30b79bf9">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <system>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <entry name="serial">89413fe5-bd1e-4dac-ab71-c5c4bdb1807e</entry>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <entry name="uuid">89413fe5-bd1e-4dac-ab71-c5c4bdb1807e</entry>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </system>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <os>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   </os>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <features>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   </features>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   <devices>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e/disk.config"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </disk>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <alias name="ua-3661813d-e086-438d-9d16-7cb1eb9419b4"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <serial>3661813d-e086-438d-9d16-7cb1eb9419b4</serial>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <encryption format="luks">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:         <secret type="passphrase" uuid="6ce0ce0e-5d13-40a4-a352-fea16e2373b3"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       </encryption>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </disk>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:9f:c9:07"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <target dev="tap2b039e25-0b"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </interface>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e/console.log" append="off"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </serial>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <video>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </video>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </rng>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:   </devices>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]: </domain>
May 28 14:26:19.905874 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:26:19.908698 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Preparing to wait for external event network-vif-plugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:26:19.908698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:19.908698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:19.908698 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:19.908698 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1410755162',display_name='tempest-TestEncryptedCinderVolumes-server-1410755162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1410755162',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgyueuyA0Ov/KsnzDbAyYg3w44E6zk3fd4WxOvLapcDPYWvuXWiZUthJfz5NBsCyrT+aXRdtD7yYca+A5/MDKo4Tb5SRzv+eRH3/z+u2JVphjATjhT1RHCgLbcDu3n7Q==',key_name='tempest-TestEncryptedCinderVolumes-404173636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-mees62tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:26:13Z,user_data=None,user_id='b24afd65ee7940c29ab00493368e2417',uuid=89413fe5-bd1e-4dac-ab71-c5c4bdb1807e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:26:19.908698 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:26:19.908698 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=2b039e25-0bf0-4d33-bff6-41be30b79bf9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b039e25-0b') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:26:19.909152 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=2b039e25-0bf0-4d33-bff6-41be30b79bf9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b039e25-0b') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:26:19.909301 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:19.909650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:26:19.909978 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:26:19.910776 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:19.911056 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'deae75fa-682f-560c-a8d6-409485020535', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:26:19.911992 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:19.912887 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:26:19.914768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:19.914972 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b039e25-0b, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:26:19.915304 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b039e25-0b, col_values=(('qos', UUID('1ab60dc0-eb34-482d-8675-350c969d2b3c')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:26:19.915519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b039e25-0b, col_values=(('external_ids', {'iface-id': '2b039e25-0bf0-4d33-bff6-41be30b79bf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:c9:07', 'vm-uuid': '89413fe5-bd1e-4dac-ab71-c5c4bdb1807e'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:26:19.916192 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:19.917267 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:26:19.921556 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:19.922755 np0000001643 nova-compute[98269]: INFO os_vif [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=2b039e25-0bf0-4d33-bff6-41be30b79bf9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b039e25-0b')
May 28 14:26:21.437684 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:26:21.438106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:26:21.438106 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No VIF found with MAC fa:16:3e:9f:c9:07, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:26:21.438543 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Using config drive
May 28 14:26:21.943908 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:22.076512 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Creating config drive at /opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e/disk.config
May 28 14:26:22.081061 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzx7l_wf {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:26:22.138132 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzx7l_wf" returned: 0 in 0.057s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:26:22.506781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.526500 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.608181 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.614026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.667132 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0fdb26ab-6b1c-40f2-a3c8-76004113f64e req-a3f168d8-00bd-4298-871f-d032ab9dc836 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-vif-plugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:26:22.667364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fdb26ab-6b1c-40f2-a3c8-76004113f64e req-a3f168d8-00bd-4298-871f-d032ab9dc836 service nova] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:22.667483 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fdb26ab-6b1c-40f2-a3c8-76004113f64e req-a3f168d8-00bd-4298-871f-d032ab9dc836 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:22.667615 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0fdb26ab-6b1c-40f2-a3c8-76004113f64e req-a3f168d8-00bd-4298-871f-d032ab9dc836 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:22.667717 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0fdb26ab-6b1c-40f2-a3c8-76004113f64e req-a3f168d8-00bd-4298-871f-d032ab9dc836 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Processing event network-vif-plugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:26:22.804948 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.805717 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.808522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.809503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:22.825306 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:24.292865 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978384.2923813, 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:26:24.293401 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:26:24.293778 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] VM Started (Lifecycle Event)
May 28 14:26:24.295681 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:26:24.299003 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Instance spawned successfully.
May 28 14:26:24.300315 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:26:24.717824 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c3df09d-b603-475d-a885-914f654fbc1a req-7755bc76-2f8a-4fc7-9739-0e91470460b6 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-vif-plugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:26:24.718384 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c3df09d-b603-475d-a885-914f654fbc1a req-7755bc76-2f8a-4fc7-9739-0e91470460b6 service nova] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:24.718595 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c3df09d-b603-475d-a885-914f654fbc1a req-7755bc76-2f8a-4fc7-9739-0e91470460b6 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:24.718749 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-6c3df09d-b603-475d-a885-914f654fbc1a req-7755bc76-2f8a-4fc7-9739-0e91470460b6 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:24.718931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-6c3df09d-b603-475d-a885-914f654fbc1a req-7755bc76-2f8a-4fc7-9739-0e91470460b6 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] No waiting events found dispatching network-vif-plugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:26:24.719083 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-6c3df09d-b603-475d-a885-914f654fbc1a req-7755bc76-2f8a-4fc7-9739-0e91470460b6 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received unexpected event network-vif-plugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 for instance with vm_state building and task_state spawning.
May 28 14:26:24.797319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:26:24.799260 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:26:24.806522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:26:24.806522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:26:24.806522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:26:24.806522 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:26:24.806782 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:26:24.806995 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:26:24.916848 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:25.073144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:25.301882 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:26:25.302271 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978385.3019776, 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:26:25.302271 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] VM Paused (Lifecycle Event)
May 28 14:26:25.312146 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Took 9.52 seconds to spawn the instance on the hypervisor.
May 28 14:26:25.312335 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:26:25.804529 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:26:25.806618 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978385.8063648, 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:26:25.806762 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] VM Resumed (Lifecycle Event)
May 28 14:26:25.821801 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Took 16.42 seconds to build instance.
May 28 14:26:26.309023 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:26:26.311119 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:26:26.323198 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-1ebb8ef9-a5ea-4d50-a8be-e196ce779741 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.925s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:27.658664 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-changed-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:26:27.661612 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Refreshing instance network info cache due to event network-changed-2b039e25-0bf0-4d33-bff6-41be30b79bf9. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:26:27.661793 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] Acquiring lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:26:27.661884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] Acquired lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:26:27.662093 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Refreshing network info cache for port 2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:26:28.164036 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:28.461199 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:26:28.589871 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Updated VIF entry in instance network info cache for port 2b039e25-0bf0-4d33-bff6-41be30b79bf9. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:26:28.590127 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Updating instance_info_cache with network_info: [{"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:26:29.091836 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-93e42c3d-31d9-4609-b28e-cee773678492 req-61daef05-498c-48e2-b548-1a2ba0e2434c service nova] Releasing lock "refresh_cache-89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:26:29.918167 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:30.074250 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:34.919519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:35.075867 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:39.920625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:40.077740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:40.826944 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:40.827178 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:26:40.827303 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:41.331147 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:41.331694 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:41.331694 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:41.331820 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:26:42.053947 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:26:42.348102 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:26:42.349509 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:26:42.350191 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:26:42.393357 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:26:42.393873 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=13610MB free_disk=72.62547302246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:26:42.394001 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:26:42.394229 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:26:43.450617 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:26:43.450989 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:26:43.450989 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:26:42 up 53 min,  2 users,  load average: 1.45, 3.02, 3.83\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_6bbeafad41ae4c0696b9aaf07b5e21b2': '1', 'io_workload': '0'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:26:43.537268 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:26:43.537473 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:26:44.040085 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:26:44.546041 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:26:44.546481 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.152s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:26:44.546676 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:26:44.922486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:45.079603 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:45.546752 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:45.547166 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:45.547263 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:45.547529 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:45.547819 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.28 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:26:46.823964 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:46.824404 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:26:47.826943 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:47.827372 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:26:49.924243 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:50.080686 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:50.823170 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:26:50.823500 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:26:54.926422 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:55.081525 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:26:59.927616 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:04.755605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:04.755605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:04.755605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:04.755605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:04.755605 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:04.757774 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Terminating instance
May 28 14:27:04.929128 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.082495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.260766 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:27:05.276141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.277650 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.294049 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.311835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.312515 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.400428 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-44770f80-ab81-44ba-8607-0078f10d5ef3 req-d5bad3ad-b931-437e-a450-cbd8a2628198 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-vif-unplugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:27:05.400733 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-44770f80-ab81-44ba-8607-0078f10d5ef3 req-d5bad3ad-b931-437e-a450-cbd8a2628198 service nova] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:05.400933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-44770f80-ab81-44ba-8607-0078f10d5ef3 req-d5bad3ad-b931-437e-a450-cbd8a2628198 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:05.401077 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-44770f80-ab81-44ba-8607-0078f10d5ef3 req-d5bad3ad-b931-437e-a450-cbd8a2628198 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:05.401254 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-44770f80-ab81-44ba-8607-0078f10d5ef3 req-d5bad3ad-b931-437e-a450-cbd8a2628198 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] No waiting events found dispatching network-vif-unplugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:27:05.401409 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-44770f80-ab81-44ba-8607-0078f10d5ef3 req-d5bad3ad-b931-437e-a450-cbd8a2628198 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-vif-unplugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:27:05.468527 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.569826 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.578370 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:05.606332 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999612535999859 future=<Future at 0x71a75c3cd5e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:27:05.606907 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999009187999945 future=<Future at 0x71a75c3cd5e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:27:05.607084 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998792824999782 future=<Future at 0x71a75c3cd5e0 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:27:05.614244 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Instance destroyed successfully.
May 28 14:27:05.614734 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'resources' on Instance uuid 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:27:06.117366 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1410755162',display_name='tempest-TestEncryptedCinderVolumes-server-1410755162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-1410755162',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgyueuyA0Ov/KsnzDbAyYg3w44E6zk3fd4WxOvLapcDPYWvuXWiZUthJfz5NBsCyrT+aXRdtD7yYca+A5/MDKo4Tb5SRzv+eRH3/z+u2JVphjATjhT1RHCgLbcDu3n7Q==',key_name='tempest-TestEncryptedCinderVolumes-404173636',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:26:25Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-mees62tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:26:25Z,user_data=None,user_id='b24afd65ee7940c29ab00493368e2417',uuid=89413fe5-bd1e-4dac-ab71-c5c4bdb1807e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:27:06.117975 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "address": "fa:16:3e:9f:c9:07", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b039e25-0b", "ovs_interfaceid": "2b039e25-0bf0-4d33-bff6-41be30b79bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:27:06.118373 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=2b039e25-0bf0-4d33-bff6-41be30b79bf9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b039e25-0b') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:27:06.118681 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=2b039e25-0bf0-4d33-bff6-41be30b79bf9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b039e25-0b') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:27:06.120374 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:06.120796 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b039e25-0b, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:27:06.121932 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:06.122944 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:06.123757 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:06.123943 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ab60dc0-eb34-482d-8675-350c969d2b3c) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:27:06.124438 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:06.125030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:27:06.126912 np0000001643 nova-compute[98269]: INFO os_vif [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=2b039e25-0bf0-4d33-bff6-41be30b79bf9,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b039e25-0b')
May 28 14:27:06.129866 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:27:06.130192 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:27:06.130463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:27:06.130906 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:27:06.131340 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3661813d-e086-438d-9d16-7cb1eb9419b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:27:06.131544 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:27:06.152531 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:27:06.152531 np0000001643 nova-compute[98269]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:27:06.152531 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:27:06.152711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:27:06.152711 np0000001643 nova-compute[98269]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4 (non-flash)
May 28 14:27:06.152711 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:27:06.152711 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', '228')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:27:06.152836 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', '227')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:27:06.153543 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4', '228')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:27:06.154077 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a75c302a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:27:06.154253 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:27:06.154463 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flush multipath device 33000000008ddc327 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:27:06.191562 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:27:06.232875 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:27:06.264652 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:27:06.264847 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:27:06.265441 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:27:06.276110 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:27:06.276291 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:27:06.286264 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:06.316287 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.40.100,3260]
May 28 14:27:06.316287 np0000001643 nova-compute[98269]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.40.100,3260] successful.
May 28 14:27:06.316287 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:06.327403 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:06.337423 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:06.365068 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.50.100,3260]
May 28 14:27:06.365068 np0000001643 nova-compute[98269]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-3661813d-e086-438d-9d16-7cb1eb9419b4, portal: 192.168.50.100,3260] successful.
May 28 14:27:06.365068 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:06.374778 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:06.375591 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:27:06.375721 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== disconnect_volume: return (245ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:27:06.375831 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:27:06.376076 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Deleting instance files /opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e_del
May 28 14:27:06.376566 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Deletion of /opt/stack/data/nova/instances/89413fe5-bd1e-4dac-ab71-c5c4bdb1807e_del complete
May 28 14:27:06.881978 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Took 1.62 seconds to destroy the instance on the hypervisor.
May 28 14:27:06.882572 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:27:06.883026 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:27:06.883182 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:27:06.883521 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:06.949281 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:07.324733 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc05cf6-0919-4cde-bb3f-74a7d75eb4f0 req-29e2fb4b-bf69-42fb-a969-3256e7e2f9fb service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-vif-deleted-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:27:07.325175 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-4fc05cf6-0919-4cde-bb3f-74a7d75eb4f0 req-29e2fb4b-bf69-42fb-a969-3256e7e2f9fb service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Neutron deleted interface 2b039e25-0bf0-4d33-bff6-41be30b79bf9; detaching it from the instance and deleting it from the info cache
May 28 14:27:07.326405 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-4fc05cf6-0919-4cde-bb3f-74a7d75eb4f0 req-29e2fb4b-bf69-42fb-a969-3256e7e2f9fb service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Detach interface failed, port_id=2b039e25-0bf0-4d33-bff6-41be30b79bf9, reason: Instance 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:27:07.458590 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f297784-063c-450f-b34c-b327c389a627 req-a0d085c8-c965-456b-8f92-9b6268edfe59 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-vif-unplugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:27:07.458940 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f297784-063c-450f-b34c-b327c389a627 req-a0d085c8-c965-456b-8f92-9b6268edfe59 service nova] Acquiring lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:07.459101 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f297784-063c-450f-b34c-b327c389a627 req-a0d085c8-c965-456b-8f92-9b6268edfe59 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:07.459278 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-7f297784-063c-450f-b34c-b327c389a627 req-a0d085c8-c965-456b-8f92-9b6268edfe59 service nova] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:07.459430 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f297784-063c-450f-b34c-b327c389a627 req-a0d085c8-c965-456b-8f92-9b6268edfe59 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] No waiting events found dispatching network-vif-unplugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:27:07.459697 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-7f297784-063c-450f-b34c-b327c389a627 req-a0d085c8-c965-456b-8f92-9b6268edfe59 service nova] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Received event network-vif-unplugged-2b039e25-0bf0-4d33-bff6-41be30b79bf9 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:27:07.780718 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:27:08.282418 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Took 1.40 seconds to deallocate network for instance.
May 28 14:27:08.832873 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:27:09.338611 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:09.338830 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:09.417004 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:27:09.417182 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:27:09.919699 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:27:10.427558 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.088s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:10.471077 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Deleted allocations for instance 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e
May 28 14:27:11.130586 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:27:11.131042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:27:11.131042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:27:11.131042 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:27:11.135897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:11.136069 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:27:11.480179 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-0f94d38f-ce38-4fda-b8b6-eb92f0806c50 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "89413fe5-bd1e-4dac-ab71-c5c4bdb1807e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.725s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:16.136473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:20.606271 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00034181299997726455 future=<Future at 0x71a75c3cd5e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:27:20.606731 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978425.6058068, 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:27:20.606899 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:27:20.607021 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] VM Stopped (Lifecycle Event)
May 28 14:27:21.109545 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 89413fe5-bd1e-4dac-ab71-c5c4bdb1807e] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:27:21.138923 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:25.064884 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:25.065277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:25.566839 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Starting instance... {{(pid=98269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 14:27:26.111721 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:26.112065 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:26.115191 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 14:27:26.115357 np0000001643 nova-compute[98269]: INFO nova.compute.claims [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Claim successful on node np0000001643
May 28 14:27:26.140410 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:27:27.223307 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:27:27.223666 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:27:27.725641 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:27:28.232260 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.120s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:28.232695 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Start building networks asynchronously for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 14:27:28.738320 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Allocating IP information in the background. {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 14:27:28.892027 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] allocate_for_instance() {{(pid=98269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 14:27:28.892475 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:28.892855 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:28.954817 np0000001643 nova-compute[98269]: DEBUG nova.policy [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b24afd65ee7940c29ab00493368e2417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbeafad41ae4c0696b9aaf07b5e21b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98269) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 14:27:29.354099 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Successfully created port: b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 14:27:29.384189 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 14:27:29.770347 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Successfully updated port: b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 14:27:29.813757 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-changed-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:27:29.813941 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Refreshing instance network info cache due to event network-changed-b0085d59-aa63-49ef-b59e-6aced1bb73d6. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:27:29.814138 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] Acquiring lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:27:29.814226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] Acquired lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:27:29.814431 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Refreshing network info cache for port b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:27:29.887112 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Start building block device mappings for instance. {{(pid=98269) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 14:27:30.272198 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:27:30.316198 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:30.368955 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:27:30.390591 np0000001643 nova-compute[98269]: INFO nova.virt.block_device [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Booting with volume 130827ad-2340-4d76-9795-50174a0d8d16 at /dev/vda
May 28 14:27:30.425157 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.222', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001643', 'execute': None}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:27:30.435678 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.scaleio [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98269) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 14:27:30.454305 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): nvme version {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:27:30.499118 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] 'nvme version' failed. Not Retrying. {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 14:27:30.500566 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] nvme not present on system {{(pid=98269) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 14:27:30.503461 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:27:30.512618 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98269) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 14:27:30.513279 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.lightos [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Current host hostNQN  and IP(s) are ['10.4.3.222', 'fe80::f816:3eff:fe9e:d5b0', '192.168.40.6', 'fe80::f816:3eff:feab:c6eb', '192.168.50.6', 'fe80::f816:3eff:fe00:a428', '192.168.10.6', 'fe80::f816:3eff:fe07:d9e0', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f44b:ddff:feaa:1044'] 
May 28 14:27:30.513397 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 14:27:30.513532 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.lightos [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] LIGHTOS: no hostnqn found. {{(pid=98269) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 14:27:30.513746 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.222', 'host': 'np0000001643', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5e13aa5813e1', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'b7ee3189-dc86-4151-9082-28c325413c1b', 'nvme_native_multipath': False} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:27:30.514188 np0000001643 nova-compute[98269]: DEBUG nova.virt.block_device [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Updating existing volume attachment record: 73af74a8-f632-4d6a-bc16-b61c7014d141 {{(pid=98269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 14:27:31.006251 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-0d2c6ff8-9c82-42e3-954f-b3d3d231f1b7 req-8a9e06cf-986b-4266-9941-71370a729b81 service nova] Releasing lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:27:31.006869 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquired lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:27:31.007067 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Building network info cache for instance {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 14:27:31.142381 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:31.597276 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Instance cache missing network info. {{(pid=98269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 14:27:31.734031 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:31.847824 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Updating instance_info_cache with network_info: [{"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:27:32.349587 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Releasing lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:27:32.349944 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Instance network_info: |[{"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 14:27:32.605313 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Start spawning the instance on the hypervisor. {{(pid=98269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 14:27:32.606434 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Creating instance directory {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 14:27:32.606721 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Creating image(s)
May 28 14:27:32.607110 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Did not create local disks {{(pid=98269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 14:27:32.607262 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Ensure instance console log exists: /opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f/console.log {{(pid=98269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 14:27:32.607540 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:32.607748 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:32.607906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:32.608340 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Start _get_guest_xml network_info=[{"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '73af74a8-f632-4d6a-bc16-b61c7014d141', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2a0bf144-3297-42f5-b066-c6f850d3b25f', 'attached_at': '', 'detached_at': '', 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'serial': '130827ad-2340-4d76-9795-50174a0d8d16'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 14:27:32.612439 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:27:32.613430 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-2042541102', uuid='2a0bf144-3297-42f5-b066-c6f850d3b25f'), owner=OwnerMeta(userid='b24afd65ee7940c29ab00493368e2417', username='tempest-TestEncryptedCinderVolumes-373548889-project-member', projectid='6bbeafad41ae4c0696b9aaf07b5e21b2', projectname='tempest-TestEncryptedCinderVolumes-373548889'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779978452.6131191) {{(pid=98269) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 14:27:32.614454 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V1... {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 14:27:32.614763 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU controller missing on host. {{(pid=98269) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 14:27:32.615750 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching host: 'np0000001643' for CPU controller through CGroups V2... {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 14:27:32.615931 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU controller found on host. {{(pid=98269) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 14:27:32.616950 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 14:27:32.617231 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T13:59:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 14:27:32.617407 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flavor limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 14:27:32.617555 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Image limits 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 14:27:32.617743 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flavor pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 14:27:32.617824 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Image pref 0:0:0 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 14:27:32.617974 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 14:27:32.618138 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 14:27:32.618231 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 14:27:32.618337 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Got 1 possible topologies {{(pid=98269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 14:27:32.618457 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 14:27:32.618598 np0000001643 nova-compute[98269]: DEBUG nova.virt.hardware [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 14:27:32.627973 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Calling os-brick to attach iSCSI Volume {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 14:27:32.628328 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:27:32.628478 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:27:32.628784 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:27:32.628956 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 14:27:32.639990 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:27:32.640575 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:27:32.640994 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:27:32.641232 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:27:32.641596 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:27:32.641798 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:27:32.652039 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:27:32.652039 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:32.652614 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 14:27:32.652614 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:32.663499 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16] added
May 28 14:27:32.663499 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:27:32.663499 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:27:32.663499 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:27:32.663499 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:27:32.663499 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:27:32.663499 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:32.663801 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:27:32.663881 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:27:32.664059 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:27:32.665960 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16] added
May 28 14:27:32.665960 np0000001643 nova-compute[98269]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 14:27:32.665960 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:27:32.665960 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:27:32.665960 np0000001643 nova-compute[98269]: iscsiadm: Config file line 363 does not have value
May 28 14:27:32.665960 np0000001643 nova-compute[98269]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 14:27:32.665960 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:32.666170 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98269) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 14:27:32.666255 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 14:27:32.666430 np0000001643 nova-compute[98269]: DEBUG os_brick.utils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98269) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 14:27:33.664538 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 14:27:33.667533 np0000001643 nova-compute[98269]: INFO os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.40.100
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:27:33.674947 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:27:33.674947 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.name = iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.tpgt = -1
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.startup = manual
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.leading_login = No
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.iscsi_ifacename = default
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.net_ifacename = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.ipaddress = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.prefix_len = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.hwaddress = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.transport_name = tcp
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.initiatorname = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.state = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.vlan_id = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.vlan_priority = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.vlan_state = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.iface_num = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.mtu = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.port = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.bootproto = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.subnet_mask = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.gateway = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id_state = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_alt_client_id = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_dns = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_learn_iqn = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_req_vendor_id_state = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id_state = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_vendor_id = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.dhcp_slp_da = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.fragmentation = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.gratuitous_arp = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.incoming_forwarding = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.tos_state = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.tos = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.ttl = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.delayed_ack = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.tcp_nagle = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.tcp_wsf_state = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.tcp_wsf = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.tcp_timer_scale = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.tcp_timestamp = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.redirect = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.def_task_mgmt_timeout = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.header_digest = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.data_digest = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.immediate_data = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.initial_r2t = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.data_seq_inorder = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.data_pdu_inorder = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.erl = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.max_receive_data_len = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.first_burst_len = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.max_outstanding_r2t = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.max_burst_len = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.chap_auth = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.bidi_chap = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.strict_login_compliance = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.discovery_auth = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: iface.discovery_logout = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.discovery_address = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.discovery_port = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.discovery_type = fw
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.initial_cmdsn = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.initial_login_retry_max = 8
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.xmit_thread_priority = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.cmds_max = 128
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.queue_depth = 32
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.nr_sessions = 1
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.auth.authmethod = None
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.auth.username = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.auth.password = ***
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.auth.username_in = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.auth.password_in = <empty>
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.auth.chap_algs = SHA256
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.timeo.replacement_timeout = 120
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.err_timeo.abort_timeout = 15
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.err_timeo.lu_reset_timeout = 30
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.err_timeo.host_reset_timeout = 60
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.FastAbort = Yes
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.InitialR2T = No
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.ImmediateData = Yes
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.FirstBurstLength = 262144
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.MaxBurstLength = 16776192
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Retain = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.DefaultTime2Wait = 2
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.MaxConnections = 1
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.iscsi.ERL = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.scan = auto
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.session.reopen_max = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].address = 192.168.50.100
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].port = 3260
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].startup = manual
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].tcp.window_size = 524288
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].tcp.type_of_service = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].timeo.logout_timeout = 15
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].timeo.login_timeout = 15
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].timeo.auth_timeout = 45
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_interval = 5
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].timeo.noop_out_timeout = 5
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].iscsi.HeaderDigest = None
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].iscsi.DataDigest = None
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].iscsi.IFMarker = No
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: node.conn[0].iscsi.OFMarker = No
May 28 14:27:33.680661 np0000001643 nova-compute[98269]: # END RECORD
May 28 14:27:33.680661 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:33.686030 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:33.692556 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:33.696967 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:27:33.696967 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:27:33.697105 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:27:33.697105 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:27:33.697228 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:27:33.697228 np0000001643 nova-compute[98269]: 
May 28 14:27:33.704999 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 14:27:33.704999 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:27:33.705102 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 14:27:33.705102 np0000001643 nova-compute[98269]:  {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:27:33.705240 np0000001643 nova-compute[98269]: WARNING os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 14:27:33.705240 np0000001643 nova-compute[98269]: 
May 28 14:27:34.732839 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.40.100,3260]
May 28 14:27:34.732839 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.40.100,3260] successful.
May 28 14:27:34.732839 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:34.733668 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.50.100,3260]
May 28 14:27:34.733668 np0000001643 nova-compute[98269]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.50.100,3260] successful.
May 28 14:27:34.733668 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:34.744913 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:34.749870 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:27:34.757641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.757641 np0000001643 nova-compute[98269]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.757641 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:27:34.757641 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.757641 np0000001643 nova-compute[98269]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.757641 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:27:34.757940 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.117s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:27:34.758043 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to 192.168.40.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:27:34.758518 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] HCTL ('7', '-', '-', 0) found on session 231 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:27:34.758617 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:27:34.763969 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.763969 np0000001643 nova-compute[98269]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.763969 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:27:34.764163 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.764163 np0000001643 nova-compute[98269]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:27:34.764163 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:27:34.764518 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.123s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:27:34.764661 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to 192.168.50.100:3260 {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 14:27:34.765134 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] HCTL ('8', '-', '-', 0) found on session 232 with lun 0 {{(pid=98269) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 14:27:34.765251 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98269) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 14:27:34.775920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching for a device in session 231 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:27:34.775920 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:27:34.780139 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching for a device in session 232 and hctl ['8', '*', '*', 0] yield: None {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:27:35.779643 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Searching for a device in session 232 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98269) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 14:27:35.780108 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98269) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 14:27:36.144770 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:36.656390 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Found WWN 3300000004ca78950 for multipath device dm-0 {{(pid=98269) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 14:27:36.656675 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:27:36.657655 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '3300000004ca78950', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000004ca78950'} {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:27:36.657809 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004ca78950', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000004ca78950'} {{(pid=98269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 14:27:36.682891 np0000001643 nova-compute[98269]: DEBUG os_brick.encryptors [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '2a0bf144-3297-42f5-b066-c6f850d3b25f', 'attached_at': '', 'detached_at': '', 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'serial': '130827ad-2340-4d76-9795-50174a0d8d16'} {{(pid=98269) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 14:27:36.683359 np0000001643 nova-compute[98269]: WARNING stevedore.named [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 14:27:36.683597 np0000001643 nova-compute[98269]: WARNING castellan.key_manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:27:36.683750 np0000001643 nova-compute[98269]: WARNING nova.keymgr.conf_key_mgr [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 14:27:36.698547 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.host [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 14:27:36.698547 np0000001643 nova-compute[98269]:   <usage type="volume">
May 28 14:27:36.698547 np0000001643 nova-compute[98269]:     <volume>130827ad-2340-4d76-9795-50174a0d8d16</volume>
May 28 14:27:36.698547 np0000001643 nova-compute[98269]:   </usage>
May 28 14:27:36.698547 np0000001643 nova-compute[98269]: </secret>
May 28 14:27:36.698547 np0000001643 nova-compute[98269]:  {{(pid=98269) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 14:27:37.207669 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2042541102',display_name='tempest-TestEncryptedCinderVolumes-server-2042541102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-2042541102',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgyueuyA0Ov/KsnzDbAyYg3w44E6zk3fd4WxOvLapcDPYWvuXWiZUthJfz5NBsCyrT+aXRdtD7yYca+A5/MDKo4Tb5SRzv+eRH3/z+u2JVphjATjhT1RHCgLbcDu3n7Q==',key_name='tempest-TestEncryptedCinderVolumes-404173636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-0jk6c2i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:27:30Z,user_data=None,user_id='b24afd65ee7940c29ab00493368e2417',uuid=2a0bf144-3297-42f5-b066-c6f850d3b25f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 14:27:37.208135 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:27:37.208481 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=b0085d59-aa63-49ef-b59e-6aced1bb73d6,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0085d59-aa') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:27:37.209427 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a0bf144-3297-42f5-b066-c6f850d3b25f {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:27:37.712291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] End _get_guest_xml xml=<domain type="qemu">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <uuid>2a0bf144-3297-42f5-b066-c6f850d3b25f</uuid>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <name>instance-00000052</name>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <memory>196608</memory>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <vcpu>1</vcpu>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <metadata>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:package version="33.1.0"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-2042541102</nova:name>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:creationTime>2026-05-28 14:27:32</nova:creationTime>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:flavor name="m1.nano" id="42">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:memory>192</nova:memory>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:disk>1</nova:disk>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:swap>0</nova:swap>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:ephemeral>0</nova:ephemeral>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:vcpus>1</nova:vcpus>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:extraSpecs>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         </nova:extraSpecs>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       </nova:flavor>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:image uuid="">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:minDisk>1</nova:minDisk>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:minRam>0</nova:minRam>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:properties>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         </nova:properties>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       </nova:image>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:owner>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:user uuid="b24afd65ee7940c29ab00493368e2417">tempest-TestEncryptedCinderVolumes-373548889-project-member</nova:user>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:project uuid="6bbeafad41ae4c0696b9aaf07b5e21b2">tempest-TestEncryptedCinderVolumes-373548889</nova:project>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       </nova:owner>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:root type="volume" uuid=""/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <nova:ports>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <nova:port uuid="b0085d59-aa63-49ef-b59e-6aced1bb73d6">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         </nova:port>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       </nova:ports>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </nova:instance>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   </metadata>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <sysinfo type="smbios">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <system>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <entry name="product">OpenStack Nova</entry>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <entry name="version">33.1.0</entry>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <entry name="serial">2a0bf144-3297-42f5-b066-c6f850d3b25f</entry>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <entry name="uuid">2a0bf144-3297-42f5-b066-c6f850d3b25f</entry>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <entry name="family">Virtual Machine</entry>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </system>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   </sysinfo>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <os>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <boot dev="hd"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <smbios mode="sysinfo"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   </os>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <features>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <acpi/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <tcg>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <tb-cache unit="MiB">128</tb-cache>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </tcg>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <vmcoreinfo/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   </features>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <iothreads>1</iothreads>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <clock offset="utc"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <cpu mode="custom" match="exact">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <model>Nehalem</model>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <topology sockets="1" cores="1" threads="1"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   </cpu>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   <devices>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <disk type="file" device="cdrom">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <source file="/opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f/disk.config"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <target dev="hda" bus="ide"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </disk>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <disk type="block" device="disk">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <alias name="ua-130827ad-2340-4d76-9795-50174a0d8d16"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <target dev="vda" bus="virtio"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <serial>130827ad-2340-4d76-9795-50174a0d8d16</serial>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <encryption format="luks">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:         <secret type="passphrase" uuid="8df1b4c6-2cad-4cd9-938e-9849704ff50f"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       </encryption>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </disk>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <interface type="ethernet">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <mac address="fa:16:3e:ed:0e:c9"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <driver name="qemu"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <mtu size="1372"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <target dev="tapb0085d59-aa"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </interface>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <serial type="pty">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <log file="/opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f/console.log" append="off"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </serial>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <video>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <model type="virtio"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </video>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <rng model="virtio">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <backend model="random">/dev/urandom</backend>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </rng>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <controller type="usb" index="0" model="none"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:       <stats period="10"/>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:     </memballoon>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:   </devices>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]: </domain>
May 28 14:27:37.712291 np0000001643 nova-compute[98269]:  {{(pid=98269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Preparing to wait for external event network-vif-plugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T14:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2042541102',display_name='tempest-TestEncryptedCinderVolumes-server-2042541102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-2042541102',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgyueuyA0Ov/KsnzDbAyYg3w44E6zk3fd4WxOvLapcDPYWvuXWiZUthJfz5NBsCyrT+aXRdtD7yYca+A5/MDKo4Tb5SRzv+eRH3/z+u2JVphjATjhT1RHCgLbcDu3n7Q==',key_name='tempest-TestEncryptedCinderVolumes-404173636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-0jk6c2i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T14:27:30Z,user_data=None,user_id='b24afd65ee7940c29ab00493368e2417',uuid=2a0bf144-3297-42f5-b066-c6f850d3b25f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=b0085d59-aa63-49ef-b59e-6aced1bb73d6,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0085d59-aa') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=b0085d59-aa63-49ef-b59e-6aced1bb73d6,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0085d59-aa') {{(pid=98269) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 14:27:37.714931 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:37.715361 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:27:37.715519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 14:27:37.716065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:37.716227 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5228ff6-59d9-5b12-bd24-875674b5193d', '_type': 'linux-noop'}}, row=False) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:27:37.717516 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:37.717835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:27:37.719962 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:37.720088 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0085d59-aa, may_exist=True, interface_attrs={}) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:27:37.720363 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0085d59-aa, col_values=(('qos', UUID('da0dd7b6-a6d3-48e3-a7ad-c5f5da5d82ca')),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:27:37.720584 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0085d59-aa, col_values=(('external_ids', {'iface-id': 'b0085d59-aa63-49ef-b59e-6aced1bb73d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:0e:c9', 'vm-uuid': '2a0bf144-3297-42f5-b066-c6f850d3b25f'}),), if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:27:37.721152 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:37.722275 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:27:37.727022 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:37.727911 np0000001643 nova-compute[98269]: INFO os_vif [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=b0085d59-aa63-49ef-b59e-6aced1bb73d6,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0085d59-aa')
May 28 14:27:39.242652 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name hda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:27:39.243024 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No BDM found with device name vda, not building metadata. {{(pid=98269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 14:27:39.243024 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] No VIF found with MAC fa:16:3e:ed:0e:c9, not building metadata {{(pid=98269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 14:27:39.243307 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Using config drive
May 28 14:27:39.748664 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:39.852051 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Creating config drive at /opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f/disk.config
May 28 14:27:39.854946 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdxd_laht {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:27:39.905815 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdxd_laht" returned: 0 in 0.050s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:27:40.300979 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:40.316992 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:40.402440 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:40.409101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:40.448206 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f6bedcd-a259-4243-a9a9-6664d3e6aad9 req-495c112a-bb90-4067-ab98-52a1c1e4ea67 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-vif-plugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:27:40.448760 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f6bedcd-a259-4243-a9a9-6664d3e6aad9 req-495c112a-bb90-4067-ab98-52a1c1e4ea67 service nova] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:40.448973 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f6bedcd-a259-4243-a9a9-6664d3e6aad9 req-495c112a-bb90-4067-ab98-52a1c1e4ea67 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:40.449144 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3f6bedcd-a259-4243-a9a9-6664d3e6aad9 req-495c112a-bb90-4067-ab98-52a1c1e4ea67 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:40.449274 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3f6bedcd-a259-4243-a9a9-6664d3e6aad9 req-495c112a-bb90-4067-ab98-52a1c1e4ea67 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Processing event network-vif-plugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 14:27:40.645012 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:40.647939 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:40.670044 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:40.827378 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:40.827622 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:27:40.827956 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:27:41.826982 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:41.891955 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978461.8915002, 2a0bf144-3297-42f5-b066-c6f850d3b25f => Started> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:27:41.892109 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] VM Started (Lifecycle Event)
May 28 14:27:41.893098 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 14:27:41.895193 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Guest created on hypervisor {{(pid=98269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 14:27:41.898086 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Instance spawned successfully.
May 28 14:27:41.898538 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 14:27:42.333302 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:42.333652 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:42.333870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:42.334055 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:27:42.394727 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:27:42.396816 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:27:42.404185 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Found default for hw_cdrom_bus of ide {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:27:42.404330 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Found default for hw_disk_bus of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:27:42.404618 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Found default for hw_input_bus of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:27:42.404815 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Found default for hw_pointer_model of None {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:27:42.405017 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Found default for hw_video_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:27:42.405215 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Found default for hw_vif_model of virtio {{(pid=98269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 14:27:42.508195 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1c57501c-a9a3-4a54-bdee-fb73917cd8a0 req-6668e1e2-8298-4b1d-a663-8734366f2e45 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-vif-plugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:27:42.508782 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1c57501c-a9a3-4a54-bdee-fb73917cd8a0 req-6668e1e2-8298-4b1d-a663-8734366f2e45 service nova] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:42.509182 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1c57501c-a9a3-4a54-bdee-fb73917cd8a0 req-6668e1e2-8298-4b1d-a663-8734366f2e45 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:42.509299 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-1c57501c-a9a3-4a54-bdee-fb73917cd8a0 req-6668e1e2-8298-4b1d-a663-8734366f2e45 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:42.509513 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-1c57501c-a9a3-4a54-bdee-fb73917cd8a0 req-6668e1e2-8298-4b1d-a663-8734366f2e45 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] No waiting events found dispatching network-vif-plugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:27:42.509570 np0000001643 nova-compute[98269]: WARNING nova.compute.manager [req-1c57501c-a9a3-4a54-bdee-fb73917cd8a0 req-6668e1e2-8298-4b1d-a663-8734366f2e45 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received unexpected event network-vif-plugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 for instance with vm_state building and task_state spawning.
May 28 14:27:42.721903 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:42.899355 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 14:27:42.899818 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978462.8994014, 2a0bf144-3297-42f5-b066-c6f850d3b25f => Paused> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:27:42.899818 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] VM Paused (Lifecycle Event)
May 28 14:27:42.909696 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Took 10.30 seconds to spawn the instance on the hypervisor.
May 28 14:27:42.910133 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:27:43.351117 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 14:27:43.353532 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:27:43.354321 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:27:43.403237 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:27:43.405497 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:27:43.405987 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=13907MB free_disk=72.62263488769531GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:27:43.406110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:27:43.406325 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:27:43.412093 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Emitting event <LifecycleEvent: 1779978463.4116588, 2a0bf144-3297-42f5-b066-c6f850d3b25f => Resumed> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:27:43.412476 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] VM Resumed (Lifecycle Event)
May 28 14:27:43.423315 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Took 17.35 seconds to build instance.
May 28 14:27:43.915032 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:27:43.918319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 14:27:43.928790 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-a27b2660-fe11-4de8-bdd6-8060eab86d3d tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.863s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:44.294421 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-changed-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:27:44.294648 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Refreshing instance network info cache due to event network-changed-b0085d59-aa63-49ef-b59e-6aced1bb73d6. {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 14:27:44.294820 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] Acquiring lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 14:27:44.294906 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] Acquired lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 14:27:44.295061 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Refreshing network info cache for port b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 14:27:44.461410 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Instance 2a0bf144-3297-42f5-b066-c6f850d3b25f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 14:27:44.461615 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:27:44.461731 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:27:43 up 54 min,  2 users,  load average: 0.89, 2.56, 3.62\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_6bbeafad41ae4c0696b9aaf07b5e21b2': '1', 'io_workload': '0'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:27:44.544581 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:27:44.544786 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:27:44.796963 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:45.047636 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:27:45.090144 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:45.097204 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:27:45.209751 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Updated VIF entry in instance network info cache for port b0085d59-aa63-49ef-b59e-6aced1bb73d6. {{(pid=98269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 14:27:45.210018 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Updating instance_info_cache with network_info: [{"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:27:45.554089 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:27:45.554258 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.148s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:27:45.554563 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:27:45.711955 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-12388c86-2aa1-4288-a619-c552df1de7fd req-102a6106-35f4-4445-a852-0bc5749ffb5a service nova] Releasing lock "refresh_cache-2a0bf144-3297-42f5-b066-c6f850d3b25f" {{(pid=98269) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 14:27:46.554793 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:46.555223 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:46.555362 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:46.555610 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:46.555945 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.27 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:27:47.722857 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:49.827289 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:49.827938 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:27:50.091024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:50.823527 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:27:50.823913 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:27:52.724072 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:55.092259 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:27:57.724599 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:00.092607 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:02.725719 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:05.093671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:07.726897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:10.095266 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:12.728263 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:15.095699 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:17.728945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:20.095752 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:21.266133 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:28:21.266669 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:28:21.266669 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:28:21.266769 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:28:21.266942 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:28:21.269217 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Terminating instance
May 28 14:28:21.772369 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Start destroying the instance on the hypervisor. {{(pid=98269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 14:28:21.793734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:21.807838 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:21.810204 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:21.826661 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:21.943727 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3b6cf9ae-e6cd-4b27-8db2-dac69df18f40 req-b98fdcec-dbb4-4f3c-8e69-a8542668b5a0 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-vif-unplugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:28:21.943870 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3b6cf9ae-e6cd-4b27-8db2-dac69df18f40 req-b98fdcec-dbb4-4f3c-8e69-a8542668b5a0 service nova] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:28:21.944475 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3b6cf9ae-e6cd-4b27-8db2-dac69df18f40 req-b98fdcec-dbb4-4f3c-8e69-a8542668b5a0 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:28:21.944641 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-3b6cf9ae-e6cd-4b27-8db2-dac69df18f40 req-b98fdcec-dbb4-4f3c-8e69-a8542668b5a0 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:28:21.944759 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3b6cf9ae-e6cd-4b27-8db2-dac69df18f40 req-b98fdcec-dbb4-4f3c-8e69-a8542668b5a0 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] No waiting events found dispatching network-vif-unplugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:28:21.944867 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-3b6cf9ae-e6cd-4b27-8db2-dac69df18f40 req-b98fdcec-dbb4-4f3c-8e69-a8542668b5a0 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-vif-unplugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:28:21.986310 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:22.084925 np0000001643 nova-compute[98269]: DEBUG nova.utils [None req-2931f67a-4319-49e9-92e9-b98fb2b0ab7e None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.999701283000377 future=<Future at 0x71a77818d640 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:28:22.085819 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998615307000364 future=<Future at 0x71a77818d640 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:28:22.086028 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=14.998431394000363 future=<Future at 0x71a77818d640 state=pending>) {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:28:22.087215 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [-] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Instance destroyed successfully.
May 28 14:28:22.087644 np0000001643 nova-compute[98269]: DEBUG nova.objects.instance [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lazy-loading 'resources' on Instance uuid 2a0bf144-3297-42f5-b066-c6f850d3b25f {{(pid=98269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 14:28:22.590292 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.vif [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T14:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2042541102',display_name='tempest-TestEncryptedCinderVolumes-server-2042541102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001643',hostname='tempest-testencryptedcindervolumes-server-2042541102',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgyueuyA0Ov/KsnzDbAyYg3w44E6zk3fd4WxOvLapcDPYWvuXWiZUthJfz5NBsCyrT+aXRdtD7yYca+A5/MDKo4Tb5SRzv+eRH3/z+u2JVphjATjhT1RHCgLbcDu3n7Q==',key_name='tempest-TestEncryptedCinderVolumes-404173636',keypairs=<?>,launch_index=0,launched_at=2026-05-28T14:27:42Z,launched_on='np0000001643',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001643',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bbeafad41ae4c0696b9aaf07b5e21b2',ramdisk_id='',reservation_id='r-0jk6c2i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-373548889',owner_user_name='tempest-TestEncryptedCinderVolumes-373548889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T14:27:43Z,user_data=None,user_id='b24afd65ee7940c29ab00493368e2417',uuid=2a0bf144-3297-42f5-b066-c6f850d3b25f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 14:28:22.590812 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converting VIF {"id": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "address": "fa:16:3e:ed:0e:c9", "network": {"id": "ba4f7552-1a81-401b-8e0a-c79ea829adbd", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-468788386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6bbeafad41ae4c0696b9aaf07b5e21b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0085d59-aa", "ovs_interfaceid": "b0085d59-aa63-49ef-b59e-6aced1bb73d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 14:28:22.591145 np0000001643 nova-compute[98269]: DEBUG nova.network.os_vif_util [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=b0085d59-aa63-49ef-b59e-6aced1bb73d6,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0085d59-aa') {{(pid=98269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 14:28:22.591394 np0000001643 nova-compute[98269]: DEBUG os_vif [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=b0085d59-aa63-49ef-b59e-6aced1bb73d6,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0085d59-aa') {{(pid=98269) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 14:28:22.593218 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:22.593218 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0085d59-aa, bridge=br-int, if_exists=True) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:28:22.595224 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:28:22.595781 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:22.595929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da0dd7b6-a6d3-48e3-a7ad-c5f5da5d82ca) {{(pid=98269) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 14:28:22.597386 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:28:22.598811 np0000001643 nova-compute[98269]: INFO os_vif [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=b0085d59-aa63-49ef-b59e-6aced1bb73d6,network=Network(ba4f7552-1a81-401b-8e0a-c79ea829adbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0085d59-aa')
May 28 14:28:22.601426 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] calling os-brick to detach iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 14:28:22.601777 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x71a7805591c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 14:28:22.601996 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 14:28:22.602383 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 14:28:22.602716 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '130827ad-2340-4d76-9795-50174a0d8d16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 14:28:22.602848 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', 0)] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 14:28:22.625414 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:28:22.625414 np0000001643 nova-compute[98269]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:28:22.625414 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 14:28:22.625670 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsi session list stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:28:22.625670 np0000001643 nova-compute[98269]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16 (non-flash)
May 28 14:28:22.625670 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 14:28:22.625840 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', '231'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', '232')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 14:28:22.626007 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', '231')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:28:22.627067 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16', '232')] {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 14:28:22.627942 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x71a7781179c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'): ({'sdc'}, set())}) {{(pid=98269) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 14:28:22.628236 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Removing multipathed devices sdc, sdb {{(pid=98269) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 14:28:22.628578 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Flush multipath device 3300000004ca78950 {{(pid=98269) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 14:28:22.667663 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:28:22.711011 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98269) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 14:28:22.746959 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 14:28:22.747173 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98269) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 14:28:22.748107 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 14:28:22.758948 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.linuxscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98269) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 14:28:22.759224 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16')] {{(pid=98269) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 14:28:22.769881 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:28:22.799277 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.40.100,3260]
May 28 14:28:22.799277 np0000001643 nova-compute[98269]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.40.100,3260] successful.
May 28 14:28:22.799277 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:28:22.810770 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:28:22.821556 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:28:22.851298 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 232, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.50.100,3260]
May 28 14:28:22.851298 np0000001643 nova-compute[98269]: Logout of [sid: 232, target: iqn.2023-03.storpool.com:os--volume-130827ad-2340-4d76-9795-50174a0d8d16, portal: 192.168.50.100,3260] successful.
May 28 14:28:22.851298 np0000001643 nova-compute[98269]:  stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:28:22.861117 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98269) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 14:28:22.862048 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.base [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 14:28:22.862179 np0000001643 nova-compute[98269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] <== disconnect_volume: return (260ms) None {{(pid=98269) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 14:28:22.862291 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Disconnected iSCSI Volume {{(pid=98269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 14:28:22.862571 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Deleting instance files /opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f_del
May 28 14:28:22.863062 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.driver [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Deletion of /opt/stack/data/nova/instances/2a0bf144-3297-42f5-b066-c6f850d3b25f_del complete
May 28 14:28:23.368946 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Took 1.60 seconds to destroy the instance on the hypervisor.
May 28 14:28:23.369642 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._common.loopingcall [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98269) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 14:28:23.370162 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [-] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Deallocating network for instance {{(pid=98269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 14:28:23.370250 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] deallocate_for_instance() {{(pid=98269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 14:28:23.370568 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:28:23.434921 np0000001643 nova-compute[98269]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 14:28:23.783655 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9ab56fc0-5bb1-4260-af94-60cffafc0f7a req-0fddc515-e161-46cb-88c8-f16c15b17395 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-vif-deleted-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:28:23.784529 np0000001643 nova-compute[98269]: INFO nova.compute.manager [req-9ab56fc0-5bb1-4260-af94-60cffafc0f7a req-0fddc515-e161-46cb-88c8-f16c15b17395 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Neutron deleted interface b0085d59-aa63-49ef-b59e-6aced1bb73d6; detaching it from the instance and deleting it from the info cache
May 28 14:28:23.785885 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-9ab56fc0-5bb1-4260-af94-60cffafc0f7a req-0fddc515-e161-46cb-88c8-f16c15b17395 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Detach interface failed, port_id=b0085d59-aa63-49ef-b59e-6aced1bb73d6, reason: Instance 2a0bf144-3297-42f5-b066-c6f850d3b25f could not be found. {{(pid=98269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 14:28:23.997427 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-44ad915a-d862-49b2-876a-c650dbe4349a req-87ed299d-5ff6-4088-9f98-a8f5ab98e168 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-vif-unplugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 14:28:23.997662 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-44ad915a-d862-49b2-876a-c650dbe4349a req-87ed299d-5ff6-4088-9f98-a8f5ab98e168 service nova] Acquiring lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:28:23.997983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-44ad915a-d862-49b2-876a-c650dbe4349a req-87ed299d-5ff6-4088-9f98-a8f5ab98e168 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:28:23.998288 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [req-44ad915a-d862-49b2-876a-c650dbe4349a req-87ed299d-5ff6-4088-9f98-a8f5ab98e168 service nova] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:28:23.998288 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-44ad915a-d862-49b2-876a-c650dbe4349a req-87ed299d-5ff6-4088-9f98-a8f5ab98e168 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] No waiting events found dispatching network-vif-unplugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 {{(pid=98269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 14:28:23.998745 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [req-44ad915a-d862-49b2-876a-c650dbe4349a req-87ed299d-5ff6-4088-9f98-a8f5ab98e168 service nova] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Received event network-vif-unplugged-b0085d59-aa63-49ef-b59e-6aced1bb73d6 for instance with task_state deleting. {{(pid=98269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 14:28:24.241938 np0000001643 nova-compute[98269]: DEBUG nova.network.neutron [-] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Updating instance_info_cache with network_info: [] {{(pid=98269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 14:28:24.744030 np0000001643 nova-compute[98269]: INFO nova.compute.manager [-] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Took 1.37 seconds to deallocate network for instance.
May 28 14:28:25.097774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:25.290569 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Took 0.55 seconds to detach 1 volumes for instance.
May 28 14:28:25.796408 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:28:25.796548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:28:25.879432 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:28:25.879645 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:28:26.382067 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:28:26.888350 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.092s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:28:26.931195 np0000001643 nova-compute[98269]: INFO nova.scheduler.client.report [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Deleted allocations for instance 2a0bf144-3297-42f5-b066-c6f850d3b25f
May 28 14:28:27.596665 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:27.938374 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-d984d57c-1a8c-4352-952f-7e38d2f816c0 tempest-TestEncryptedCinderVolumes-373548889 tempest-TestEncryptedCinderVolumes-373548889-project-member] Lock "2a0bf144-3297-42f5-b066-c6f850d3b25f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.672s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:28:31.778466 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:32.597734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:33.229218 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:37.084775 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x71a7845af8c0>>, remaining_delay=-0.00034801499987224815 future=<Future at 0x71a77818d640 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x71a782a2c830> {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:28:37.085399 np0000001643 nova-compute[98269]: DEBUG nova.virt.driver [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] Emitting event <LifecycleEvent: 1779978502.084328, 2a0bf144-3297-42f5-b066-c6f850d3b25f => Stopped> {{(pid=98269) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 14:28:37.085550 np0000001643 nova-compute[98269]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98269) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 14:28:37.085660 np0000001643 nova-compute[98269]: INFO nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] VM Stopped (Lifecycle Event)
May 28 14:28:37.587881 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-90295c32-c034-41c3-9c8f-721c1473ee75 tempest-TestVolumeBootPattern-1916664954 tempest-TestVolumeBootPattern-1916664954-project-member] [instance: 2a0bf144-3297-42f5-b066-c6f850d3b25f] Checking state {{(pid=98269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 14:28:37.598636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:41.826960 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:41.827319 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:28:41.827319 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:41.827432 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:28:42.056479 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:28:42.329384 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:28:42.600106 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:43.328953 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:43.834105 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:28:43.834261 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:28:43.834402 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:28:43.834528 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:28:43.844999 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:28:43.845738 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:28:43.891398 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:28:43.891768 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14044MB free_disk=72.61257553100586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:28:43.892841 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:28:43.893971 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:28:44.942068 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:28:44.942596 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:28:43 up 55 min,  2 users,  load average: 0.75, 2.23, 3.43\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:28:44.987906 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:28:44.988194 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:28:45.490965 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:28:45.996922 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:28:45.997330 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.103s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:28:45.997330 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:28:46.495415 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:46.495664 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:46.495917 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:46.496110 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:46.496403 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.33 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:28:46.827137 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:46.827246 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:28:47.329163 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:28:47.329641 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:28:47.600807 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:50.827134 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:50.827581 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:50.827581 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:51.329542 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:28:52.324916 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:28:52.325352 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.70 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:28:52.601845 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:28:57.602938 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:02.603638 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:03.024714 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:03.026570 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:29:07.604734 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:11.523691 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:12.027020 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 31.80 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:29:12.605680 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:17.606859 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:22.607671 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:27.608633 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:32.614934 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:32.614934 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:32.614934 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:29:32.614934 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:29:32.614934 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:29:32.615568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:37.620563 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:37.620997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:37.620997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:29:37.620997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:29:37.635746 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:37.635941 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:29:42.637048 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:43.827007 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:43.827547 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:43.827547 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:29:43.827547 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:44.331548 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:29:44.331737 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:29:44.331903 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:29:44.332042 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:29:44.342763 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:29:44.343533 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:29:44.387383 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:29:44.387740 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14051MB free_disk=72.612060546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:29:44.387930 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:29:44.388146 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:29:45.554311 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:29:45.554673 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:29:44 up 56 min,  2 users,  load average: 0.27, 1.82, 3.22\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:29:45.594964 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:29:45.632365 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:29:45.632535 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:29:45.669155 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:29:45.709675 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:29:45.751407 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:29:45.751666 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:29:46.254761 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:29:46.763079 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:29:46.763593 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.375s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:29:46.763593 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:29:47.640065 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:47.640427 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:47.640523 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:29:47.640631 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:29:47.649208 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:47.649382 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:29:49.763299 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:49.763908 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:49.763908 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:49.763984 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.06 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:29:50.823569 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:50.824066 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:29:52.657217 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:52.826886 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:29:52.827169 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:29:57.662550 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:57.662945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:29:57.662945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:29:57.662945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:29:57.668192 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:29:57.668334 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:02.673564 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:02.674131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:02.674131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:02.674131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:02.679243 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:02.679479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:07.680971 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:07.681523 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:07.681523 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:07.681523 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:07.689338 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:07.689544 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:12.694830 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:12.694830 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:12.695583 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:12.695583 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:12.701479 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:12.701628 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:17.701945 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:17.702432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:17.702432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:17.702432 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:17.724244 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:17.724413 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:22.725316 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:27.730239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:27.730740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:27.730740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:27.730740 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:27.740200 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:27.740329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:32.742495 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:32.742870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:32.742870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:32.742870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:32.756307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:32.756571 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:37.761972 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:37.761972 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:37.761972 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:37.761972 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:37.771222 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:37.771375 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:42.059371 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:42.772145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:43.826894 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:43.827327 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:44.330821 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:30:44.330992 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:30:44.331088 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:30:44.331241 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:30:44.341612 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:30:44.342340 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:30:44.390482 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:30:44.390832 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14046MB free_disk=72.61152267456055GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:30:44.390995 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:30:44.391265 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:30:45.437866 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:30:45.438213 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:30:44 up 57 min,  2 users,  load average: 0.10, 1.49, 3.01\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:30:45.480230 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:30:45.480420 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:30:45.982963 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:30:46.488527 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:30:46.489046 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.097s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:30:46.489046 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:47.488832 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:47.489350 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:30:47.489350 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.34 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:47.775765 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:47.776107 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:47.776228 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:47.776228 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:47.791333 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:47.791559 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:47.827357 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:47.827581 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:47.827820 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:48.826844 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:48.827261 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:51.823026 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:51.823471 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:52.796780 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:52.797007 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:52.797070 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:52.797143 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:52.802329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:52.802536 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:53.822807 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:53.823253 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:54.826843 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:30:54.827583 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:30:57.803987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:57.803987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:30:57.803987 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:30:57.804635 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:30:57.809341 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:30:57.809530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:02.814389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:02.814389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:02.814389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:02.814389 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:02.823486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:02.823646 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:07.828984 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:07.829489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:07.829489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:07.829489 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:07.833315 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:07.833535 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:12.839021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:12.839021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:12.839021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:12.839754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:12.839754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:12.839754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:12.839754 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:17.845180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:17.845180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:17.845180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:17.845180 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:17.848416 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:17.848416 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:22.864020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:22.864020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:22.864020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:22.864020 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:22.864632 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:22.864632 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:27.869788 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:27.870269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:27.870269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:27.870269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:27.877537 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:27.877768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:32.880634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:32.880634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:32.880634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:32.880634 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:32.885491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:32.885682 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:37.891357 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:37.891357 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:37.891357 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:37.891357 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:37.898488 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:37.898683 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:42.899688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:43.826926 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:43.827148 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:44.331160 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:31:44.331593 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:31:44.331593 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:31:44.331705 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:31:44.343105 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:31:44.343959 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:31:44.387787 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:31:44.388186 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14053MB free_disk=72.61101531982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:31:44.388364 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:31:44.388695 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:31:45.436116 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:31:45.436116 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:31:44 up 58 min,  2 users,  load average: 0.03, 1.21, 2.82\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:31:45.477822 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:31:45.478030 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:31:45.980530 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:31:46.486481 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:31:46.486924 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:31:46.486988 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:31:47.904209 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:47.904636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:47.904636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:47.904636 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:47.909363 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:47.909460 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:49.486718 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:49.487393 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:49.487785 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:49.487785 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:31:49.488055 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.34 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:31:50.827244 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:50.827829 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:31:51.823390 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:51.824062 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:31:52.914661 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:52.915127 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:52.915127 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:52.915127 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:52.923359 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:52.923519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:55.827011 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:31:55.827473 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:31:57.929105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:57.929105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:31:57.929105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:31:57.929105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:31:57.932305 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:31:57.932423 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:02.935239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:02.935239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:02.935239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:02.935239 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:02.944309 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:02.944478 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:07.951300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:12.952908 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:12.953405 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:12.953405 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:12.953405 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:12.965467 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:12.965670 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:17.966300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:17.966300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:17.966300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:17.966300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:17.982835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:17.982835 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:22.993568 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:27.997983 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:27.998444 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:27.998444 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:27.998444 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:28.003352 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:28.003590 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:33.009157 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:33.009157 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:33.009157 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:33.009157 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:33.020494 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:33.020570 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:38.023676 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:38.024210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:38.024210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:38.024210 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:38.036242 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:38.036381 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:42.061866 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:32:43.036774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:43.036929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:43.036929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:43.036929 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:43.051347 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:43.051487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:44.826889 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:44.828158 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:45.331365 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:32:45.331568 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:32:45.331681 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:32:45.331776 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:32:45.341937 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:32:45.343081 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:32:45.385876 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:32:45.386305 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14045MB free_disk=72.61050033569336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:32:45.386501 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:32:45.386739 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:32:46.433369 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:32:46.433707 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:32:45 up 59 min,  2 users,  load average: 0.04, 1.00, 2.65\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:32:46.491875 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:32:46.492127 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:32:46.994763 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:32:47.500580 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:32:47.501235 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.114s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:32:47.501235 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:32:48.056774 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:48.057016 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:48.057105 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:48.057145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:48.059228 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:48.059386 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:51.500566 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:51.501071 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:51.501071 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:51.501071 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:32:51.501319 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.32 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:32:51.823660 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:51.823894 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:32:52.826963 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:52.827370 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:32:53.061303 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:55.827320 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:55.827786 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:32:56.823276 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:32:56.823614 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:32:58.066383 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:58.066744 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:32:58.066744 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:32:58.066744 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:32:58.073378 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:32:58.073581 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:03.074515 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:03.074515 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:03.075039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:03.075039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:03.081656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:03.081656 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:08.087293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:08.087293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:08.087293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:08.087293 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:08.093370 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:08.093556 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:13.099329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:13.099329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:13.099329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:13.099329 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:13.103522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:13.103522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:18.105091 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:18.105091 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:18.105091 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:18.105091 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:18.115391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:18.115624 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:23.116678 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:28.119816 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:28.120496 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:28.120496 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:28.120496 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:28.130295 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:28.130599 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:33.134197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:33.134197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:33.134197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:33.134197 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:33.139351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:33.139351 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:38.144947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:38.144947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:38.144947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:38.144947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:38.163292 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:38.163678 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:41.827274 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:41.827728 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:33:42.329163 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:43.168840 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:43.169310 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:43.169310 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:43.169310 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:43.178343 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:43.178519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:46.329010 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:46.833010 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:33:46.833220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:33:46.833312 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:33:46.833423 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:33:46.844228 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:33:46.844983 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:33:46.890168 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:33:46.890544 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14045MB free_disk=72.60865783691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:33:46.890747 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:33:46.891036 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:33:47.937987 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:33:47.938345 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:33:46 up  1:00,  2 users,  load average: 0.23, 0.87, 2.49\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:33:47.978168 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:33:47.978402 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:33:48.182361 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:48.182361 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:48.182361 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:48.182361 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:48.196476 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:48.196476 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:48.481362 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:33:48.987082 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:33:48.987492 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.096s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:33:48.987492 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:49.485633 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:49.485954 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.34 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:49.826971 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:49.827179 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:49.827357 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:33:49.827592 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:49.827730 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:33:50.329723 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:33:50.330173 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:51.329976 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:51.330505 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:51.823119 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:51.823375 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:51.826862 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:52.328473 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:53.198162 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:54.328384 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:54.328873 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:57.827204 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:33:57.827931 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:33:58.202926 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:58.203096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:33:58.203192 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:33:58.203192 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:33:58.206039 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:33:58.206176 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:03.211516 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:03.211516 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:03.212034 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:03.212034 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:03.217331 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:03.217531 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:08.234852 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:08.234852 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:08.234852 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:08.234852 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:08.235431 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:08.235431 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:13.238686 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:13.239030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:13.239030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:13.239030 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:13.247141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:13.247321 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:18.250511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:18.250511 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:18.250979 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:18.250979 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:18.254031 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:18.254179 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:23.255930 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:28.257886 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:28.258386 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:28.258386 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:28.258386 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:28.279106 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:28.279251 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:33.284242 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:33.284242 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:33.284242 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:33.284242 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:33.291368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:33.291368 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:38.304273 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:42.064364 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:34:43.309563 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:43.310054 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:43.310054 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:43.310054 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:43.312026 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:43.312153 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:46.827750 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:46.828228 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:34:47.826968 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:48.317162 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:48.318170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:48.318170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:48.318170 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:48.327057 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:48.327248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:48.331226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:34:48.331226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:34:48.331226 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:34:48.331476 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:34:48.341797 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:34:48.342710 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:34:48.386331 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:34:48.387277 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14048MB free_disk=72.60815048217773GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:34:48.387277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:34:48.387277 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:34:49.503152 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:34:49.503690 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:34:48 up  1:01,  2 users,  load average: 0.42, 0.80, 2.36\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:34:49.550814 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:34:49.589036 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:34:49.589164 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:34:49.623563 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:34:49.664839 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:34:49.706095 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:34:49.706279 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:34:50.208708 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:34:50.714420 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:34:50.714875 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.327s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:34:50.714920 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:34:53.329473 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:53.329870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:53.329870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:53.329870 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:53.336982 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:53.337136 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:53.714994 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:53.715195 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:53.715378 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:53.715628 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:53.715823 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:34:53.716097 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.11 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:34:54.827315 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:54.827793 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:34:56.823158 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:56.823601 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:34:58.341580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:58.341580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:34:58.341580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:34:58.341580 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:58.351075 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:34:58.351265 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:34:58.826977 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:34:58.827384 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:35:03.354254 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:03.354768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:03.354768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:03.354768 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:03.361084 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:03.361248 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:08.366390 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:08.366797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:08.366797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:08.366797 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:08.378214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:08.378381 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:13.381522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:13.381522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:13.381522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:13.381522 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:13.394245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:13.394491 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:18.395799 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:23.401151 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:23.401151 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:23.401151 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:23.401151 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:23.412253 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:23.412253 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:28.416961 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:28.417393 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:28.417393 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:28.417393 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:28.428141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:28.428335 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:33.433503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:33.433988 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:33.433988 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:33.433988 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:33.444301 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:33.444541 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:38.455001 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:43.456062 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:46.827428 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:46.827911 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:35:48.460963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:48.460963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:48.461493 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:48.461493 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:48.469061 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:48.469240 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:48.827115 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:49.332028 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:35:49.332231 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:35:49.332323 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:35:49.332434 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:35:49.342373 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:35:49.343112 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:35:49.387317 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:35:49.387769 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14043MB free_disk=72.60764694213867GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:35:49.387933 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:35:49.388209 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:35:50.455638 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:35:50.456068 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:35:49 up  1:02,  2 users,  load average: 0.65, 0.77, 2.25\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:35:50.499882 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:35:50.500173 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:35:51.003656 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:35:51.509355 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:35:51.509924 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.121s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:35:51.509924 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:35:53.472981 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:53.473524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:53.473524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:53.473524 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:53.478024 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:53.478212 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:53.509821 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:53.510064 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:53.510251 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:53.510434 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:53.510574 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:35:53.510782 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.32 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:35:55.827181 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:55.827600 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:35:58.483421 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:58.483877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:35:58.483877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:35:58.483877 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:58.497074 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:35:58.497214 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:35:58.827238 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:35:58.827383 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:36:03.499021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:08.500538 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:08.500975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:08.500975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:36:08.500975 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:08.515131 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:08.515354 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:13.516035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:13.516035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:13.516035 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:36:13.516683 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:13.534380 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:13.534380 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:18.535328 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:23.536557 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:23.537300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:23.537300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:36:23.537300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:23.537300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:23.537300 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:28.541749 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:28.542145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:28.542145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:36:28.542145 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:28.549190 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:28.549811 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:33.551079 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:38.556421 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:38.557043 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:38.557043 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:36:38.557043 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:38.570391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:38.570391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:42.066711 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:36:43.571061 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:46.827149 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:36:46.827896 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:36:48.576519 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:48.576963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:48.576963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:36:48.576963 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:48.590279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:48.590279 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:50.826887 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:36:50.827404 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:36:51.330810 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:36:51.330997 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:36:51.331095 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:36:51.331191 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:36:51.341321 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:36:51.342000 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:36:51.386304 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:36:51.386669 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14046MB free_disk=72.60712814331055GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:36:51.386856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:36:51.387049 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:36:52.434000 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:36:52.434561 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:36:51 up  1:03,  2 users,  load average: 0.47, 0.69, 2.12\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:36:52.476186 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:36:52.476388 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:36:52.978995 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:36:53.485033 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:36:53.485528 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:36:53.485528 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:36:53.598625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:53.598625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:36:53.598625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:36:53.598625 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:53.599429 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:36:53.599429 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:36:54.481502 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:36:54.481695 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:36:54.481894 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:36:54.482018 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:36:54.482224 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.34 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:36:55.827111 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:36:55.827629 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:36:58.612205 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:00.823204 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:00.823711 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:37:00.826721 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:00.826985 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:37:03.613751 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:08.615513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:08.615513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:08.615513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:08.616096 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:08.620883 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:08.621046 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:13.626251 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:13.626821 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:13.626821 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:13.626821 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:13.632534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:13.632534 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:18.637922 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:18.637922 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:18.637922 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:18.637922 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:18.650269 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:18.650506 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:23.651688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:28.654951 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:28.655433 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:28.655433 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:28.655433 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:28.662252 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:28.662252 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:33.667465 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:33.667947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:33.667947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:33.667947 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:33.670093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:33.670093 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:38.672379 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:38.672866 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:38.672866 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:38.672866 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:38.678054 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:38.678234 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:43.683497 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:43.683981 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:43.683981 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:43.683981 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:43.693040 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:43.693242 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:46.827287 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:46.828349 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:37:48.700560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:48.700560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:48.700560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:48.700560 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:48.701164 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:48.701164 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:52.823943 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:52.824743 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:37:52.826691 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:52.826902 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:52.827078 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:52.827288 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:37:52.828044 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:53.331382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:37:53.331618 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:37:53.331824 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:37:53.331962 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:37:53.342083 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:37:53.343343 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:37:53.389775 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:37:53.390224 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14045MB free_disk=72.60661697387695GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:37:53.390456 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:37:53.390835 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:37:53.706391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:53.706391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:53.706391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:53.706391 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:53.718123 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:53.718350 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:54.436912 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:37:54.437217 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:37:53 up  1:04,  2 users,  load average: 0.17, 0.56, 1.98\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:37:54.477648 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:37:54.477843 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:37:54.980345 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:37:55.486197 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:37:55.486759 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.096s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:37:55.486759 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:37:58.486530 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:37:58.486956 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.34 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:37:58.734137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:58.734137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:37:58.734137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5015 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:37:58.734137 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:58.734530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:37:58.734659 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:37:58.734782 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:01.827425 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:01.827903 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 14.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:38:03.738008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:03.738516 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:03.738516 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:38:03.738516 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:03.746974 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:38:03.747292 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:08.752416 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:08.752897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:08.752897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:38:08.752897 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:08.756873 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:38:08.757021 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:13.769487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:13.769487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:13.769487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:38:13.769487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:13.770028 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:38:13.770028 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:15.827585 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:15.827585 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:38:15.828032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:38:15.828032 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:38:15.828180 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:38:15.828462 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:38:15.828688 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:38:16.833518 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Verify base images {{(pid=98269) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
May 28 14:38:16.834003 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f
May 28 14:38:16.834003 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555
May 28 14:38:16.834003 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816
May 28 14:38:16.834003 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8
May 28 14:38:16.834003 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e
May 28 14:38:16.834168 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b
May 28 14:38:16.834168 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573
May 28 14:38:16.834230 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743
May 28 14:38:16.834339 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476
May 28 14:38:16.834529 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0
May 28 14:38:16.834529 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d
May 28 14:38:16.834632 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Removable base files: /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555 /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816 /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8 /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573 /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743 /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476 /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0 /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d
May 28 14:38:16.835515 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73c7b08d745939f0c3bda4a68d7168c18dad9d4f
May 28 14:38:16.835515 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/31f70ec784d0bd85b3ed416babb6129d671fe555
May 28 14:38:16.835515 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/42090e032e6febe7315f18c539b9f3a3a079c816
May 28 14:38:16.835515 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/275fcea1acfbf2fbc787a50091e95041944603f8
May 28 14:38:16.835515 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/00f78cdb42496de144d1d7cd89500a3b262f5d5e
May 28 14:38:16.835744 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8dadcf518c3dfdacf04f25cb2f2336ded8c64d5b
May 28 14:38:16.835744 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4fe9ab5b777fa77daa200d14e0ad30a3b2716573
May 28 14:38:16.835836 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/45d209954120862597b4e05919d1830a7b151743
May 28 14:38:16.835968 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d247e6c14755b92f89afa3981dba8a24a5994476
May 28 14:38:16.836734 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f3e8d5529b8ef199150a9ca2d08046dab51afae0
May 28 14:38:16.836734 np0000001643 nova-compute[98269]: INFO nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/29421d96836d3c110a7d59b57cb8941591e81c9d
May 28 14:38:16.836734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Verification complete {{(pid=98269) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
May 28 14:38:16.836734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Verify swap images {{(pid=98269) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
May 28 14:38:16.836734 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.imagecache [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Verify ephemeral images {{(pid=98269) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
May 28 14:38:16.837177 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 30.99 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:38:18.775245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:18.775245 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:18.775750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:38:18.775750 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:18.778073 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:38:18.778247 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:23.797206 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:28.802171 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:28.802692 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:28.802692 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:38:28.802692 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:28.805944 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:38:28.805944 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:33.814530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:33.814530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:33.814530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:38:33.814530 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:33.815141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:38:33.815141 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:38:38.833997 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:42.069188 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:38:43.834513 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:38:47.827218 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:47.827706 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:47.827706 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 14:38:48.329383 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:38:48.849900 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:53.328886 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:53.832553 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:38:53.832839 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:38:53.832839 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:38:53.832937 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:38:53.843087 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:38:53.843759 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:38:53.869155 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:38:53.899430 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:38:53.899748 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14036MB free_disk=72.60609436035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:38:53.899879 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:38:53.900110 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:38:54.952482 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:38:54.952962 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:38:53 up  1:05,  2 users,  load average: 0.16, 0.49, 1.87\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:38:54.997467 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:38:54.997911 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:38:55.500515 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:38:56.006429 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:38:56.006856 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.106s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:38:56.006856 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:56.508599 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:38:57.002804 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:57.003101 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:57.003364 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:57.003646 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:57.003871 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:38:57.004067 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:38:57.004387 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.82 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:38:58.897101 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:00.827168 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:00.827649 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Cleaning up deleted instances {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 14:39:01.329228 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] There are 0 instances to clean {{(pid=98269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 14:39:01.329552 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:39:03.325262 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:03.325742 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:39:03.826987 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:03.827434 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.69 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:39:03.913139 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:08.918331 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:08.918871 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:08.918871 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:39:08.918871 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:08.934760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:08.934760 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:13.939919 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:13.940509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:13.940509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:39:13.940509 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:13.944843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:13.944843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:18.950307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:18.950307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:18.950307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:39:18.950307 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:18.952920 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:18.953031 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:23.955292 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:23.955292 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:23.955914 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:39:23.955914 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:23.972008 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:23.972582 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:27.521887 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:28.025438 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 19.30 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:39:28.980985 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:29.510973 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:30.909430 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:34.001796 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:39.004587 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:39.004587 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:39.004587 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:39:39.004587 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:39.017843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:39.017843 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:44.019172 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:47.330568 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:47.331104 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:39:49.026537 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:53.826928 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:53.827370 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:54.031941 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:54.032192 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:54.032254 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:39:54.032254 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:54.039410 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:54.039598 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:54.331949 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:39:54.332942 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:39:54.333185 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:39:54.333396 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:39:54.346227 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:39:54.347494 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:39:54.397673 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:39:54.398199 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14228MB free_disk=72.60227584838867GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:39:54.398437 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:39:54.398813 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:39:55.583871 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:39:55.584301 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:39:54 up  1:06,  1 user,  load average: 0.18, 0.43, 1.76\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:39:55.625608 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing inventories for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 14:39:55.664108 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Updating ProviderTree inventory for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 14:39:55.664253 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Updating inventory in ProviderTree for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 14:39:55.701423 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing aggregate associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, aggregates: None {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 14:39:55.743172 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Refreshing trait associations for resource provider f568fd9c-b967-45a3-9c51-ad00d748c4b7, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE41,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_SSE42,COMPUTE_ARCH_S390X,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND {{(pid=98269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 14:39:55.784387 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:39:55.784589 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:39:56.287073 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:39:56.792830 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:39:56.793320 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.394s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:39:56.793320 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:39:57.789233 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:57.789505 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:57.789651 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:57.789837 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:39:57.789960 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:39:57.790177 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.04 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:39:59.043828 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:59.044320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:39:59.044320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:39:59.044320 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:39:59.055503 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:39:59.055714 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:04.057512 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:04.827306 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:04.827669 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:40:09.058569 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:09.059063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:09.059063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:09.059063 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:09.072507 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:09.072691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:14.073475 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:14.074068 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:14.074068 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:14.074068 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:14.076321 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:14.076486 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:19.095048 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:19.095048 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:19.095048 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:19.095048 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:19.095678 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:19.095678 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:24.100858 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:24.101437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:24.101437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:24.101437 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:24.112436 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:24.112688 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:29.118258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:29.118258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:29.118258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:29.118258 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:29.129480 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:29.129567 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:34.134442 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:34.134442 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:34.134442 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:34.134442 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:34.138514 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:34.138691 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:39.155117 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:42.072012 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:40:44.156970 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:47.827295 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:47.827748 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:40:49.162487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:49.162487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:49.162487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:49.162487 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:49.169260 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:49.169260 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:53.826952 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:54.174907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:54.174907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 14:40:54.174907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98269) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 14:40:54.174907 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:54.179209 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=98269) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 14:40:54.179404 np0000001643 nova-compute[98269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98269) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 14:40:54.330796 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:40:54.330952 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:40:54.331135 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:40:54.331176 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Auditing locally available compute resources for np0000001643 (node: np0000001643) {{(pid=98269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 14:40:54.342379 np0000001643 nova-compute[98269]: WARNING nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 14:40:54.344382 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 14:40:54.390399 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.processutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 14:40:54.390877 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Hypervisor/Node resource view: name=np0000001643 free_ram=14158MB free_disk=72.52935791015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 14:40:54.391220 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 14:40:54.391459 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 14:40:55.439191 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 14:40:55.439501 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Final resource view: name=np0000001643 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 14:40:54 up  1:07,  2 users,  load average: 0.13, 0.36, 1.65\n'} {{(pid=98269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 14:40:55.480342 np0000001643 nova-compute[98269]: DEBUG nova.virt.libvirt.driver [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98269) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 14:40:55.480565 np0000001643 nova-compute[98269]: DEBUG nova.compute.provider_tree [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed in ProviderTree for provider: f568fd9c-b967-45a3-9c51-ad00d748c4b7 {{(pid=98269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 14:40:55.983037 np0000001643 nova-compute[98269]: DEBUG nova.scheduler.client.report [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Inventory has not changed for provider f568fd9c-b967-45a3-9c51-ad00d748c4b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 14:40:56.489665 np0000001643 nova-compute[98269]: DEBUG nova.compute.resource_tracker [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Compute_service record updated for np0000001643:np0000001643 {{(pid=98269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 14:40:56.490095 np0000001643 nova-compute[98269]: DEBUG oslo_concurrency.lockutils [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 14:40:56.490185 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:40:58.486294 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:58.486762 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:58.486804 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:58.487048 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:58.487221 np0000001643 nova-compute[98269]: DEBUG nova.compute.manager [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 14:40:58.487495 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.34 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 14:40:58.827528 np0000001643 nova-compute[98269]: DEBUG oslo_service.periodic_task [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 14:40:58.827824 np0000001643 nova-compute[98269]: DEBUG oslo.service.backend._threading.loopingcall [None req-19e2045f-20f8-44eb-a500-1dac6797b9b8 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98269) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}